Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

111 rise with text #15

Merged
merged 25 commits into from
Oct 12, 2021
Merged

111 rise with text #15

merged 25 commits into from
Oct 12, 2021

Conversation

geek-yang
Copy link
Member

@geek-yang geek-yang commented Oct 5, 2021

We expand RISE to work with text.

Specifically, we mask tokens randomly (meaning that we just drop random words) and estimates importance empirically by probing the model with randomly masked versions of the input texts.

The outputs are saliency maps which are prepared for the visualization modules in dianna.

We create corresponding tests for this implementation.

!!Note that this is one possible interpretation of how to apply RISE on text.

close dianna-ai/dianna-exploration#111

@cwmeijer
Copy link
Member

cwmeijer commented Oct 7, 2021

The cffconvert test that is failing should be fixed later as a PR to cffconvert was already made. Some final linting errors need to be solved before merging. Other than that it's ready to merge.

@loostrum loostrum mentioned this pull request Oct 12, 2021
@sonarqubecloud
Copy link

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

99.0% 99.0% Coverage
0.0% 0.0% Duplication

@cwmeijer cwmeijer merged commit da085fd into main Oct 12, 2021
@cwmeijer cwmeijer deleted the 111-rise-with-text branch October 12, 2021 09:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

expand RISE to work with text
4 participants