Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance on MR dataset #29

Open
nick11roberts opened this issue Sep 19, 2020 · 2 comments
Open

Performance on MR dataset #29

nick11roberts opened this issue Sep 19, 2020 · 2 comments

Comments

@nick11roberts
Copy link

nick11roberts commented Sep 19, 2020

Hi there, I see that the best reported accuracy for this repo for the MR dataset is 77.5% using CNN-rand-static. When I run this, using ./main.py -device=0 -static, I get much lower numbers (~70%). Two questions:

  1. What training settings are you using to get 77.5%?
  2. How are you evaluating on the MR dataset to get 77.5%?

Thanks!

@A11en0
Copy link

A11en0 commented Jun 3, 2021

same problem.

@A11en0
Copy link

A11en0 commented Jun 3, 2021

Hi there, I see that the best reported accuracy for this repo for the MR dataset is 77.5% using CNN-rand-static. When I run this, using ./main.py -device=0 -static, I get much lower numbers (~70%). Two questions:

  1. What training settings are you using to get 77.5%?
  2. How are you evaluating on the MR dataset to get 77.5%?

Thanks!

How did you handle the problem?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants