Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Testing always creates same results across 600 test points #83

Open
hiyamgh opened this issue Jan 22, 2021 · 0 comments
Open

Testing always creates same results across 600 test points #83

hiyamgh opened this issue Jan 22, 2021 · 0 comments

Comments

@hiyamgh
Copy link

hiyamgh commented Jan 22, 2021

Hello

Great work thank you very much!!

I am running the testing and I always get the same results after setting NUM_TEST_POINTS = 600

This is a sample of the results:

Restoring model weights from just_testing//cls_2.mbs_8.ubs_16.numstep4.updatelr0.001batchnorm\model999
WARNING:tensorflow:From C:\Users\96171\AppData\Local\Programs\Python\Python36\lib\site-packages\tensorflow\python\training\saver.py:1276: checkpoint_exists (from tensorflow.python.training.checkpoint_management) is deprecated and will be removed in a future version.
Instructions for updating:
Use standard file APIs to check for files with this prefix.
Mean validation accuracy/loss, stddev, and confidence intervals
(array([0.875  , 0.6875 , 0.8125 , 0.78125, 0.6875 , 0.6875 , 0.71875,
       0.78125, 0.6875 , 0.78125, 0.71875]), array([0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.]), array([0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.]))

Process finished with exit code 0

The stddev and the confidence intervals are always 0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant