Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NON-ISSUE] Cross validating training result #5

Open
louisgv opened this issue Aug 10, 2017 · 5 comments
Open

[NON-ISSUE] Cross validating training result #5

louisgv opened this issue Aug 10, 2017 · 5 comments

Comments

@louisgv
Copy link
Contributor

louisgv commented Aug 10, 2017

Hello,

I would like to cross validate my loss and accuracy with other. Below is my result:

image

@ryanjcooper
Copy link
Owner

ryanjcooper commented Aug 10, 2017

Hi @louisgv, your results seem fairly consistent with my training/test accuracy (~86%). I will be working on a deep-model extension to this project this weekend (hopefully), and I will report my findings.

It seems that creators of this data set reported 69.71% ± 1.47% (see table 3 from here) accuracy using an OPIUM-based model, so this method beats that already. I have no benchmark for state-of-the-art (I would assume that >95% could be achieved using DCNNs).

I will leave this thread open for people to report any model progress or accuracy improvements.

Thanks for your interest!

EDIT:
I also noticed that they reported a peak accuracy of 77.57% ± 0.08% on the by_class set using a deep OPIUM-based classifier, should be noted that they claim that they believe higher accuracy can be achieved.

@jamesyzhb
Copy link

why
image

@jamesyzhb
Copy link

thanks

@ryanjcooper
Copy link
Owner

Hello @jamesyzhb, please open a new issue on the repository, but I believe it is an issue with a version mismatch with this code and Keras. What version of Keras and TensorFlow/Theano are you using?

@jamesyzhb
Copy link

Is a FLask version issue, thanks for the reminder

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants