Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

learning success rates with variable number of attempts #28

Open
cadama opened this issue Mar 28, 2021 · 1 comment
Open

learning success rates with variable number of attempts #28

cadama opened this issue Mar 28, 2021 · 1 comment

Comments

@cadama
Copy link

cadama commented Mar 28, 2021

I am working on a problem where the labels/response variables take the form of #successes / #attempts. Clearly the goodness of the label depends on the number of attempt so I'd like to avoid the model to learn corner cases like y=0, y=1 that essentially occur because not enough attempts have been made.

We generally frame this problem as either a regression task with mse loss and weights given by #attempts or by looking at it as a classification task with label in [0, 1] and weights equal to #attempts - #successes and #successes respectively and trained through binary cross entropy.

Do you have any paper to recommend that tackle this problem?
thanks in advance

@subeeshvasu
Copy link
Owner

HI, I am not familiar with any papers on this topic, but some others might know. So let's keep this issue open.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants