Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

关于score结果的疑问 #22

Closed
mzp1121 opened this issue May 30, 2023 · 3 comments
Closed

关于score结果的疑问 #22

mzp1121 opened this issue May 30, 2023 · 3 comments

Comments

@mzp1121
Copy link

mzp1121 commented May 30, 2023

请问最终得分有什么具体的参考意义吗?还是说只是用来排序的?

@xujz18
Copy link
Member

xujz18 commented May 30, 2023

首先肯定能用于排序。其次,最终得分在ImageReward的测试集上均值为0,标准差为1,可以看成近似正态分布(虽然不严格等于)。
(Here is the English version of the answer) Firstly it can definitely be used for sorting. Secondly, the final score has a mean of 0 and a standard deviation of 1 on the test set of ImageReward, which can be seen as approximately normally distributed (although not strictly equal).

@mzp1121
Copy link
Author

mzp1121 commented May 31, 2023

那是否存在一个阈值?高于这个阈值,认为图像生成是ok的,低于这个阈值,生成是不好的

@xujz18
Copy link
Member

xujz18 commented May 31, 2023

这个阈值根据使用者的实际需求和所用数据集,可以人为设定,例如你可以根据分数筛选top5%、top10%、top50%,等等。
(Here is the English version of the answer) This threshold can be set artificially depending on the actual needs of the user and the data set used, e.g. you can filter top5%, top10%, top50%, etc. based on the score.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants