Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Analysis without other submissions #142

Open
dmvt opened this issue Jan 19, 2024 · 9 comments
Open

Analysis without other submissions #142

dmvt opened this issue Jan 19, 2024 · 9 comments

Comments

@dmvt
Copy link

dmvt commented Jan 19, 2024

I propose a change to only allow the submission of an advanced-analysis if at least 1 high or medium risk issue has been submitted.

@bytes032
Copy link

Agreed. Otherwise, it turns into chatbot driven analysis reward pot farming.

@0xSorryNotSorry
Copy link

Majority of the analysis reports don't add anything to the Sponsors as the reports only provide functionality features, summary of the contracts etc. I definitely agree with that there should be an access control to submit analysis reports.

@DadeKuma
Copy link

DadeKuma commented Feb 7, 2024

Totally agree with you.

Maybe we should also add a requirement where the analysis can get a reward only if there is at least 1 valid H/M submitted by the Warden?

Unless the contest has zero valid H/M submissions, in that case this rule shouldn't be applied.

@0xean
Copy link

0xean commented Feb 7, 2024

@dmvt is the requirement that they are valid H/Ms ?

@dmvt
Copy link
Author

dmvt commented Feb 7, 2024

Not necessarily. More that effort was put into them.

@0xean
Copy link

0xean commented Feb 7, 2024

Not necessarily. More that effort was put into them.

so this adds another hoop a judge has to jump through to manually validate? IE is this H/M satisfactory enough in order for me to consider their Analysis report?

@CloudEllie
Copy link

@dmvt from a tooling perspective, an option that might be simpler to implement would be to restrict access to the Analysis submission form to only wardens who have at least one valid HM on the C4 leaderboard. (This could be all-time or time-constrained.)

What do you think of that option, vs submitting a well-argued HM to the same audit?

@MarioPoneder
Copy link

What about both?
To get the Analysis submission form activated one needs:

  • A valid HM on the 365 day leaderboard
  • A HM submission in the current contest

@14si2o
Copy link

14si2o commented Mar 19, 2024

I've also noticed the recent increase in professional chatbot wardens who only submit Analyses.

Perhaps the simplest solution would be to limit Analysis submission to Wardens with backstage access?

  • Only people who actually submitted valid findings in the past can participate
  • No extra work for pre-sorters or judges
  • Should reduce 90%+ of the chatbot spam I hope

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants