You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Make the text (history, etc.) expandable only showing few lines first.
Functional Features
Leaderboard form: a submission rule per challenge phase (#1331)
In "Leaderboard form" we can select, among other options, "Force last" or "Force best".
It would be amazing if you could consider adding a functionality where we can select such option for each challenge phase, such that we could select, for example, to use "Force last" in a development phase, and "Force best" in a test (final) phase.
Add option to select topic/hashtags for competition, datasets, etc.
We could have a "type" field, mandatory, where we select between different types: "superviser learning", "NLP", "...", "Other".
We can take inspiration from https://mlcontests.com/
Having a directory in the competition bundle containing files (images, etc.) to which the documentation pages (markdown or HTML) can link to. Right now we need to link images using external URLs instead of having them directly inside the bundle.
Right now, submitting to only one task results in having n/a scores to the other tasks. It would be interesting to be able to submit seperately to different tasks and have the results merged on the leaderboard.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
This discussion is for proposing features for future developments.
UI Features
Dark and light UI (#915)
A feature to toggle light and dark mode for the website. Can also be toggled using system settings
Make UI responsive (#719)
Make changes in the UI to make it mobile-friendly.
Email templates (#1230)
Design good looking email templates for all the emails sent to participants and organizers
Theme matching Dialog (#911)
Design theme matching dialog modals
Expandable text in home page (#1268)
Make the text (history, etc.) expandable only showing few lines first.
Functional Features
Leaderboard form: a submission rule per challenge phase (#1331)
In "Leaderboard form" we can select, among other options, "Force last" or "Force best".
It would be amazing if you could consider adding a functionality where we can select such option for each challenge phase, such that we could select, for example, to use "Force last" in a development phase, and "Force best" in a test (final) phase.
Custom Docker Image for submission (#1149)
Allow participants to select the Docker image of their choice.
Hashtags/Topics (#420)
Add option to select topic/hashtags for competition, datasets, etc.
We could have a "type" field, mandatory, where we select between different types: "superviser learning", "NLP", "...", "Other".
We can take inspiration from https://mlcontests.com/
Multiple leaderboards (#873)
Possibility of splitting the results across multiple tables can be nice
Assets directory (#992)
Having a directory in the competition bundle containing files (images, etc.) to which the documentation pages (markdown or HTML) can link to. Right now we need to link images using external URLs instead of having them directly inside the bundle.
Meta Info in competition page (#1050)
Include meta-data e.g. image, title, description etc. in the competition page
Show data when phase is active (#1207)
Notification Center (#1242)
develop a dedicated notification center
Multitask support (#1237)
Submit independently to tasks (#1570)
Right now, submitting to only one task results in having n/a scores to the other tasks. It would be interesting to be able to submit seperately to different tasks and have the results merged on the leaderboard.
Organizations (#1217, #1240)
Make organizations clear with more functionalities e.g. sharing tasks, datasets etc and more
Uploading of scoring/ingestion program robust to sub-directories (#968)
Only zipping without directory structure works right now. PR #1143 proposed to make this more robust.
Security Features
Encrypt data (#903)
Documentation
Dataset submission bundle (#1013)
Add a good "dataset submissions" bundle in competition-examples
Beta Was this translation helpful? Give feedback.
All reactions