Leaderboard: Share this benchmark does not work for custom benchmarks

[Muennighoff]

E.g. when removing / adding custom tasks / languages; ideally the link would change and one could link to that I think

[x-tabdeveloping]

It would indeed be nice... I took the decision not to do that since that would sometimes mean having to include hundreds of tasks in a URL, which would definitely cause issues on a practical level.
One could of course also store the set difference from the original parameters, but it seems a bit overengineered to me.
Though if this is something we really want, I can try to come up with a sensible implementation.

I think this feature would also be substantially more useful if it was possible in Gradio to change the URL path in the header dynamically, as currently there is a mismatch between the URL you see in your browser and the one you copy.

[KennethEnevoldsen]

For now let us add a note that states that it does not work for custom benchmarks

[Muennighoff]

Makes sense; alternative to long URLs could be hashing it into a short string I think

[Muennighoff]

The new multi-pages feature in Gradio may be relevant here: gradio-app/gradio#10433

Thanks @abidlabs for the pointer!