Availability definition #117
Conversation
|
MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅ |
|
Inference WG proposes to add a new column in results table to capture more details on the availability. |
There was a problem hiding this comment.
Thank you @nv-rborkar for updating the availability definition which makes the rules more stringent for a system to go under 'Available` category. The current as well as proposed rule says "pricing available on request" - I suppose this applies to "anyone's request" and not from "restricted companies". Can this clause be made clear?
Can we also have a sub category "Available retail systems" where either the system as a whole or in parts are available in the retail market (public pricing and a buy now link)? This can clearly distinguish systems which anyone can make use of from those which are available only to select customers.
|
@DilipSequeira Just to clarify my ask in the inference meeting this motherboard is an example for a product which is "not clearly" available. We can ask for a quote for this but it is not yet available for "purchase" as someone has asked here. As per my understanding of availability definition, any submission using this "motherboard" must be under preview category. The company here can supply an engineering sample of the product to a reseller and that should not qualify as a "purchase" especially when we put "release" condition for the underlying "software". And this motherboard is a clear example of an available product. Is my understanding correct? |
This PR updates the definition of Availability to allow Results WG to verify availability & reproducibility of submissions.