Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support nested choice labels #53

Open
mikix opened this issue Jul 25, 2024 · 0 comments
Open

Support nested choice labels #53

mikix opened this issue Jul 25, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@mikix
Copy link
Contributor

mikix commented Jul 25, 2024

This is something that @Dtphelan1 flagged.

Label Studio can set up Choices that are nested below a Label. So maybe you label "Fever" and then have a sub choice of "Mild", "Severe", "Deadly" or something.

Thoughts around supporting this:

  • Label studio does not enforce that a choice is filled in.
  • How to get choice config? Just have the use specify options in the config.yaml, like they do for labels? Maybe re-use grouped-label structure?
  • We'd have to parse the Choices in the export - they are a separate kind of object next to a label (they point at the label, share the same "id" value, and use the same span)
  • How to specify on the CLI whether you want math run the leaf choices vs the roll-up (choices vs labels) - both of which the user might want - could show both by default, but what about when using the --csv flag?
  • The accuracy math will need changes to consider all choices together (like, one FN/FP, not 3 for for the Fever case)
@mikix mikix added the enhancement New feature or request label Jul 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant