Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve Visualization #96

Merged
merged 25 commits into from
Oct 18, 2024
Merged

Improve Visualization #96

merged 25 commits into from
Oct 18, 2024

Conversation

thequilo
Copy link
Member

@thequilo thequilo commented Oct 1, 2024

  • Add all supported assignment options to the visualization (cp, tcp, orc, tcorc, greedy_dicp, ...)
  • Add entrypoint meeteval-viz
  • Add option to load a precomputed assignment from a *_per_reco.json file (or an ErrorRate object in the Python interface)
  • Automatically increase the number of minimaps for large examples
  • Show current playhead position in details plot on playback

By clicking on a breadcrumb, the user can navigate the file structure and open any other visualization file from the file system, even files that have not been generated by the same call to meeteval-viz.
… change

This changes the way the alignments are specified. It is now used without a comma, since argparse does not support delimiting arguments with a comma. The upside of this is that we don't have to list all possible combinations in the choices.
The long text if often too wide when empty segments overlap with other segments of the same speaker
- do not change zoom level
- focus matched word instead of containing utterance
- Mark focused word visually
- Highlight the text background so that the highlights are visible even when the boxes are too small
- Only move the view when the next highlighted word is outside the current view area
- Center the word on screen instead of the segment
- Make the animation slower
@thequilo thequilo requested a review from boeddeker October 1, 2024 11:25
nargs='+',
help='Specifies which assigment and alignment are used. If a time-constrained algorithm is '
'selected for the stream assignment, then a time-constrained alignment will be computed, '
'otherwise the "classical" alignment without a time constraint is used.\n'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't get it, why the time constraint alignment is used and where the difference to the assignment is.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I simplified the help text

# - dipco: 2568
# - chime6: 6738
if self.num_minimaps == 'auto':
if len(self.data['utterances']) > 1000:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use length as indicator. Otherwise, lots of overlapping speech triggers the second minimap.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done. Set the threshold to 300s. LibriCSS gets 2 minimaps

@thequilo thequilo merged commit ce8b0f6 into main Oct 18, 2024
6 checks passed
@thequilo thequilo deleted the viz_improvements branch October 18, 2024 11:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants