-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Speaker diarization with whisper transcription #181
Conversation
g scripts, example notebook, unit test, test files and modifies sd deployment
…_speech_confidence values
I cannot comment the notebook, so I will write the comments here.
[s.model_dump(include=["text", "time_interval", "speaker"]) for s in segments]
RuntimeError: Traceback (most recent call last):
File "/workspaces/aana_sdk/aana/deployments/pyannote_speaker_diarization_deployment.py", line 77, in apply_config
self.diarize_model = Pipeline.from_pretrained(self.model_id)
File "/root/.cache/pypoetry/virtualenvs/aana-vIr3-B0u-py3.10/lib/python3.10/site-packages/pyannote/audio/core/pipeline.py", line 138, in from_pretrained
pipeline = Klass(**params)
File "/root/.cache/pypoetry/virtualenvs/aana-vIr3-B0u-py3.10/lib/python3.10/site-packages/pyannote/audio/pipelines/speaker_diarization.py", line 130, in __init__
model: Model = get_model(segmentation, use_auth_token=use_auth_token)
File "/root/.cache/pypoetry/virtualenvs/aana-vIr3-B0u-py3.10/lib/python3.10/site-packages/pyannote/audio/pipelines/utils/getter.py", line 89, in get_model
model.eval()
AttributeError: 'NoneType' object has no attribute 'eval' I did set the HF_TOKEN environment variable to my Hugging Face token. And the model page says: |
…k to speaker_recognition model hub
…update post processor
I have changed the post-processing function into a class to keep the logic organized and the module-specific functions private. However, it has not been moved to diarization deployment because it will kill the flexibility to run the diarization and whisper models in parallel if needed. I think we can keep it this way until we have a specific SDK component that can combine the deployments and additional functions. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good! Great work 👍
This PR addresses the feature request #176.