Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(silero): add Silero-vad backend #4204

Merged
merged 8 commits into from
Nov 20, 2024
Merged

feat(silero): add Silero-vad backend #4204

merged 8 commits into from
Nov 20, 2024

Conversation

mudler
Copy link
Owner

@mudler mudler commented Nov 20, 2024 •
edited
Loading

Description

This PR adds the silero VAD backend to enable voice activity detection (https://en.wikipedia.org/wiki/Voice_activity_detection).

Example modelfile:

name: vad
backend: silero-vad
parameters:
  model: silero_vad.onnx

Notes for Reviewers

This has been extracted as part of #3722

#1126

Signed commits

  • Yes, I signed my commits.

@mudler
feat(vad): add silero-vad backend (WIP)
a234772 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler
feat(vad): add API endpoint
a97f239 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler
fix(vad): correctly place the onnxruntime libs
dabe748 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler
chore(vad): hook silero-vad to binary and container builds
eec0fb9 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler mudler added the enhancement New feature or request label Nov 20, 2024
@netlify Netlify
Copy link

netlify bot commented Nov 20, 2024 •
edited
Loading

✅ Deploy Preview for localai ready!

Name Link
🔨 Latest commit 1b40c57
🔍 Latest deploy log https://app.netlify.com/sites/localai/deploys/673de37d064b860008d39b6f
😎 Deploy Preview https://deploy-preview-4204--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@mudler
feat(gRPC): register VAD Server
389e55b 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler mudler mentioned this pull request Nov 20, 2024
Draft
1 task
@mudler
fix(Makefile): consume ONNX_OS consistently
fdbf125 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler mudler force-pushed the feat/silero-vad branch 3 times, most recently from c5f2682 to 2b365ee Compare November 20, 2024 10:35
@mudler
fix(Makefile): handle macOS
2a68c92 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler
Merge branch 'master' into feat/silero-vad
1b40c57 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
@mudler mudler merged commit b1ea931 into master Nov 20, 2024
30 of 31 checks passed
@mudler mudler deleted the feat/silero-vad branch November 20, 2024 13:48
@BrewTestBot BrewTestBot mentioned this pull request Dec 4, 2024
Merged
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@mudler