Code

feat: Realtime API support#3722

Code

Draft

mudler wants to merge 29 commits intomastermudler/LocalAI:masterfrom feat/realtimemudler/LocalAI:feat/realtimeCopy head branch name to clipboard

+1,482-146

Commits

Commits on Jan 14, 2025

• WIP

  Show description for 8f507c3
  mudler

  committed
  8f507c3

  Copy full SHA for 8f507c3

• WIP

  Show description for dcb13a7
  mudler

  committed
  dcb13a7

  Copy full SHA for dcb13a7

• debug

  Show description for 4ca7689
  mudler

  committed
  4ca7689

  Copy full SHA for 4ca7689

• aujdio

  Show description for 9b6826d
  mudler

  committed
  9b6826d

  Copy full SHA for 9b6826d

• Add model interface to sessions

  Show description for f45d11c
  mudler

  committed
  f45d11c

  Copy full SHA for f45d11c

• setup ws upgrade

  Show description for 65f4c12
  mudler

  committed
  65f4c12

  Copy full SHA for 65f4c12

• Fix route

  Show description for 05225c9
  mudler

  committed
  05225c9

  Copy full SHA for 05225c9

• chore: simplify passing options to ModelOptions

  Show description for 9e96503
  mudler

  committed
  9e96503

  Copy full SHA for 9e96503

• Load wrapper clients

  Show description for b4fea58
  mudler

  committed
  b4fea58

  Copy full SHA for b4fea58

• refactor

  Show description for 60c99dd
  mudler

  committed
  60c99dd

  Copy full SHA for 60c99dd

• feat: correctly detect when starting the vad server

  Show description for 4f69170
  mudler

  committed
  4f69170

  Copy full SHA for 4f69170

• chore: extract realtime models into two categories

  Show description for 1796a17
  mudler

  committed
  1796a17

  Copy full SHA for 1796a17

• feat(vad): hook vad detection

  Show description for a3fd8ca
  mudler

  committed
  a3fd8ca

  Copy full SHA for a3fd8ca

• chore(vad): try to hook vad to received data from the API (WIP)

  Show description for 9614422
  mudler

  committed
  9614422

  Copy full SHA for 9614422

• Attach context for VAD

  Show description for 0318434
  mudler

  committed
  0318434

  Copy full SHA for 0318434

• Move to debug calls

  Show description for 9273395
  mudler

  committed
  9273395

  Copy full SHA for 9273395

• Fix lock handling

  Show description for 5953156
  mudler

  committed
  5953156

  Copy full SHA for 5953156

• wip(vad)

  Show description for 136fbd2
  mudler

  committed
  136fbd2

  Copy full SHA for 136fbd2

• gRPC client stubs

  Show description for ebfe8dd
  mudler

  committed
  ebfe8dd

  Copy full SHA for ebfe8dd

• wip

  Show description for 3dd1b30
  mudler

  committed
  3dd1b30

  Copy full SHA for 3dd1b30

• WIP

  Show description for 06e438d
  mudler

  committed
  06e438d

  Copy full SHA for 06e438d

• Small adaptations

  Show description for c526f05
  mudler

  committed
  c526f05

  Copy full SHA for c526f05

• Use template evaluator for preparing LLM prompt in wrapped mode

  Show description for 7592984
  mudler

  committed
  7592984

  Copy full SHA for 7592984

• WIP - to drop

  Show description for 9020683
  mudler

  committed
  9020683

  Copy full SHA for 9020683

• go tidy

  Show description for 5f2c837
  mudler

  committed
  5f2c837

  Copy full SHA for 5f2c837

• Tweak silero settings

  Show description for 01aace3
  mudler

  committed
  01aace3

  Copy full SHA for 01aace3

• Improve audio detection

  Show description for 30e3c47
  mudler

  committed
  30e3c47

  Copy full SHA for 30e3c47

• WIP - improve start and end of speech detection

  Show description for 9a09820
  mudler

  committed
  9a09820

  Copy full SHA for 9a09820

• more robust approach

  Show description for f272605
  mudler

  committed
  f272605

  Copy full SHA for f272605