Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pass max-len argument to server wparams #1574

Merged
merged 1 commit into from
Dec 5, 2023

Conversation

osdrv
Copy link
Contributor

@osdrv osdrv commented Nov 29, 2023

This commit fixes the missing parameter binding for max-len between the input arguments and wparams.

The major difference between examples/main and examples/server is the following:

// main.cpp
wparams.max_len = params.output_wts && params.max_len == 0 ? 60 : params.max_len;

Vs

// server.cpp
wparams.max_len = params.max_len == 0 ? 60 : params.max_len;

I.e. the proposed fix does not take under consideration the open_wts flag as it is not backported to the server yet. I'm happy to backport wts if it could be of use, as a separate PR.

This commit fixes the missing parameter binding for max-len between the input
arguments and wparams.
@ggerganov ggerganov merged commit 3163090 into ggerganov:master Dec 5, 2023
37 checks passed
@osdrv osdrv deleted the osdrv/server-params-max-len branch December 5, 2023 21:02
@osdrv
Copy link
Contributor Author

osdrv commented Dec 5, 2023

Thanks folks, much appreciated!

@linmi
Copy link

linmi commented Dec 13, 2023

🎉 Looking forward to open_wts

landtanin pushed a commit to landtanin/whisper.cpp that referenced this pull request Dec 16, 2023
This commit fixes the missing parameter binding for max-len between the input
arguments and wparams.
bygreencn added a commit to bygreencn/whisper.cpp that referenced this pull request Dec 20, 2023
* origin/master:
  bench.py : add different large models (ggerganov#1655)
  wchess : update README.md
  release : v1.5.2
  wchess : update readme
  wchess : whisper assisted chess (ggerganov#1595)
  sync : ggml (Metal fixes, new ops, tests) (ggerganov#1633)
  cmake : target windows 8 or above for prefetchVirtualMemory in llama-talk (ggerganov#1617)
  cmake : Fix bug in httplib.h for mingw (ggerganov#1615)
  metal : fix `ggml_metal_log` vargs (ggerganov#1606)
  whisper.objc : disable timestamps for real-time transcription
  whisper : more debug messages + fix fallback logic
  metal : fix soft_max kernel src1 argument (ggerganov#1602)
  sync : ggml (new ops, new backend, etc) (ggerganov#1602)
  server : pass max-len argument to the server (ggerganov#1574)
  ios : Remove `#if arch(arm)` check for using Metal (ggerganov#1561)
  ggml : Fix 32-bit compiler warning (ggerganov#1575)
  ggml : re-enable blas for src0 != F32 (ggerganov#1583)
iThalay pushed a commit to iThalay/whisper.cpp that referenced this pull request Sep 23, 2024
This commit fixes the missing parameter binding for max-len between the input
arguments and wparams.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants