Skip to content

feat: Add no-context option to server #3045

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Apr 16, 2025

Conversation

sachaarbonel
Copy link
Contributor

feat: Add no-context option to server

This PR introduces a --no-context flag (and corresponding HTTP parameter no_context) to the server example. When set to true, the server will process audio requests without using the context from previous audio segments. This is useful for scenarios where each audio chunk should be treated independently.

Changes include:

  • Added no_context boolean field to whisper_params.
  • Updated command-line argument parsing and usage help text.
  • Modified get_req_parameters to handle the no_context parameter from requests.
  • Passed the no_context setting to whisper_full_params before processing.

@danbev danbev merged commit 170b2fa into ggml-org:master Apr 16, 2025
51 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants