Add azure_ai cohere rerank v3.5 #12283
Merged
+28
−1
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
|
|
There was a problem hiding this comment.
Pull Request Overview
Adds support for the Azure Cohere Rerank v3.5 model by defining its token limits and cost parameters in both the main and backup pricing files.
- Introduces a new JSON entry for
azure_ai/cohere-rerank-v3.5in the primary pricing definition - Mirrors the same addition in the backup JSON
Reviewed Changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.
| File | Description |
|---|---|
| model_prices_and_context_window.json | Added new model entry for azure_ai/cohere-rerank-v3.5 |
| litellm/model_prices_and_context_window_backup.json | Synchronized backup to include the same azure_ai/cohere-rerank-v3.5 entry |
Comments suppressed due to low confidence (1)
model_prices_and_context_window.json:4071
- Add a unit test in
tests/litellmto verify that the new modelazure_ai/cohere-rerank-v3.5is correctly loaded with the expected token limits and cost values.
"azure_ai/cohere-rerank-v3.5": {
dcieslak19973
deleted the
litellm-10847-add-azure_ai-cohere-35-pricing-20250703
branch
jugaldb
pushed a commit
that referenced
this pull request
Jul 3, 2025
* Add azure_ai cohere rerank v3.5 * Fix CI error
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Title
Add azure_ai/cohere-rerank-v3.5
Relevant issues
Fixes #10847
Pre-Submission checklist
tests/litellm/directory, Adding at least 1 test is a hard requirement - see detailsmake test-unitType
🆕 New Feature
Changes