Skip to content

[Provider] Cohere: [OpenAICompatibleModel Chat + tools] #493

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

mkozakov
Copy link

@mkozakov mkozakov commented May 9, 2025

This PR adds support for Cohere as a model provider via the OpenAI compatibility API, and includes the model command-a-03-2025.

@andrewpareles
Copy link
Contributor

andrewpareles commented May 10, 2025

This is a good start! It needs a little work (doesn't compile right now).

We should look into Cohere's free tier the way we did for Gemini and OpenRouter. Is the main reason you want to add Cohere the free tier? If so, it would be great to add a description about the rate limits for the most common models.

@mkozakov
Copy link
Author

This is a good start! It needs a little work (doesn't compile right now).

We should look into Cohere's free tier the way we did for Gemini and OpenRouter. Is the main reason you want to add Cohere the free tier? If so, it would be great to add a description about the rate limits for the most common models.

I work at cohere, and i have been using Void, so the main reason I want to add cohere is personal excitement :)

We should look into Cohere's free tier the way we did for Gemini and OpenRouter.
The limits on the free tier are:

  • 1000 requests a month
  • 20rpm rate limit

as per https://docs.cohere.com/v2/docs/rate-limits

@andrewpareles
Copy link
Contributor

Great, thanks!

@mkozakov
Copy link
Author

@andrewpareles do you want to give this another look, i think the compiling was fixed?

@andrewpareles
Copy link
Contributor

Yep will review in a bit!

@andrewpareles
Copy link
Contributor

andrewpareles commented May 14, 2025

Can you add a few more models, too? Ideally we’d have all of them, but we definitely at least want all the common ones besides command-a-03-2025. Happy to do this if you don't want to, but maybe you have a better sense of the good models than I do?

@mkozakov
Copy link
Author

@andrewpareles i think we should start with command A and we can add more models as they come out

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants