[Feature]: Add Claude4

[pathikrit]

The Feature

see https://www.anthropic.com/news/claude-4

Motivation, pitch

New model

Are you a ML Ops Team?

No

Twitter / LinkedIn details

No response

[Dmarcotrigiano]

I assume this is just for cost counting and other model metadata calculations, but making requests to bedrock hosted sonnet 4 would simply work.

[brunompicinini]

I assume this is just for cost counting and other model metadata calculations, but making requests to bedrock hosted sonnet 4 would simply work.

I'm not sure if I'm doing something wrong, but here I couldn't get it to work — tried both options:

anthropic.claude-sonnet-4-20250514-v1:0
us.anthropic.claude-sonnet-4-20250514-v1:0

When I test connect it says:

Connection Test Results
Connection to custom failed
Error:
LLM Provider NOT provided. Pass in the LLM provider you are trying to call. You passed model=anthropic.claude-sonnet-4-20250514-v1:0 Pass model as E.g. For 'Huggingface' inference endpoints pass in `completion(model='huggingface/starcoder',..)` Learn more: https://docs.litellm.ai/docs/providers
Troubleshooting Details
litellm.BadRequestError: LLM Provider NOT provided. Pass in the LLM provider you are trying to call. You passed model=anthropic.claude-sonnet-4-20250514-v1:0
 Pass model as E.g. For 'Huggingface' inference endpoints pass in `completion(model='huggingface/starcoder',..)` Learn more: https://docs.litellm.ai/docs/providers
stack trace: Traceback (most recent call last):
  File "/usr/lib/python3.13/site-packages/litellm/main.py", line 5589, in ahealth_check
    model, custom_llm_provider, _, _ = get_llm_provider(model=model)
                                       ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^
  File "/usr/lib/python3.13/site-packages/litellm/litellm_core_utils/get_llm_provider_logic.py", line 358, in get_llm_provider
    raise e
  File "/usr/lib/python3.13/site-packages/litellm/litellm_core_utils/get_llm_provider_logic.py", line 335, in get_llm_provider
    raise litellm.exceptions.BadRequestError(  # type: ignore
    ...<8 lines>...
    )
litellm.exceptions.BadRequestError: litellm.BadRequestError: LLM Provider NOT provided. Pass in the LLM provider you are trying to call. You passed model=anthropic.claude-sonnet-4-20250514-v1:0
 Pass model as E.g. For 'Huggingface' inference endpoints pass in `completion(model='huggingface/starcoder',..)` Learn more: https://docs.litellm.ai/docs/providers
API Request
No request data available

Am I doing something wrong?

If I try with us.anthropic.claude-3-7-sonnet-20250219-v1:0 for example, then I get:

Connection to custom successful!

But it does say here that it's available on Bedrock:

https://www.anthropic.com/claude/sonnet

BTW, price is actually the same as previous Opus/Sonnet.

Any help appreciated 🙏

Lite version: 1.67.4

[Alex-Dumitru-17]

I'm also having issues with bedrock:

litellm.completion(
    model="bedrock/us.anthropic.claude-opus-4-20250514-v1:0",
    messages=[{"role": "user", "content": "Hi, who are you"}],
    
)

getting this error: AttributeError: 'AmazonAnthropicConfig' object has no attribute 'aws_authentication_params'

litellm==1.70.2

[ncecere]

Plus one to AWS Bedrock support for Claude 4

[ishaan-jaff]

Ack on this. Working on it now !

[ishaan-jaff]

Can you try this @Alex-Dumitru-17 ?

litellm.completion(
    model="bedrock/converse/us.anthropic.claude-opus-4-20250514-v1:0",
    messages=[{"role": "user", "content": "Hi, who are you"}],
    
)

[ishaan-jaff]

Done here: #11060

Can I get a 2nd set of eyes to cross check this looks good cc @ncecere @Alex-Dumitru-17 @brunompicinini @pathikrit

[Alex-Dumitru-17]

@ishaan-jaff
Tried it now, it seems to be working!

test = litellm.completion(
    model="bedrock/converse/us.anthropic.claude-opus-4-20250514-v1:0",
    messages=[{"role": "user", "content": "Hi, who are you"}],
    
)
test.choices[0].message.content
"I'm Claude, an AI assistant created by Anthropic. I'm here to help with a wide variety of tasks like answering questions, helping with analysis and research, writing, coding, math, creative projects, and general conversation. Is there something specific I can help you with today?"

[ishaan-jaff]

Will it help to put out a dev docker + pip release for people to test ?

[ishaan-jaff]

v1.70.2.dev5 will be out on Docker and GHCR. Keep an eye out if you want to use the dev release.

[recrudesce]

This should also fix the 400: litellm.UnsupportedParamsError: bedrock does not support parameters: ['tools'], for model=anthropic.claude-sonnet-4-20250514-v1:0 error I'm getting as I see the model has been added to the model/pricing map.

Any idea when this will be in the latest docker tag ?

[ishaan-jaff]

@recrudesce

Trying to get a latest/nightly release in the next 1-2 hours. Unfortunately vertex is not playing nice on our CI/CD

[recrudesce]

Nice, I shall sit here on my hands and wait patiently :P Thanks for all your hard work on this - appreciated !

[ishaan-jaff]

New release here: https://github.com/BerriAI/litellm/releases/tag/v1.70.4-nightly