Tag Management API - /tag/new - Fails with 500 error when associated with models

[marumugam-lg]

We have a use case where we need to add tags and associate them with the model. We are using the backend API to automate this process, but the Tag Management API returns a 500 error as even though the model appears in the LiteLLM Models list.

Despite the 500 error, the tags are visible in the UI; however, the tags are not functioning as expected.

Request URL :/tag/new

Request Schema :{
"name": "agent-assist2",
"description": "agent-assist tag for routing",
"models": ["eu.anthropic.claude-3-5-sonnet-20240620-v1:0"]
}

Response:
{
"detail": "404: Deployment eu.anthropic.claude-3-5-sonnet-20240620-v1:0 not found"
}

))

[krrishdholakia]

Hi @marumugam-lg what do you see when calling /model/info?

[krrishdholakia]

Oh i see the issue - this is because the value in models is the model_id, not the public model name.

This allows us to know which specific deployment you want to route via tags.

[krrishdholakia]

We can support the public model name too

[krrishdholakia]

Added ✅