Add GitHub Actions workflow for LLM translation testing artifacts

[colesmcintosh]

Title

Add GitHub Actions workflow for LLM translation testing artifacts

Relevant issues

Addresses need for automated generation of comprehensive test artifacts for release candidates, specifically for llm_translation testing suite validation.

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

• I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
• I have added a screenshot of my new test passing locally
• My PR passes all unit tests on make test-unit
• My PR's scope is as isolated as possible, it only solves 1 specific problem

Note: This PR adds CI/CD infrastructure rather than requiring new unit tests. The workflow itself tests the existing llm_translation test suite.

Screenshot placeholder for passing tests:

Type

🚄 Infrastructure

Changes

• Added GitHub Actions workflow (.github/workflows/llm-translation-testing.yml) that:
  • Automatically triggers on release candidate tags (v*-rc* format)
  • Can be manually triggered via GitHub Actions UI for any RC version
  • Runs the comprehensive tests/llm_translation/ test suite
  • Generates multiple artifact formats:
    • HTML test reports with pass/fail details
    • JUnit XML for CI/CD integration
    • Coverage reports (XML + HTML)
    • Test summary with statistics
  • Uploads artifacts to GitHub with 30-day retention
  • Uses parallel test execution for faster completion
  • Includes timeout protection (120 minutes max)

Benefits:

• Provides downloadable test artifacts for external stakeholders
• Enables automated validation of LLM provider integrations for releases
• Creates standardized test reporting for release candidates
• Supports quality assurance workflows for production deployments

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jun 19, 2025 11:26am

[ishaan-jaff]

requested changes

[ishaan-jaff]

LGTM