Ishaan Jaffer
c2df54a8f0
proxy_pass_through_endpoint_tests
2025-11-15 10:28:24 -08:00
Ishaan Jaffer
90c8233fa3
fix pt tests
2025-11-15 10:04:18 -08:00
Ishaan Jaffer
a69011883a
fix logging_testing
2025-11-14 18:48:20 -08:00
Ishaan Jaffer
8be374c98d
fix docker v
2025-11-13 16:12:48 -08:00
yuneng-jiang
627463b21f
[Infra] CI/CD - Bump up docker version for e2e ui testing ( #16506 )
...
* Bump up docker version for e2e ui testing CICD
* Fixing config file
2025-11-11 15:07:30 -08:00
Ishaan Jaffer
b8eda0ef55
proxy_store_model_in_db_tests
2025-11-10 18:20:52 -08:00
Krish Dholakia
06906534b3
feat(audio_transcriptions/): calculate duration of audio file for cost calculation + feat (image_generations): cost tracking accuracy improved with output_format, quality, size values fixed per openai model
...
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation
Fixes https://github.com/BerriAI/litellm/issues/11846
Closes https://github.com/BerriAI/litellm/issues/14605
* fix(cost_calculator.py): correctly use base model, when set
Fixes issue where azure base model was being ignored
* feat(cost_calculator.py): fix default cost tracking quality param for image generation
* feat(image_generations/): return output_format, quality, size
aligns response to openai spec and improves cost tracking accuracy
* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params
* build: update build
* fix: fix cost calculation
* build: update poetry lock
* fix: fix ruff checks
* fix: fix aembedding
* fix: fix ruff errors
* fix: modify to catch errors
* fix: test
* fix: loosen test to handle openai lib out of sync
* fix: fix base models
* fix: fix usage object
2025-11-08 16:24:31 -08:00
Krish Dholakia
202eaeb1a2
Revert "(feat) Audio transcription - cost tracking + (feat) image generation …" ( #16409 )
...
This reverts commit c96da44265
2025-11-08 15:38:16 -08:00
Krish Dholakia
c96da44265
(feat) Audio transcription - cost tracking + (feat) image generation - accurate cost tracking based on output_format/quality/size
...
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation
Fixes https://github.com/BerriAI/litellm/issues/11846
Closes https://github.com/BerriAI/litellm/issues/14605
* fix(cost_calculator.py): correctly use base model, when set
Fixes issue where azure base model was being ignored
* feat(cost_calculator.py): fix default cost tracking quality param for image generation
* feat(image_generations/): return output_format, quality, size
aligns response to openai spec and improves cost tracking accuracy
* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params
* build: update build
* fix: fix cost calculation
* build: update poetry lock
* fix: fix ruff checks
* fix: fix aembedding
* fix: fix ruff errors
* fix: modify to catch errors
* fix: test
* fix: loosen test to handle openai lib out of sync
2025-11-08 15:30:46 -08:00
Ishaan Jaffer
1d0b25dfa0
fix mapped tests
2025-11-06 18:47:51 -08:00
Krish Dholakia
80440e11a7
Revert "Update MCP version from 1.10.1 to 1.20.0 ( #16281 )" ( #16300 )
...
This reverts commit 34c12d0131
2025-11-05 18:42:34 -08:00
Guan Zheng Huang
34c12d0131
Update MCP version from 1.10.1 to 1.20.0 ( #16281 )
...
* Update MCP version from 1.10.1 to 1.20.0
- Update mcp dependency: 1.10.1 -> 1.20.0 in requirements.txt, pyproject.toml, and CI config
- Update uvicorn dependency: 0.29.0 -> 0.31.1 (required by MCP 1.20.0)
- Update PyJWT constraint to support newer versions required by MCP
- Update all CI pipeline references to MCP 1.20.0
- Add test to verify MCP version and import compatibility
MCP 1.20.0 requires uvicorn >=0.31.1 and PyJWT >=2.10.1.
MCP package remains Python >=3.10 only (no change to version constraint).
* Update poetry.lock for MCP 1.20.0
2025-11-05 18:34:28 -08:00
Ishaan Jaffer
af73879659
db_migration_disable_update_check
2025-10-31 19:23:08 -07:00
Ishaan Jaffer
f538caaa01
fix proxy_build_from_pip_tests
2025-10-29 18:22:55 -07:00
Ishaan Jaffer
e9466dc27e
pt tests fix
2025-10-25 11:08:33 -07:00
Ishaan Jaff
e1cb92862e
[Feat] Add def search() APIs for Web Search - Perplexity API ( #15769 )
...
* add BaseSearchConfig
* add BaseSearchConfig
* validate_environment
* fix handlers
* add PerplexitySearchConfig
* add PerplexitySearchConfig
* add LiteLLM Search API module.
* add BaseSearchConfig
* add _build_search_optional_params
* add search_testing
* add BaseSearchTest
* add TestPerplexitySearch
* fix BASE
* fix handler
* add search API
* add to init
* fix: working perplexity search API
* add _hidden_params to search
2025-10-21 16:58:51 -07:00
Ishaan Jaff
73a23a6c78
[Feat] Add Azure AVA TTS integration ( #15749 )
...
* add AzureBaseIssueTokenHandler
* add BaseTextToSpeechConfig
* async_text_to_speech_handler
* add AzureAVATextToSpeechConfig
* add get_provider_text_to_speech_config
* add AzureAVATextToSpeechConfig
* fixes for base_llm_http_handler
* fix transform_text_to_speech_request
* test_azure_ava_tts_async
* test_azure_ava_tts_async
* fix TextToSpeechRequestData
* fix transform_text_to_speech_request
* add text_to_speech_handler in LLMHttpHandler
* remove old file
* fix transform_text_to_speech_request
* fix dispatch_text_to_speech
* fix azure TTS
* fix AVA TTS
* fix transform
* fix linting
* ci/cd - use one job for audio testing
* fix tests
* fix llm http handler debugging
* unit tests azure tts
* docs Azure speech
* docs fix
* docs azure AVA
* docs azure AVA
* fix handlers
* test_async_realtime_uses_max_size_parameter
2025-10-20 16:52:23 -07:00
Ishaan Jaff
bc26845ec4
[Feat] Native /ocr endpoint support ( #15573 )
...
* [Feat] Add native litellm.ocr() functions (#15567 )
* fix get_supported_ocr_params
* add get_provider_ocr_config
* init OCR
* init ocr functions
* add OCRResponse Base Model
* add ocr to llm http handlers
* add main.py for OCR
* fix linting for OCR
* TestMistralOCR
* update to use DocumentType for Mistral
* fix _prepare_ocr_request
* fix transform
* add main.py for OCR
* add spec to init
* fix OCR
* TestMistralOCR
* ruff fix
* Potential fix for code scanning alert no. 3521: Clear-text logging of sensitive information
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
* [Feat] Add /ocr route on LiteLLM AI Gateway - Adds support for native mistral ocr calling (#15571 )
* fix get_supported_ocr_params
* add get_provider_ocr_config
* init OCR
* init ocr functions
* add OCRResponse Base Model
* add ocr to llm http handlers
* add main.py for OCR
* fix linting for OCR
* TestMistralOCR
* update to use DocumentType for Mistral
* fix _prepare_ocr_request
* fix transform
* add main.py for OCR
* add spec to init
* fix OCR
* TestMistralOCR
* ruff fix
* add router.ocr() methods
* add OCR routes
* feat add ocr routes
* add OCR routes
* feat: add OCR routes in proxy server
* working /ocr routes
* test_router_aocr_with_mistral
* docs Mistral OCR
* docs OCR
* [Feat] Add Azure AI Mistral OCR Integration (#15572 )
* fix get_supported_ocr_params
* add get_provider_ocr_config
* init OCR
* init ocr functions
* add OCRResponse Base Model
* add ocr to llm http handlers
* add main.py for OCR
* fix linting for OCR
* TestMistralOCR
* update to use DocumentType for Mistral
* fix _prepare_ocr_request
* fix transform
* add main.py for OCR
* add spec to init
* fix OCR
* TestMistralOCR
* ruff fix
* add router.ocr() methods
* add OCR routes
* feat add ocr routes
* add OCR routes
* feat: add OCR routes in proxy server
* working /ocr routes
* test_router_aocr_with_mistral
* docs Mistral OCR
* docs OCR
* add azure ai to get_provider_ocr_config
* add AzureAIOCRConfig
* TestAzureAIOCR
* TestAzureAIOCR
* test fixes for azure ai ocr
* fix async OCR transform for Azure
* fix transform_ocr_request
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-10-15 17:20:01 -07:00
Ishaan Jaffer
1b4bcdabfd
fix test
2025-10-11 11:42:09 -07:00
Ishaan Jaffer
5f4b890dcd
fixes
2025-10-11 11:32:00 -07:00
Ishaan Jaffer
7e738c8ac4
proxy_store_model_in_db_tests
2025-10-11 10:55:28 -07:00
Ishaan Jaffer
8c4ca82235
fix: postgresql auth_ui_unit_tests
2025-10-11 09:23:31 -07:00
Ishaan Jaffer
41953185bf
fix litellm_proxy_unit_testing
2025-10-11 09:16:59 -07:00
Ishaan Jaffer
97e00f694c
fix azure assistants test
2025-10-04 16:18:14 -07:00
Ishaan Jaffer
53503828b2
test fix
2025-10-04 10:57:02 -07:00
Ishaan Jaffer
82978f4c5c
fix mypy
2025-09-27 12:21:32 -07:00
Ishaan Jaffer
1bb7ad4f69
litellm_utils_testing
2025-09-27 12:13:51 -07:00
Ishaan Jaffer
200dd0ef39
local_testing fix
2025-09-27 12:04:30 -07:00
Ishaan Jaff
3e793d7122
test - fix mypy linting on ci/cd ( #14981 )
...
* mypy_linting make 1 job for it
* mypy_linting
* fix fastuuid
* fix mypy
* mypy fix
2025-09-27 11:56:45 -07:00
Ishaan Jaffer
e31972f5db
litellm_mapped_tests
2025-09-27 10:45:36 -07:00
Ishaan Jaffer
936e3466ac
litellm_router_testing
2025-09-27 10:42:51 -07:00
Ishaan Jaffer
ba3e20060a
llm_translation_testing fix
2025-09-27 10:35:25 -07:00
Ishaan Jaffer
9c8a2e8bff
add -show-traceback
2025-09-26 19:26:44 -07:00
Ishaan Jaffer
9a737c5be4
fix local_testing bump python img
2025-09-26 19:14:13 -07:00
Ishaan Jaffer
ce7499c8f7
fix sec tests
2025-09-26 19:06:10 -07:00
Ishaan Jaffer
55849706f9
fix local_testing
2025-09-26 18:59:11 -07:00
Ishaan Jaffer
dd0744b746
fix mypy
2025-09-26 18:46:09 -07:00
Ishaan Jaffer
9bed9995f8
bump pip install "mypy==1.18.2
2025-09-26 18:32:42 -07:00
Ishaan Jaff
ea8d0bb7d5
fix: re-add scheduled rotations
2025-09-26 11:40:46 -07:00
Ishaan Jaffer
b1e56c55ad
merge
2025-09-24 22:11:37 -07:00
Ishaan Jaff
ded823a3a3
[Feat] Initial support for scheduled key rotations ( #14877 )
...
* add KeyRotationSettings
* add KeyRotationManager
* add key rotation manager
* add KeyRotationManager
* fix _initialize_spend_tracking_background_jobs
* fix add_key_rotation_fields
* fixes
* new fields in schema
* update schema
* fix fixes for init key rotation manager
* fixes for init key rotation manager
* fix KeyRotationManager
* tests for key rotation
* fix key_rotation_settings
* fix KeyRotationManager
* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS
* fix fixes for init key rotation manager
* ruff check fix
* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS
* fix _initialize_spend_tracking_background_jobs
* docs fix
* docs auto rotate
* schema fix
* bump proxy extras
* fix config.yml
2025-09-24 21:37:56 -07:00
Ishaan Jaffer
66a88d3761
fix ci/cd
2025-09-24 11:55:34 -07:00
Alex Shoop
ab2bd2a50f
add check_fastuuid_usage.py script to check_code_and_doc_quality job
2025-09-24 10:45:59 +09:00
Ishaan Jaffer
74593daf40
ci/cd fix litellm_mapped_enterprise_tests
2025-09-20 16:05:44 -07:00
Krrish Dholakia
a07bf301e6
ci: update env vars
2025-09-20 12:06:58 -07:00
Krish Dholakia
661a42b626
Merge pull request #14698 from BerriAI/litellm_contributor_prs_09_18_2025_p1
...
Litellm contributor prs 09 18 2025 p1
2025-09-18 18:32:51 -07:00
=
90bd1927e2
Update config.yml
2025-09-18 17:50:55 -07:00
=
4f89675267
upgraded to node 20
2025-09-18 17:38:56 -07:00
Alexsander Hamir
59409429d4
fix: reduced __inits__ overhead in 7% ( #14689 )
...
* fix: avoid redundant __init__ calls on hot path
Previously, imports on the request hot path caused __init__ to run
excessively for every request. This change ensures initialization
happens once, reducing cpu overhead.
* fix: remove redundant __init__ import
The current implementation no longer requires an import at the top of the function.
* fix: placed on core utils for future reuse
* test: add coverage & remove inline import
A general import-checking tool across all endpoints would be a large PR.
This commit focuses on a smaller, targeted fix for the discussed case.
* added import check to CI
2025-09-18 17:18:05 -07:00
=
f80660acd9
vitests for GuardrailViewer components
2025-09-18 16:57:22 -07:00
