Sameer Kankute
8b3213ce5c
Add mapping for responses tools in file ids
2026-02-04 13:12:45 +05:30
Sameer Kankute
410e54648c
Fix: Managed Batches: Inconsistent State Management for list and cancel batches
2026-02-03 14:47:28 +05:30
Sameer Kankute
70684ca86f
Fix File access permissions for .retreive and .delete
2026-01-29 11:19:24 +05:30
Sameer Kankute
833cf6a2cf
Fix: Batch cancellation ownership bug
2026-01-29 10:54:42 +05:30
Ephrim Stanley
88280d9cca
Fix batch creation to return the input file's expires_at attribute
2026-01-26 12:02:35 -05:00
Ephrim Stanley
caa2c57619
Fix /batches to return encoded ids (from managed objects table)
2026-01-26 10:36:43 -05:00
Ephrim Stanley
479e40672e
Add end to end integration tests for batches
2025-12-23 12:55:09 -05:00
Ephrim Stanley
73083a1f5b
Add end to end integration tests for batches
2025-12-23 11:54:46 -05:00
Ephrim Stanley
b84aafbab6
Add end to end integration tests for batches
2025-12-23 10:24:32 -05:00
Sameer Kankute
7d0f41f437
Add cost tracking for responses api in background mode
2025-12-19 13:35:48 +05:30
Sameer Kankute
755f024087
remove print statments
2025-12-16 21:37:09 +05:30
Sameer Kankute
3222b4e3a8
Add batch output file in managed table
2025-12-16 15:44:30 +05:30
Sameer Kankute
7b1cef86a7
Add support for target_storage param
2025-12-11 15:08:17 +05:30
Krish Dholakia
70e1e83102
feat(managed_files.py): support /delete for files + feat(managed_batches): support /cancel for batches ( #16387 )
...
* feat(managed_files.py): initial commit fixing managed file delete on litellm
* fix(managed_files.py): fix file delete
* feat(batches_endpoints/endpoints.py): fix cancelling a batch
ensures managed batches works
---------
Co-authored-by: Ishaan Jaffer <ishaanjaffer0324@gmail.com>
2025-11-18 17:36:26 -08:00
Sameer Kankute
7cebc151b0
Add managed files support for responses API ( #16733 )
...
* Fix responses api with managed files
* fix litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py mypy
* fix litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py mypy
* fix mypy errors
2025-11-17 18:41:26 -08:00
Krish Dholakia
06906534b3
feat(audio_transcriptions/): calculate duration of audio file for cost calculation + feat (image_generations): cost tracking accuracy improved with output_format, quality, size values fixed per openai model
...
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation
Fixes https://github.com/BerriAI/litellm/issues/11846
Closes https://github.com/BerriAI/litellm/issues/14605
* fix(cost_calculator.py): correctly use base model, when set
Fixes issue where azure base model was being ignored
* feat(cost_calculator.py): fix default cost tracking quality param for image generation
* feat(image_generations/): return output_format, quality, size
aligns response to openai spec and improves cost tracking accuracy
* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params
* build: update build
* fix: fix cost calculation
* build: update poetry lock
* fix: fix ruff checks
* fix: fix aembedding
* fix: fix ruff errors
* fix: modify to catch errors
* fix: test
* fix: loosen test to handle openai lib out of sync
* fix: fix base models
* fix: fix usage object
2025-11-08 16:24:31 -08:00
Krish Dholakia
202eaeb1a2
Revert "(feat) Audio transcription - cost tracking + (feat) image generation …" ( #16409 )
...
This reverts commit c96da44265
2025-11-08 15:38:16 -08:00
Krish Dholakia
c96da44265
(feat) Audio transcription - cost tracking + (feat) image generation - accurate cost tracking based on output_format/quality/size
...
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation
Fixes https://github.com/BerriAI/litellm/issues/11846
Closes https://github.com/BerriAI/litellm/issues/14605
* fix(cost_calculator.py): correctly use base model, when set
Fixes issue where azure base model was being ignored
* feat(cost_calculator.py): fix default cost tracking quality param for image generation
* feat(image_generations/): return output_format, quality, size
aligns response to openai spec and improves cost tracking accuracy
* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params
* build: update build
* fix: fix cost calculation
* build: update poetry lock
* fix: fix ruff checks
* fix: fix aembedding
* fix: fix ruff errors
* fix: modify to catch errors
* fix: test
* fix: loosen test to handle openai lib out of sync
2025-11-08 15:30:46 -08:00
Ishaan Jaffer
0a1fc0eeb2
Revert "fix: fix ruff errors"
...
This reverts commit eef864360e
2025-11-08 14:33:51 -08:00
Krrish Dholakia
eef864360e
fix: fix ruff errors
2025-11-08 14:15:12 -08:00
Krish Dholakia
f8d6a6edb9
fix(managed_files.py): don't raise error if managed object is not found + (Feat) Azure AI - Search Vector Stores + (Fix) Batches - “User default_user_id does not have access to the object” when object not in db + (fix) Vector Stores - show config.yaml vector stores on UI ( #15873 )
...
* fix(managed_files.py): don't raise error if managed object is not found
* feat(vector_stores): add azure ai search vector store support
Enables direct querying a vector store on azure
* fix(azure/vector_stores): working azure ai search api vector stores
allows azure direct querying on vector stores
* test: update env vars
* docs(docs/): document new azure ai vector store search
* docs(azure_ai_vector_stores.md): add table
* docs: clarify support for 'create' vector stores
* fix(vector_stores/endpoints.py): Fixes https://github.com/BerriAI/litellm/issues/14606
* fix: fix linting errors
2025-10-25 12:06:24 -07:00
Ishaan Jaff
cea318330e
[Feat] Add Guardrails for /v1/messages and /v1/responses API ( #15686 )
...
* add get_guardrails_messages_for_call_type
* fix call type for /messages
* add anthropic endpoints
* fix bedrock guardrails
* fix config.yaml
* fix types
* fix async_pre_call_hook
* ruff fix
* fix guard
* fix test bedrock guardrail
* fix linting
* fix linting
* docs guardrails
* fix mypy linting
2025-10-17 18:09:00 -07:00
Alexsander Hamir
eaa04cd8ce
fix: use fastuuid helper ( #14903 )
...
* fix: use fastuuid helper across the codebase
First batch of changes, simple drop in replacement.
* second batch of changes
* fixed: script mistake on helper file
2025-09-25 15:47:01 -07:00
Jugal D. Bhatt
900c7f45c0
[MCP Gateway] Litellm mcp pre and during guardrails ( #13188 )
...
* add guardrail support
* add guardrail support
* guardrails for MCP
* added changes
* add mcp guardrails
* added test
* add ui
* fix guardrail form
* working with cursor
* remvoe print
* fix mcp servertests
* fix mypy and remove console logs
* fix mypy and remove console logs
* fix mypy tests
2025-08-01 20:02:25 -07:00
yeahyung
782969bb05
( #11794 ) use upsert for managed object table rather than create to avoid UniqueViolationError ( #11795 )
...
* (#11794 ) use upsert for managed object table rather than create to avoid UniqueViolationError
* (#11794 ) use upsert for managed object table rather than create to avoid UniqueViolationError
2025-07-15 20:20:01 -07:00
Krrish Dholakia
c3857e60f2
Store batch output file id in DB + Store batch file status in DB + (experimental) BATCH API COST TRACKING
2025-06-25 22:41:22 -07:00
