Ishaan Jaff
72de453cc0
fix gemini/gemini-2.5-pro-exp-03-25
2025-04-28 20:24:40 -07:00
Ishaan Jaff
34cdefbb77
[Feat] Add logging callback support for /moderations API ( #10390 )
...
* add OpenAIModerationResponse as a type
* Add typing for litellm.moderation response obj
* Add typing for litellm.moderation response obj
* test_moderations_api_logging
* add assertions for logged slp object
* test_moderations_api_logging
* refactor moderations api usage
* Revert "test_moderations_api_logging"
This reverts commit 5a9001f04cb076d3174c
2025-04-28 20:24:17 -07:00
Krrish Dholakia
25213f6087
docs: fix docs
2025-04-28 15:36:56 -07:00
Krrish Dholakia
a38e2f052e
docs: fix docs
2025-04-28 15:36:31 -07:00
Krish Dholakia
bf9382a182
Handle more gemini tool calling edge cases + support bedrock 'stable-image-core' ( #10351 )
...
* test(test_amazing_vertex_completion.py): try to repro https://github.com/BerriAI/litellm/issues/10319
* fix(common_utils.py): handle edge case on tools
Fixes https://github.com/BerriAI/litellm/issues/10319
* test: add unit testing for infinite loops
* fix(amazon_stability3_transformation.py): support 'stable-image-core' transformation
Fixes https://github.com/BerriAI/litellm/issues/8488
* test: add unit testing for stable image core model
* test: update test
2025-04-28 14:22:29 -07:00
Ishaan Jaff
a5ef8a9556
update release note with imgs
2025-04-26 20:14:39 -07:00
Ishaan Jaff
52ceeaeb40
fix code quality check
2025-04-26 19:37:34 -07:00
Ishaan Jaff
2be334eeb1
fix build from pip test
2025-04-26 19:36:47 -07:00
Ishaan Jaff
c2f7d7b185
fix linting errors
2025-04-26 19:34:37 -07:00
Ishaan Jaff
4153b8975c
fix types/responses/main.py
2025-04-26 19:18:26 -07:00
Ishaan Jaff
c8688ee85c
fix linting _ENTERPRISE_ResponsesSessionHandler
2025-04-26 19:17:20 -07:00
Ishaan Jaff
15ab172cf5
fix def of ChatCompletionSession
2025-04-26 19:16:20 -07:00
Ishaan Jaff
1e0ee22445
fix build from pip tests
2025-04-26 19:05:28 -07:00
Krrish Dholakia
ab4523c080
docs(index.md): cleanup
2025-04-26 19:00:56 -07:00
Krrish Dholakia
1390ae8e18
docs(index.md): cleanup doc
2025-04-26 18:54:08 -07:00
Ishaan Jaff
6f3c158266
[QA] Allow managing sessions with litellm_session_id ( #10348 )
...
* allow dynamically setting litellm_session_id
* allow dynamically setting litellm_session_id
2025-04-26 18:52:50 -07:00
Ishaan Jaff
fcaac91724
ui new build
2025-04-26 18:25:50 -07:00
Krish Dholakia
2ab00bd12c
Litellm UI improvements 04 26 2025 p1 ( #10346 )
...
* fix(provider_info_helpers.tsx): fix together ai provider name
* fix(user_edit_view.tsx): all admin to edit user's personal models
* fix(model_dashboard.tsx): fix model filtering by team id check
* fix(proxy_server.py): support returning available models for a user on `/model_group/info`
Fixes issue where personal key with 'all team models' would see all proxy models (not just the ones user can call)
* test(test_models.py): add unit test for model group info check on personal key
2025-04-26 18:24:49 -07:00
Ishaan Jaff
42928601b4
bump litellm-proxy-extras
2025-04-26 18:11:06 -07:00
Ishaan Jaff
d6103c3962
ui fix linting
2025-04-26 17:44:09 -07:00
Ishaan Jaff
c2480db73d
[Bug Fix] UI QA - Fix wildcard model test connection not working ( #10347 )
...
* fix setFieldsValue for wildcard
* fix async_completion_with_fallbacks
* fix ahealth_check_wildcard_models
2025-04-26 17:42:06 -07:00
Krish Dholakia
31313dd489
Fix - support azure dall e custom pricing ( #10339 )
...
* fix(cost_calculator.py): support custom pricing for image gen
Allow user to set custom pricing on azure image gen models
* test(test_cost_calculator.py): add unit test
* test(test_litellm_logging.py): add more unit testing
* fix(litellm_logging.py): fix ruff check
2025-04-26 17:16:03 -07:00
Ishaan Jaff
f30479557e
fix remove Column Selector, it seems to not be working
2025-04-26 16:36:14 -07:00
Ishaan Jaff
f2c9406980
fix /sso/callback ( #10345 )
2025-04-26 16:27:40 -07:00
Ishaan Jaff
9ab9744fac
ui - fix infinite scroll on test key page ( #10343 )
2025-04-26 16:18:54 -07:00
Ishaan Jaff
f694878155
fix SSO ( #10344 )
2025-04-26 16:17:38 -07:00
Ishaan Jaff
58878aa0bb
[UI] Fixes for sessions on UI - ensure errors have a session and use 1 session for test key ( #10342 )
...
* ui fix use same trace id on test key page
* _get_session_id_for_spend_log
* fix linting
2025-04-26 16:02:58 -07:00
Ishaan Jaff
faf54e3f29
fixes for EE image
2025-04-26 15:43:21 -07:00
Ishaan Jaff
fd3603d4e8
deploy - add build-and-push-image-ee
2025-04-26 14:40:20 -07:00
Ishaan Jaff
dcfa26c428
docs fix index stable release
2025-04-26 14:31:24 -07:00
Ishaan Jaff
9614d5ba69
docs fix stable release
2025-04-26 14:23:09 -07:00
Ishaan Jaff
a0b6766321
docs release notes
2025-04-26 14:02:38 -07:00
Ishaan Jaff
cd5f0e809e
docs responses API session management
2025-04-26 14:01:24 -07:00
Krrish Dholakia
68c74bb342
build(model_prices_and_context_window.json): add gemini/gemini-2.5-pro-exp-03-25
...
Addresses https://github.com/BerriAI/litellm/discussions/10058
2025-04-26 12:48:08 -07:00
Ishaan Jaff
3d516fee1f
docs responses API GET, DELETE examples
2025-04-26 12:40:21 -07:00
Ishaan Jaff
8c8b786267
doc fix stable release add images of UI improvements
2025-04-26 12:13:59 -07:00
mdonaj
b99b0d5010
Fix: Prevent cache token overwrite by last chunk in streaming usage ( #10284 )
2025-04-26 12:06:12 -07:00
Krish Dholakia
93b6df96e0
Prisma Migrate - support setting custom migration dir ( #10336 )
...
* build(litellm-proxy-extras/utils.py): correctly generate baseline migration for non-empty db
* fix(litellm-proxy-extras/utils.py): Fix issue in migration, where if a migration fails during baselining, all are still marked as applied
* fix(prisma_client.py): don't pass separate schema.prisma to litellm-proxy-extras
use the one in litellm-proxy-extras
* fix(litellm-proxy-extras/utils.py): support passing custom dir for baselining db in read-only fs
Fixes https://github.com/BerriAI/litellm/issues/9885
* fix(utils.py): give helpful warning message when permission denied error raised in fs
2025-04-26 12:05:06 -07:00
Ishaan Jaff
f2899cb66e
[Docs] v1.67.4-stable ( #10338 )
...
* draft 1.67.4
* completed New Models / Updated Models
* docs clean up image gen
* docs azure granularities for whisper
* docs New Models / Updated Models
* docs cohere
* update cohere docs
* complete New Models / Updated Models updates
* docs responses API
* complete Logging / Guardrail Integrations
* completed Logging / Guardrail Integrations
* doc Spend Tracking Improvements
* Logging / Guardrail Integrations
2025-04-26 11:54:18 -07:00
Ishaan Jaff
dd8a7e15a8
bump: version 1.67.3 → 1.67.4
2025-04-26 08:30:50 -07:00
Ishaan Jaff
93759b4cc7
ui new build
2025-04-26 08:28:49 -07:00
Ishaan Jaff
f7e75fa276
[Docs] UI Session Logs ( #10334 )
...
* add ui logs session doc
* docs add instructions on how to do session management
* docs session management
* docs session management
* docs responses api session management
* docs ui logs
2025-04-26 08:26:23 -07:00
Krrish Dholakia
421011baec
build(model_prices_and_context_window.json): update azure o1-mini pricing
2025-04-26 08:05:09 -07:00
Christian Owusu
350bae9be0
Internal Users: Refresh user list on create ( #10296 )
...
* Clean up
* Refactor
* Internal Users: Refresh user list on create
2025-04-26 08:01:24 -07:00
Ishaan Jaff
8d73259561
ui session management - link to docs
2025-04-26 07:55:28 -07:00
Nandini Bagga
ab9705781f
create key table render fix ( #10224 )
...
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2025-04-26 07:51:56 -07:00
Ishaan Jaff
c114da1c6d
bump litellm proxy extras
2025-04-26 07:46:33 -07:00
Ishaan Jaff
331e784db4
[Feat] Responses API - Add session management support for non-openai models ( #10321 )
...
* add session id in spendLogs
* fix log proxy server request as independant field
* use trace id for SpendLogs
* add _ENTERPRISE_ResponsesSessionHandler
* use _ENTERPRISE_ResponsesSessionHandler
* working session_ids
* working session management
* working session_ids
* test_async_gcs_pub_sub_v1
* test_spend_logs_payload_e2e
* working session_ids
* test_get_standard_logging_payload_trace_id
* test_get_standard_logging_payload_trace_id
* test_gcs_pub_sub.py
* fix all linting errors
* test_spend_logs_payload_with_prompts_enabled
* _ENTERPRISE_ResponsesSessionHandler
* _ENTERPRISE_ResponsesSessionHandler
* expose session id on ui
* get spend logs by session
* add sessionSpendLogsCall
* add session handling
* session logs
* ui session details
* fix on rowExpandDetails
* ui working sessions
2025-04-25 23:24:24 -07:00
Krish Dholakia
c66c821f96
UI (Keys Page) - Support cross filtering, filter by user id, filter by key hash ( #10322 )
...
* feat(filter.tsx): initial commit making filter component more generic - same style as user table filters
* refactor(all_keys_table.tsx): refactor to simplify update logic
* fix: partially revert changes - reduce scope of pr
* fix(filter_logic.tsx): fix filter update logic
* fix(all_keys_table.tsx): fix filtering + search logic
* refactor: cleanup unused params
* Revert "fix(all_keys_table.tsx): fix filtering + search logic"
This reverts commit 5fbc331970
2025-04-25 21:30:56 -07:00
Krish Dholakia
339351c579
fix(ui_sso.py): support experimental jwt keys for UI auth w/ SSO ( #10326 )
2025-04-25 21:30:29 -07:00
