Commit graph

20943 commits

Author SHA1 Message Date
Ishaan Jaff
b4568762d2 update_internal_user_settings 2025-03-17 18:26:42 -07:00
Krrish Dholakia
359b8298f8 test(test_assemble_streaming_responses.py): update test to use correct type 2025-03-17 18:17:01 -07:00
Ishaan Jaff
8441f2f55c fix DefaultInternalUserParams 2025-03-17 18:13:15 -07:00
Ishaan Jaff
93e4a36300 DefaultInternalUserParams 2025-03-17 18:11:19 -07:00
Krrish Dholakia
c4b2e0ae3d fix(streaming_handler.py): support logging complete streaming response on cache hit 2025-03-17 18:10:39 -07:00
Ishaan Jaff
5d8b288570 fix get_sso_settings 2025-03-17 18:06:09 -07:00
Ishaan Jaff
5e1e25d98d is_internal_user_role 2025-03-17 17:55:35 -07:00
Ishaan Jaff
8ff8ad82c9 DefaultInternalUserParams 2025-03-17 17:34:05 -07:00
Ishaan Jaff
c2db7fb28b fix internal user sso settings 2025-03-17 17:31:31 -07:00
Ishaan Jaff
ba7891d332 ui fix rendering budget duration settings on ui 2025-03-17 17:26:51 -07:00
Krrish Dholakia
dd9e79adbd fix(streaming_handler.py): emit deep copy of completed chunk 2025-03-17 17:26:21 -07:00
Emerson Gomes
18c2592f2b fix redis serialization issue with Redis + lowest latency strategy 2025-03-17 19:19:20 -05:00
Ishaan Jaff
30add0e64c update internal user settings on ui 2025-03-17 17:11:16 -07:00
Andrew Smith
1b2439cb82
Merge branch 'BerriAI:main' into main 2025-03-18 11:10:02 +11:00
Andrew Smith
d5274efe62
Update test_sagemaker.py to match changed parameters 2025-03-18 11:09:52 +11:00
Andrew Smith
81a7cf0f44
Update handler.py to use prepared_request.body for input 2025-03-18 11:07:38 +11:00
Ishaan Jaff
508b474a1f update_internal_user_settings 2025-03-17 17:03:06 -07:00
Ishaan Jaff
02db6f9d86 fix display of settings 2025-03-17 16:56:49 -07:00
Krrish Dholakia
594d2ad433 docs(config_settings.md): document new env var 2025-03-17 16:55:32 -07:00
Krrish Dholakia
057c774c14 fix(http_handler.py): fix typing error 2025-03-17 16:42:32 -07:00
Krish Dholakia
cf86ce3908
Merge pull request #9322 from BerriAI/litellm_dev_redis_ttl
fix(redis_cache.py): add 5s default timeout
2025-03-17 16:39:36 -07:00
Ishaan Jaff
2607676e3f UISSOSettings 2025-03-17 16:29:32 -07:00
Andrew Smith
a92e99e946
Update handler.py to use prepared_request.body 2025-03-18 10:23:32 +11:00
Ishaan Jaff
0f44b33e0f ui sso settings 2025-03-17 15:54:41 -07:00
Ishaan Jaff
0771d49ea7 ui networking getSSOSettingsCall 2025-03-17 15:54:20 -07:00
Ishaan Jaff
0af0de8a96 model_dump() 2025-03-17 15:53:36 -07:00
Ishaan Jaff
401630833f add types for internal user settings 2025-03-17 15:52:01 -07:00
Krrish Dholakia
8e27b2026a fix(http_handler.py): support reading ssl security level from env var
Allows user to specify lower security settings
2025-03-17 15:48:31 -07:00
Shiti Saxena
d1e20d41fd
docs(vertexai): fix typo in required env variables 2025-03-17 15:46:36 -07:00
Krrish Dholakia
078e2d341b feat(cost_calculator.py): support reading litellm response cost header in client sdk
allows consistent cost tracking when sdk is calling proxy
2025-03-17 15:12:01 -07:00
Ishaan Jaff
ce9ab69be2 add UISSOSettings 2025-03-17 15:09:54 -07:00
Krish Dholakia
ce9b6f49bb
Merge pull request #9317 from afspies/patch-1
Update prompt_caching.md to fix typo
2025-03-17 14:47:16 -07:00
Krrish Dholakia
db92956ae3 fix(redis_cache.py): add 5s default timeout 2025-03-17 14:27:36 -07:00
Alex Spies
c52514598f
Update prompt_caching.md to fix typo
openai endpoint is presumably supposed to read `openai/` not `deepseek/` here. not yet at least :)
2025-03-17 17:16:51 +00:00
Krish Dholakia
41d1a88d05
Merge pull request #9314 from BerriAI/litellm_dev_03_16_2025_p1
fix(utils.py): Prevents final chunk w/ usage from being ignored
2025-03-17 10:03:03 -07:00
Krish Dholakia
d0d8ec2c40
Merge branch 'main' into litellm_dev_03_16_2025_p1 2025-03-17 10:02:53 -07:00
Krrish Dholakia
8618295911 test: loosen test 2025-03-17 09:44:22 -07:00
Krrish Dholakia
284435022e docs(bedrock.md): add aws bedrock runtime endpoint to docs 2025-03-17 09:18:03 -07:00
Krrish Dholakia
d01361747d test: make test less flaky 2025-03-17 09:00:15 -07:00
Krrish Dholakia
a5b497667c fix(logging_utils.py): revert change 2025-03-16 21:04:41 -07:00
Krrish Dholakia
a99251a4ab fix(streaming_handler.py): raise stop iteration post-finish reason 2025-03-16 20:40:41 -07:00
Krrish Dholakia
bde9ae8a95 fix(litellm_logging.py): remove unused import 2025-03-16 20:24:27 -07:00
Krrish Dholakia
c0a76427d2 fix(streaming_handler.py): pass complete streaming response on completion 2025-03-16 20:22:12 -07:00
Krrish Dholakia
08b297230e fix(streaming_handler.py): return model response on finished chunk 2025-03-16 13:05:46 -07:00
Krish Dholakia
97ed4d3a16
Merge pull request #9288 from mknet3/make-masterkey-secret-configurable 2025-03-16 07:50:07 -07:00
Oliver
1d73bbc47a
Update perplexity.md
Updated sonar(by perplexity) model avalibilty because other models have been depricated
2025-03-16 16:29:50 +02:00
Manuel Cañete
44373baeee feat: make masterkey secret configurable 2025-03-16 12:39:13 +01:00
Ishaan Jaff
8cc63e0802 docs docker run cmd 2025-03-15 22:20:53 -07:00
Ishaan Jaff
165b1887bd fix docker img deploy - deploy stable releases from main-stable 2025-03-15 20:34:32 -07:00
Ishaan Jaff
f5e9211c1b fix ghcr build 2025-03-15 20:14:04 -07:00