Commit graph

12481 commits

Author SHA1 Message Date
Ishaan Jaff
926670bfb7
Merge pull request #3429 from BerriAI/litellm_add_unit_tests_slack_alerts
[Test] Add Slack Alerting unit tests
2024-05-03 16:27:40 -07:00
Ishaan Jaff
3dd1e8dfe7
Merge pull request #3427 from BerriAI/litellm_test_alert_size
[Test] - Ensure only 1 slack callback + Size of of all callbacks do not grow
2024-05-03 16:27:16 -07:00
Krish Dholakia
1b35a75245
Merge pull request #3430 from BerriAI/litellm_return_api_base
feat(proxy_server.py): return api base in response headers
2024-05-03 16:25:21 -07:00
Krrish Dholakia
a732d8772a fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
Closes https://github.com/BerriAI/litellm/issues/3398
2024-05-03 16:24:21 -07:00
Ishaan Jaff
401bf8d67e test - bedrock v2 supports dimension 2024-05-03 16:23:37 -07:00
Ishaan Jaff
4a39b95acc fix - support dimension for titan embed v2 2024-05-03 16:13:27 -07:00
Ishaan Jaff
bf048ecda4 docs - titan embeddings v2 2024-05-03 15:59:02 -07:00
Ishaan Jaff
fbe412a3a6 feat - add amazon.titan-embed-text-v2 2024-05-03 15:58:05 -07:00
Ishaan Jaff
5333474a6f
Merge pull request #3431 from BerriAI/litellm_simplify_docs_prod
docs - simplify best practices for prod
2024-05-03 15:56:03 -07:00
Ishaan Jaff
209baaca02 docs - simplify prod docs 2024-05-03 15:40:05 -07:00
Krrish Dholakia
5b39f8e282 feat(proxy_server.py): return api base in response headers
Closes https://github.com/BerriAI/litellm/issues/2631
2024-05-03 15:27:32 -07:00
Ishaan Jaff
bae5d3601d feat - add unit tests for slack alerting 2024-05-03 15:08:55 -07:00
Ishaan Jaff
ab27866b6a fix test slack alerting len 2024-05-03 14:58:11 -07:00
Ishaan Jaff
a369867e02 test - num alerts on callbacks 2024-05-03 14:46:44 -07:00
Ishaan Jaff
e5311d35f2 fix test len active callbacks 2024-05-03 14:32:13 -07:00
Ishaan Jaff
3997ea6442 fix - return num callbacks in /active/callbacks 2024-05-03 14:24:01 -07:00
Ishaan Jaff
e9eead2f25 test - size of callbacks, alerts 2024-05-03 14:22:15 -07:00
Ishaan Jaff
e99edaf4e1
Merge pull request #3426 from BerriAI/litellm_set_db_exceptions_on_ui
UI - set DB Exceptions webhook_url on UI
2024-05-03 14:05:37 -07:00
Ishaan Jaff
776f541f6c fix bug where slack would get inserting several times 2024-05-03 14:04:38 -07:00
Ishaan Jaff
fdc9856652 UI - set DB Exceptions webhook_url 2024-05-03 13:33:43 -07:00
Ishaan Jaff
34bf0b37f5
Merge pull request #3423 from BerriAI/litellm_test_callbacks_proxy
[Test] Assert num Callbacks on Proxy don't increase
2024-05-03 12:44:56 -07:00
Krrish Dholakia
b2a0502383 bump: version 1.35.36 → 1.35.37 2024-05-03 12:42:20 -07:00
Krrish Dholakia
defc205348 test(test_alangfuse.py): fix test 2024-05-03 12:39:38 -07:00
frob
4adba181b2
Merge branch 'BerriAI:main' into ollama-image-handling 2024-05-03 20:56:10 +02:00
Lunik
9ba9b3891f
⚡️ perf: Remove test violation on each stream chunk
Signed-off-by: Lunik <lunik@tiwabbit.fr>
2024-05-03 20:51:40 +02:00
Lunik
e7405f105c
✅ ci: Add tests
Signed-off-by: Lunik <lunik@tiwabbit.fr>
2024-05-03 20:50:37 +02:00
Krish Dholakia
cb1872d7cb
Merge pull request #3422 from BerriAI/litellm_lowest_latency_fix
fix(lowest_latency.py): fix the size of the latency list to 10 by default (can be modified)
2024-05-03 10:14:50 -07:00
Krrish Dholakia
2dd9d2f704 test(test_amazing_vertex_completion.py): try-except api errors 2024-05-03 10:09:57 -07:00
Ishaan Jaff
9ba5685722 test active callbacks on proxy 2024-05-03 10:05:06 -07:00
Ishaan Jaff
fe6e465466 test - num callbacks on proxy should not increase 2024-05-03 09:59:59 -07:00
Vincelwt
508e53593b
Merge branch 'BerriAI:main' into main 2024-05-03 17:43:17 +01:00
Vince Loewe
3677d56e9e
Lunary: Fix tool calling 2024-05-03 17:42:50 +01:00
Ishaan Jaff
c6a9b460cd
Merge pull request #3419 from BerriAI/litellm_fix_lowest_latency_router
[Fix] Ensure callbacks are not added to router when `store_model_in_db=True`
2024-05-03 09:28:35 -07:00
Ishaan Jaff
23d334fe60 proxy - return num callbacks on /health/readiness 2024-05-03 09:14:32 -07:00
Ishaan Jaff
a1814a3e4c test - num callbacks on proxy 2024-05-03 09:13:37 -07:00
Krrish Dholakia
0b72904608 fix(lowest_latency.py): fix the size of the latency list to 10 by default (can be modified) 2024-05-03 09:00:32 -07:00
Ishaan Jaff
540a35ed5e fix update router logic 2024-05-03 08:48:11 -07:00
mogith-pn
723ef9963e Clarifai - Added streaming and async completion support 2024-05-03 14:03:38 +00:00
sumanth
3bc6b5d119 usage-based-routing-ttl-on-cache 2024-05-03 10:50:45 +05:30
mikey
de7fe98556
Merge branch 'BerriAI:main' into main 2024-05-03 11:30:03 +08:00
ffreemt
a7ec1772b1 Add litellm\tests\test_batch_completion_return_exceptions.py 2024-05-03 11:28:38 +08:00
Krrish Dholakia
91971fa9e0 feat(router.py): add 'get_model_info' helper function to get the model info for a specific model, based on it's id 2024-05-02 17:53:09 -07:00
Krrish Dholakia
fdc4fdb91a fix(proxy/utils.py): fix slack alerting to only raise alerts for llm api exceptions
don't spam for bad user requests. Closes https://github.com/BerriAI/litellm/issues/3395
2024-05-02 17:18:21 -07:00
Krrish Dholakia
5baeeec899 fix(openmeter.py): fix get from env 2024-05-02 16:34:22 -07:00
Krish Dholakia
2200900ca2
Merge pull request #3393 from Priva28/main
Add Llama3 tokenizer and allow custom tokenizers.
2024-05-02 16:32:41 -07:00
Ishaan Jaff
0b27f5b3dc
Merge pull request #3409 from BerriAI/litellm_revert_passing_langfuse_traces_alerts
fix - revert init langfuse client on slack alerts
2024-05-02 16:09:23 -07:00
Ishaan Jaff
9edf463c3b fix - revert init langfuse client on slack alerts 2024-05-02 16:02:52 -07:00
Marc Abramowitz
cdb39e90ce Improve mocking in test_proxy_exception_mapping
Mock the calls to the backend and assert that the correct parameters are passed
to the backend.
2024-05-02 15:16:20 -07:00
Ishaan Jaff
f893f8bc55
Merge pull request #3403 from msabramo/disambiguate-invalid-model-name-errors
Disambiguate invalid model name errors
2024-05-02 15:09:59 -07:00
Krish Dholakia
9e56472a81
Merge pull request #3406 from msabramo/test_proxy_server_mock_improvements
Improve mocking in `test_proxy_server.py`
2024-05-02 15:05:09 -07:00