Sebastián Estévez
fc0ced48c1
add_function_to_prompt bug fix
...
This blows up when there's no "functions" in the dictionary even when tools is present because the inner function executes regardless (does not short circuit).
2024-05-03 23:38:54 -04:00
Krish Dholakia
7d2aa2f645
Merge pull request #3433 from BerriAI/litellm_timeout_fix
...
fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
2024-05-03 18:53:59 -07:00
Krish Dholakia
e6e742d464
Merge pull request #3436 from BerriAI/litellm_anthropic_stop_sequence_fix
...
fix(anthropic.py): drop unsupported non-whitespace character value wh…
2024-05-03 17:53:29 -07:00
Krrish Dholakia
097714e02f
fix(anthropic.py): handle whitespace characters for anthropic calls
2024-05-03 17:31:34 -07:00
Krrish Dholakia
0450abfdc1
fix(bedrock.py): fix boto3 config init
2024-05-03 17:22:06 -07:00
Ishaan Jaff
debd8137f3
Merge pull request #3435 from BerriAI/litellm_ui_filter_exceptions_by_model_group
...
Admin UI - filter exceptions by model group
2024-05-03 17:18:44 -07:00
Krrish Dholakia
0b9fa53e3e
fix(anthropic.py): drop unsupported non-whitespace character value when calling anthropic with stop sequences
...
Fixes https://github.com/BerriAI/litellm/issues/3286
2024-05-03 16:59:49 -07:00
Ishaan Jaff
e7034ea53d
feat - filter exceptions by model group
2024-05-03 16:54:24 -07:00
Ishaan Jaff
d3152e606f
fix - ui filter exceptions by modelGroup
2024-05-03 16:53:24 -07:00
Krrish Dholakia
f7eee60943
docs(exception_mapping.md): update exception mapping docs with 'should_retry'
2024-05-03 16:51:26 -07:00
Ishaan Jaff
2084cfd959
fix - test_check_num_callbacks
2024-05-03 16:41:08 -07:00
Ishaan Jaff
5e6b6c41c4
Merge pull request #3432 from BerriAI/litellm_add_bedrock_titan_embed
...
Feat - add bedrock titan embed-v2
2024-05-03 16:28:12 -07:00
Ishaan Jaff
926670bfb7
Merge pull request #3429 from BerriAI/litellm_add_unit_tests_slack_alerts
...
[Test] Add Slack Alerting unit tests
2024-05-03 16:27:40 -07:00
Ishaan Jaff
3dd1e8dfe7
Merge pull request #3427 from BerriAI/litellm_test_alert_size
...
[Test] - Ensure only 1 slack callback + Size of of all callbacks do not grow
2024-05-03 16:27:16 -07:00
Krish Dholakia
1b35a75245
Merge pull request #3430 from BerriAI/litellm_return_api_base
...
feat(proxy_server.py): return api base in response headers
2024-05-03 16:25:21 -07:00
Krrish Dholakia
a732d8772a
fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
...
Closes https://github.com/BerriAI/litellm/issues/3398
2024-05-03 16:24:21 -07:00
Ishaan Jaff
401bf8d67e
test - bedrock v2 supports dimension
2024-05-03 16:23:37 -07:00
Ishaan Jaff
4a39b95acc
fix - support dimension for titan embed v2
2024-05-03 16:13:27 -07:00
Ishaan Jaff
bf048ecda4
docs - titan embeddings v2
2024-05-03 15:59:02 -07:00
Ishaan Jaff
fbe412a3a6
feat - add amazon.titan-embed-text-v2
2024-05-03 15:58:05 -07:00
Ishaan Jaff
5333474a6f
Merge pull request #3431 from BerriAI/litellm_simplify_docs_prod
...
docs - simplify best practices for prod
2024-05-03 15:56:03 -07:00
Ishaan Jaff
209baaca02
docs - simplify prod docs
2024-05-03 15:40:05 -07:00
Krrish Dholakia
5b39f8e282
feat(proxy_server.py): return api base in response headers
...
Closes https://github.com/BerriAI/litellm/issues/2631
2024-05-03 15:27:32 -07:00
Ishaan Jaff
bae5d3601d
feat - add unit tests for slack alerting
2024-05-03 15:08:55 -07:00
Ishaan Jaff
ab27866b6a
fix test slack alerting len
2024-05-03 14:58:11 -07:00
Ishaan Jaff
a369867e02
test - num alerts on callbacks
2024-05-03 14:46:44 -07:00
Ishaan Jaff
e5311d35f2
fix test len active callbacks
2024-05-03 14:32:13 -07:00
Ishaan Jaff
3997ea6442
fix - return num callbacks in /active/callbacks
2024-05-03 14:24:01 -07:00
Ishaan Jaff
e9eead2f25
test - size of callbacks, alerts
2024-05-03 14:22:15 -07:00
Ishaan Jaff
e99edaf4e1
Merge pull request #3426 from BerriAI/litellm_set_db_exceptions_on_ui
...
UI - set DB Exceptions webhook_url on UI
2024-05-03 14:05:37 -07:00
Ishaan Jaff
776f541f6c
fix bug where slack would get inserting several times
2024-05-03 14:04:38 -07:00
Ishaan Jaff
fdc9856652
UI - set DB Exceptions webhook_url
2024-05-03 13:33:43 -07:00
Ishaan Jaff
34bf0b37f5
Merge pull request #3423 from BerriAI/litellm_test_callbacks_proxy
...
[Test] Assert num Callbacks on Proxy don't increase
2024-05-03 12:44:56 -07:00
Krrish Dholakia
b2a0502383
bump: version 1.35.36 → 1.35.37
2024-05-03 12:42:20 -07:00
Krrish Dholakia
defc205348
test(test_alangfuse.py): fix test
2024-05-03 12:39:38 -07:00
Krish Dholakia
cb1872d7cb
Merge pull request #3422 from BerriAI/litellm_lowest_latency_fix
...
fix(lowest_latency.py): fix the size of the latency list to 10 by default (can be modified)
2024-05-03 10:14:50 -07:00
Krrish Dholakia
2dd9d2f704
test(test_amazing_vertex_completion.py): try-except api errors
2024-05-03 10:09:57 -07:00
Ishaan Jaff
9ba5685722
test active callbacks on proxy
2024-05-03 10:05:06 -07:00
Ishaan Jaff
fe6e465466
test - num callbacks on proxy should not increase
2024-05-03 09:59:59 -07:00
Ishaan Jaff
c6a9b460cd
Merge pull request #3419 from BerriAI/litellm_fix_lowest_latency_router
...
[Fix] Ensure callbacks are not added to router when `store_model_in_db=True`
2024-05-03 09:28:35 -07:00
Ishaan Jaff
23d334fe60
proxy - return num callbacks on /health/readiness
2024-05-03 09:14:32 -07:00
Ishaan Jaff
a1814a3e4c
test - num callbacks on proxy
2024-05-03 09:13:37 -07:00
Krrish Dholakia
0b72904608
fix(lowest_latency.py): fix the size of the latency list to 10 by default (can be modified)
2024-05-03 09:00:32 -07:00
Ishaan Jaff
540a35ed5e
fix update router logic
2024-05-03 08:48:11 -07:00
Krrish Dholakia
91971fa9e0
feat(router.py): add 'get_model_info' helper function to get the model info for a specific model, based on it's id
2024-05-02 17:53:09 -07:00
Krrish Dholakia
fdc4fdb91a
fix(proxy/utils.py): fix slack alerting to only raise alerts for llm api exceptions
...
don't spam for bad user requests. Closes https://github.com/BerriAI/litellm/issues/3395
2024-05-02 17:18:21 -07:00
Krrish Dholakia
5baeeec899
fix(openmeter.py): fix get from env
2024-05-02 16:34:22 -07:00
Krish Dholakia
2200900ca2
Merge pull request #3393 from Priva28/main
...
Add Llama3 tokenizer and allow custom tokenizers.
2024-05-02 16:32:41 -07:00
Ishaan Jaff
0b27f5b3dc
Merge pull request #3409 from BerriAI/litellm_revert_passing_langfuse_traces_alerts
...
fix - revert init langfuse client on slack alerts
2024-05-02 16:09:23 -07:00
Ishaan Jaff
9edf463c3b
fix - revert init langfuse client on slack alerts
2024-05-02 16:02:52 -07:00
