Ishaan Jaff
f09da3f14c
test - test setting retry policies per model groups
2024-05-04 20:40:56 -07:00
Ishaan Jaff
90ac1e3fd9
feat - set retry policy per model group
2024-05-04 20:39:51 -07:00
Ishaan Jaff
87e165e413
Merge pull request #3456 from BerriAI/litellm_router_set_retry_policy_errors
...
[FEAT] router set custom num retries for ContentPolicyViolationErrorRetries, RateLimitErrorRetries, BadRequestErrorRetries etc
2024-05-04 18:26:03 -07:00
Ishaan Jaff
495d3a9646
router set dynamic retry policies
2024-05-04 18:13:43 -07:00
Ishaan Jaff
009f7c9bfc
support dynamic retry policies
2024-05-04 18:10:15 -07:00
Ishaan Jaff
f70ae68188
fix router test
2024-05-04 17:58:54 -07:00
Ishaan Jaff
bbf5d79069
docs - set retry policy
2024-05-04 17:52:01 -07:00
Ishaan Jaff
8d128a4b91
test - router retry policy
2024-05-04 17:30:30 -07:00
Ishaan Jaff
b83901a861
Merge pull request #3451 from BerriAI/litellm_return_model_api_base
...
[Feat] Return model, api_base and first 100 chars of messages in Azure Exceptions
2024-05-04 17:07:09 -07:00
Ishaan Jaff
9e4e467039
test router - retry policy
2024-05-04 17:06:34 -07:00
Ishaan Jaff
5d17c814a3
router - use retry policy
2024-05-04 17:04:51 -07:00
Ishaan Jaff
6d1981fbaa
init router retry policy
2024-05-04 16:59:14 -07:00
Krish Dholakia
601e8a1172
Merge pull request #3448 from BerriAI/litellm_anthropic_fix
...
fix(factory.py): support 'function' openai message role for anthropic
2024-05-04 16:36:05 -07:00
Ishaan Jaff
85b2137f9c
fix - test exceptions vertex ai
2024-05-04 16:09:20 -07:00
Ishaan Jaff
7150df653f
test azure exceptions are more decriptive
2024-05-04 13:02:29 -07:00
Ishaan Jaff
d45328dda6
Merge pull request #3450 from BerriAI/revert-3397-main
...
Revert "Add return_exceptions to litellm.batch_completion"
2024-05-04 13:01:25 -07:00
Ishaan Jaff
df8e33739d
Revert "Add return_exceptions to litellm.batch_completion"
2024-05-04 13:01:17 -07:00
Ishaan Jaff
d968dedd77
Merge pull request #1530 from TanaroSch/main
...
change max_tokens type to int
2024-05-04 12:47:15 -07:00
Krish Dholakia
a3905bad94
Merge pull request #3447 from BerriAI/litellm_fix_redis_ping
...
fix(caching.py): fix redis caching ping check
2024-05-04 12:46:31 -07:00
Krrish Dholakia
09d7121af2
fix(bedrock.py): map finish reason for bedrock
2024-05-04 12:45:40 -07:00
Ishaan Jaff
855c7caf0b
fix add get_first_chars_messages in utils
2024-05-04 12:43:09 -07:00
Ishaan Jaff
7094ac9557
Merge pull request #3397 from ffreemt/main
...
Add return_exceptions to litellm.batch_completion
2024-05-04 12:41:21 -07:00
Krrish Dholakia
8d49b3a84c
fix(factory.py): support openai 'functions' messages
2024-05-04 12:33:39 -07:00
Ishaan Jaff
faa8b77325
Merge pull request #3449 from BerriAI/litellm_return_messages_exceptions
...
[Feat] Add Exception mapping for Azure ContentPolicyViolationError
2024-05-04 11:55:19 -07:00
Ishaan Jaff
76825e1d2c
test - mapping content policy violation errors
2024-05-04 11:15:34 -07:00
Ishaan Jaff
c6beaf53af
litellm map Azure GPT ContentPolicyViolationError
2024-05-04 11:14:47 -07:00
Ishaan Jaff
59dac1bc7a
ui - new build
2024-05-04 10:55:39 -07:00
Krrish Dholakia
d9d5149aa1
fix(factory.py): support mapping openai 'tool' message to anthropic format
2024-05-04 10:14:52 -07:00
Krrish Dholakia
33472bfd2b
fix(factory.py): support 'function' openai message role for anthropic
...
Fixes https://github.com/BerriAI/litellm/issues/3446
2024-05-04 10:03:30 -07:00
Ishaan Jaff
0bc6969e4d
Merge pull request #3408 from msabramo/test_proxy_exception_mapping_mock_improvements
...
Improve mocking in `test_proxy_exception_mapping.py`
2024-05-04 09:29:41 -07:00
Krrish Dholakia
5a79f648c6
fix(caching.py): fix redis caching ping check
...
don't fail to startup. Log an error message.
2024-05-04 08:48:53 -07:00
Krish Dholakia
e7149a6812
Merge pull request #3445 from paneru-rajan/Issue-1159-imrove-reaceloop-doc
...
Improve the document of Traceloop
2024-05-04 08:35:56 -07:00
Rajan Paneru
7d9377f18a
Improve the document of Traceloop
...
If we follow exact step I was getting two errors, which this Pull-Request will fix:
* Fixed the yaml snippet spacing issue: it was throwing error when running copy+paste code
* Added api_key: my-fake-key as to run litellm --config config.yaml --debug it will be required, otherwise it will fail
Need for Improvements:
* The traceloop is ambigous, because it's a company that maintains OpenLLMetry, and has observability solution and the sdk name is aslo traceloop-sdk
* The doc was missing several other observability solutions
* The steps were not quite obvious, added one more steps to make things clear
2024-05-04 22:42:53 +09:30
Ishaan Jaff
8e9ba0f27f
Merge pull request #3441 from BerriAI/ui_select_start_end_time
...
UI select start end time
2024-05-03 22:14:58 -07:00
Ishaan Jaff
2cfb37aaaf
add text about model group / time range
2024-05-03 22:14:12 -07:00
Ishaan Jaff
1d9a96bf8f
ui - set models and start/endtimes
2024-05-03 22:10:40 -07:00
Ishaan Jaff
19aa43798c
ui - select model group
2024-05-03 22:09:22 -07:00
Ishaan Jaff
e7adbb3801
ui - model dashboard
2024-05-03 22:09:01 -07:00
Ishaan Jaff
d4afe8a3bc
ui - view logs by model group and time
2024-05-03 21:59:22 -07:00
Krrish Dholakia
b7ca9a53c9
refactor(main.py): trigger new build
2024-05-03 21:53:51 -07:00
Ishaan Jaff
611e7bd403
ui - select model group and date time range
2024-05-03 21:51:47 -07:00
Krrish Dholakia
fa47ce456d
bump: version 1.35.37 → 1.35.38
2024-05-03 21:38:32 -07:00
Krrish Dholakia
8249c986bf
fix(main.py): support new 'supports_system_message=False' param
...
Fixes https://github.com/BerriAI/litellm/issues/3325
2024-05-03 21:31:45 -07:00
Ishaan Jaff
ed714a9d6e
ui select model and start and endtime
2024-05-03 21:21:41 -07:00
Ishaan Jaff
d806fe3513
startTime and endTime on UI
2024-05-03 21:21:28 -07:00
Ishaan Jaff
fccdb92c6b
fix - select startTime and endTime on UI
2024-05-03 21:20:19 -07:00
Ishaan Jaff
f7150cdba2
ui - slect start and end date
2024-05-03 20:52:30 -07:00
Krrish Dholakia
a35ac050d2
test(test_router_fallbacks.py): bump test limits
2024-05-03 20:42:29 -07:00
Ishaan Jaff
01a11ccced
ui - new build
2024-05-03 20:40:58 -07:00
Krish Dholakia
7d2aa2f645
Merge pull request #3433 from BerriAI/litellm_timeout_fix
...
fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
2024-05-03 18:53:59 -07:00
