Commit graph

13556 commits

Author SHA1 Message Date
Ishaan Jaff
d30cdd82cc move caching up on left nav 2024-06-21 14:28:15 -07:00
Ishaan Jaff
b91854bdbb ui - show leading cache indicators 2024-06-21 13:43:47 -07:00
Ishaan Jaff
829ac3a0d0 ui - add new cache hits page 2024-06-21 13:10:40 -07:00
Ishaan Jaff
10e88a939d backend - new endpoint to show cache hit stats 2024-06-21 13:08:54 -07:00
Ishaan Jaff
12f4fb3a42 fix refactor - add batches endpoints proxy server.py 2024-06-21 07:55:53 -07:00
Krish Dholakia
361e47882b
Merge pull request #4121 from friendliai/feat/friendliai
feat: friendli ai support
2024-06-20 22:17:41 -07:00
Ishaan Jaff
e23b56fe16 ci/cd run again 2024-06-20 21:58:17 -07:00
Ishaan Jaff
0efd94cfca ci/cd run again 2024-06-20 21:47:48 -07:00
Krrish Dholakia
97d33324df test: trigger new build 2024-06-20 21:42:42 -07:00
Krrish Dholakia
086d3b2877 ci(config.yml): fix testing 2024-06-20 21:39:28 -07:00
Krrish Dholakia
dfd5882c31 fix(vertex_httpx.py): allow passing extra headers
Closes https://github.com/BerriAI/litellm/pull/4327
2024-06-20 21:14:44 -07:00
Ishaan Jaff
3a510582c2 fix test_litellm_proxy_server_config_no_general_settings 2024-06-20 21:11:30 -07:00
Ishaan Jaff
558c00931e
Merge pull request #4322 from BerriAI/litellm_bug_fix_spend_tracking
[Fix]  user field and user_api_key_* is sometimes omitted randomly
2024-06-20 21:10:13 -07:00
Ishaan Jaff
f2677620fd test_call_with_end_user_over_budget 2024-06-20 21:08:06 -07:00
Krrish Dholakia
cd73ea245a test(test_lowest_latency_routing.py): use mock responses 2024-06-20 21:05:23 -07:00
Krrish Dholakia
e96326a211 docs(input.md): update docs with parallel_tool_calls 2024-06-20 21:01:49 -07:00
Krrish Dholakia
5ff74f90ad bump: version 1.40.19 → 1.40.20 2024-06-20 20:54:29 -07:00
Krish Dholakia
e7e7b0e265
Merge pull request #4328 from BerriAI/litellm_proxy_testing
test(test_python_38.py): add coverage for non-gen settings config.yaml flow
2024-06-20 20:46:46 -07:00
Krrish Dholakia
46da517cdf test(test_python_38.py): add longer delay 2024-06-20 20:42:32 -07:00
Krrish Dholakia
9b5aa90bb7 test(test_python_38.py): add relevant installs 2024-06-20 20:39:59 -07:00
Krish Dholakia
f86290584a
Merge pull request #4290 from BerriAI/litellm_specific_deployment
feat(router.py): allow user to call specific deployment via id
2024-06-20 20:36:13 -07:00
Krish Dholakia
790d7057cb
Merge pull request #4323 from BerriAI/litellm_fix_duration_in_s
fix(key_management_endpoints.py): use common _duration_in_seconds function
2024-06-20 20:35:59 -07:00
Krrish Dholakia
906f3698de fix(proxy_cli.py): fix tab error 2024-06-20 20:32:22 -07:00
Krrish Dholakia
40ca30813e test(test_python_38.py): add coverage for non-gen settings config.yaml flow
Adds testing for this https://github.com/BerriAI/litellm/issues/4324
2024-06-20 20:29:10 -07:00
Ishaan Jaff
aa3c14fa46 make sure linting runs proxy_cli.py 2024-06-20 20:20:08 -07:00
Ishaan Jaff
df8317774c ci/cd again 2024-06-20 20:07:33 -07:00
Ishaan Jaff
0810b5fcb4 ci/cd again 2024-06-20 20:06:52 -07:00
Ishaan Jaff
0f29207c48 test add flake8 check on cli.py 2024-06-20 20:05:32 -07:00
Ishaan Jaff
1db25d5b6a fix test_call_with_end_user_over_budget 2024-06-20 19:54:34 -07:00
Krish Dholakia
c36a2cc262
Merge pull request #4325 from vanpelt/patch-3
Update proxy_cli.py
2024-06-20 19:33:08 -07:00
Wonseok Lee (Jack)
c4c7d1b367
Merge branch 'main' into feat/friendliai 2024-06-21 10:50:03 +09:00
Chris Van Pelt
306c2b425d
Update proxy_cli.py
Fixed indentation to so we don't get an `UnboundLocalError`.  Fixes #4324
2024-06-20 17:48:16 -07:00
Krrish Dholakia
3feaf231ac docs(drop_params.md): drop unsupported params 2024-06-20 17:43:07 -07:00
Ishaan Jaff
76145a94fb test - key test_call_with_key_over_budget_no_cache 2024-06-20 17:30:03 -07:00
Ishaan Jaff
c4b34946ed fix update_cache function 2024-06-20 17:27:25 -07:00
Krish Dholakia
8ab29d7171
Merge pull request #4321 from BerriAI/litellm_fallbacks_assert_access
fix(user_api_key_auth.py): ensure user has access to fallback models
2024-06-20 17:26:12 -07:00
Krrish Dholakia
511c0dc4d7 fix(key_management_endpoints.py): use common _duration_in_seconds function 2024-06-20 17:02:31 -07:00
Ishaan Jaff
0003de41c1 fix don't store bad api key in user api key cache 2024-06-20 16:55:12 -07:00
Krrish Dholakia
d3a3146155 fix(vertex_httpx.py): support setting custom api base for vertex ai calls
Closes https://github.com/BerriAI/litellm/issues/4317
2024-06-20 16:33:37 -07:00
Krrish Dholakia
5729eb5168 fix(user_api_key_auth.py): ensure user has access to fallback models
for client side fallbacks, checks if user has access to fallback models
2024-06-20 16:02:19 -07:00
Krrish Dholakia
14da2d5ade fix(_logging.py): fix timestamp format for json logs
Outputs timestamp in ISO 8601 format to work with fluentbit
2024-06-20 15:20:21 -07:00
Krrish Dholakia
248ee488f0 fix(proxy_cli.py): fix double counting json logs 2024-06-20 15:15:23 -07:00
Krish Dholakia
c8a40eca05
Merge pull request #4313 from BerriAI/litellm_drop_specific_params
fix(utils.py): allow dropping specific openai params
2024-06-20 15:15:19 -07:00
Ishaan Jaff
aa8f0637d1
Merge pull request #4318 from BerriAI/litellm_use_custom_routing_strat
[Feat] allow using custom router strategy
2024-06-20 15:11:51 -07:00
Ishaan Jaff
112c25217b
Merge pull request #4320 from BerriAI/docs_add_algolia_search
docs - add algolia search 🫡
2024-06-20 14:50:54 -07:00
Ishaan Jaff
648c20aef9 docs - add algolia search 2024-06-20 14:49:36 -07:00
Ishaan Jaff
cdc1e952ac router - add doc string 2024-06-20 14:36:51 -07:00
Ishaan Jaff
91d9d59717 docs - routing 2024-06-20 14:32:52 -07:00
Krrish Dholakia
db2cf5b5a5 build(model_prices_and_context_window.json): fixes https://github.com/BerriAI/litellm/issues/4305 2024-06-20 14:22:48 -07:00
Krrish Dholakia
473509aed3 build(model_prices_and_context_window.json): fix azure/gpt-35-turbo-1106 pricing 2024-06-20 14:17:49 -07:00