Commit graph

15300 commits

Author SHA1 Message Date
Ishaan Jaff
b2fcf65653 log file_size_in_mb in metadata 2024-07-29 08:00:28 -07:00
Ishaan Jaff
0627468455 fix checking mode on health checks 2024-07-27 20:21:39 -07:00
Ishaan Jaff
9b69e500e5
Merge pull request #4927 from BerriAI/litellm_set_max_request_response_size_ui
Feat Enterprise -  set max request  / response size UI
2024-07-27 20:06:09 -07:00
Ishaan Jaff
10e70f842d
Merge pull request #4928 from BerriAI/litellm_check_response_size
[Feat Enterprise] - check max response size
2024-07-27 17:03:56 -07:00
Ishaan Jaff
b2f745f0e2
Merge pull request #4926 from BerriAI/litellm_check_max_request_size
Proxy Enterprise - security - check max request size
2024-07-27 17:02:12 -07:00
Ishaan Jaff
3511aadf99 allow setting max request / response size on admin UI 2024-07-27 17:00:39 -07:00
Ishaan Jaff
f633f7d92d set max_response_size_mb 2024-07-27 16:54:31 -07:00
Ishaan Jaff
b2f72338f6 feat check check_response_size_is_safe 2024-07-27 16:53:39 -07:00
Ishaan Jaff
41ca6fd52a feat - check max response size 2024-07-27 16:53:00 -07:00
Krish Dholakia
9efebc490d
Merge pull request #4730 from danielbichuetti/fireworks-fix-cost-map
[Feature]: Allow using custom and on-demand models in Fireworks AI + update data to model_prices_and_context_window.json
2024-07-27 16:43:48 -07:00
Krish Dholakia
f9eca63433
Merge pull request #4919 from yujonglee/fix-canary-dev
Fix Canary error with `docusaurus start`
2024-07-27 16:42:49 -07:00
Krrish Dholakia
a7785c624b docs(user_keys.md): improve openai migration docs 2024-07-27 16:29:06 -07:00
Ishaan Jaff
15d488c25c docs set max_request_size 2024-07-27 16:25:57 -07:00
Krrish Dholakia
c5ee6fe4b9 build: cookbook on migrating to litellm proxy from openai/azure sdk 2024-07-27 16:09:50 -07:00
Ishaan Jaff
4ab8d2229d security - check max request size 2024-07-27 16:08:41 -07:00
Ishaan Jaff
2e9fb5ca1f
Merge pull request #4924 from BerriAI/litellm_log_writing_spend_to_db_otel
[Feat] - log writing BatchSpendUpdate events on OTEL
2024-07-27 16:07:56 -07:00
Krrish Dholakia
d1989b6063 fix(utils.py): support fireworks ai finetuned models
Fixes https://github.com/BerriAI/litellm/issues/4923
2024-07-27 15:38:27 -07:00
Ishaan Jaff
35ecf3c06b fix otel test 2024-07-27 15:30:58 -07:00
Krrish Dholakia
05ba34b9b7 fix(utils.py): add exception mapping for databricks errors 2024-07-27 13:13:31 -07:00
Ishaan Jaff
7dac0e0001 fix otel logging 2024-07-27 12:05:24 -07:00
Ishaan Jaff
7c0ea16e3d test otel for batch_write_to_db 2024-07-27 11:47:17 -07:00
Ishaan Jaff
19fb5cc11c use common helpers for writing to otel 2024-07-27 11:40:39 -07:00
Ishaan Jaff
f71ba63cab refactor use common helper 2024-07-27 11:39:03 -07:00
Ishaan Jaff
32eb3bd719 add new BATCH_WRITE_TO_DB type for service logger 2024-07-27 11:36:51 -07:00
Ishaan Jaff
d5d9ed73af use _get_parent_otel_span_from_kwargs 2024-07-27 11:14:06 -07:00
Ishaan Jaff
2a89486948 move _get_parent_otel_span_from_kwargs to otel.py 2024-07-27 11:12:13 -07:00
Ishaan Jaff
61c10e60a4 feat - use log_to_opentelemetry for _PROXY_track_cost_callback 2024-07-27 11:08:22 -07:00
Krrish Dholakia
1a8f45e8da build(model_prices_and_context_window.json): add mistral nemo + codestral pricing 2024-07-27 10:46:52 -07:00
Krrish Dholakia
2719860c46 build(model_prices_and_context_window.json): add mistral-large on vertex ai pricing 2024-07-27 10:37:18 -07:00
Ishaan Jaff
3f39e61b15
Merge pull request #4921 from BerriAI/litellm_update_verifying_airgapped_license
[Fix] using airgapped license for Enterprise
2024-07-27 09:57:46 -07:00
Ishaan Jaff
1adf71b9b7 feat - clearly show version litellm enterprise 2024-07-27 09:50:03 -07:00
Krish Dholakia
230b0c9a3d
Merge pull request #4920 from idris/patch-2
Fix Datadog JSON serialization
2024-07-27 09:46:06 -07:00
Ishaan Jaff
6f428a16fa fix update public key 2024-07-27 09:45:58 -07:00
Krrish Dholakia
1e621f716f docs(debugging.md): cleanup docs 2024-07-27 09:28:53 -07:00
Krrish Dholakia
0356decdec bump: version 1.42.4 → 1.42.5 2024-07-27 09:16:08 -07:00
Idris Mokhtarzada
c2c5877afa
Fix Datadog JSON serialization
Nested dicts were not being serialized properly
2024-07-27 02:16:36 -04:00
yujonglee
48a1a2ba26 fix 2024-07-27 15:05:17 +09:00
Krish Dholakia
9bdcef238b
Merge pull request #4907 from BerriAI/litellm_proxy_get_secret
fix(proxy_server.py): fix get secret for environment_variables
2024-07-26 22:17:11 -07:00
Krish Dholakia
f9c2fec1a6
Merge pull request #4918 from BerriAI/litellm_ollama_tool_calling
feat(ollama_chat.py): support ollama tool calling
2024-07-26 22:16:58 -07:00
Krrish Dholakia
77fe8f57cf docs(ollama.md): add ollama tool calling to docs 2024-07-26 22:12:52 -07:00
Krrish Dholakia
b25d4a8cb3 feat(ollama_chat.py): support ollama tool calling
Closes https://github.com/BerriAI/litellm/issues/4812
2024-07-26 21:51:54 -07:00
Ishaan Jaff
1506e74332 bump: version 1.42.3 → 1.42.4 2024-07-26 21:37:52 -07:00
Ishaan Jaff
36187102d1
Merge pull request #4917 from BerriAI/litellm_link_tomodel_cost
[Feat] Link to https://models.litellm.ai/ on Swagger docs and docs
2024-07-26 21:37:04 -07:00
Ishaan Jaff
f03769e2a4 docs fix link https://models.litellm.ai/ 2024-07-26 21:35:54 -07:00
Ishaan Jaff
2501b4eccd feat link to model cost map on swagger 2024-07-26 21:34:42 -07:00
Krrish Dholakia
a264d1ca8c feat(vertex_httpx.py): support logging citation metadata
Closes https://github.com/BerriAI/litellm/issues/3230
2024-07-26 20:54:59 -07:00
Krrish Dholakia
fe7f78fbf6 feat(vertex_httpx.py): support logging vertex ai safety results to langfuse
Closes https://github.com/BerriAI/litellm/issues/3230
2024-07-26 20:50:43 -07:00
Ishaan Jaff
a7f964b869
Merge pull request #4913 from BerriAI/litellm_fix_error_limit
[Proxy-Fix] - raise more descriptive errors when crossing tpm / rpm limits on keys, user, global limits
2024-07-26 20:25:28 -07:00
Ishaan Jaff
3c463ccbe6
Merge pull request #4914 from BerriAI/litellm_fix_batches
[Proxy-Fix + Test] - /batches endpoint
2024-07-26 20:12:03 -07:00
Krrish Dholakia
fe0b55f2ca fix(utils.py): fix cache hits for streaming
Fixes https://github.com/BerriAI/litellm/issues/4109
2024-07-26 19:04:08 -07:00