Commit graph

15537 commits

Author SHA1 Message Date
Ishaan Jaff
f5b8ecbcc3 docs spend tracking enteprrise 2024-08-01 20:52:23 -07:00
Krrish Dholakia
4355e923e5 fix(langfuse.py): cleanup 2024-08-01 20:46:29 -07:00
Ishaan Jaff
7f93fa01e9 ci/cd run again 2024-08-01 19:55:12 -07:00
Ishaan Jaff
85ced920a0 fix test traceloop.py 2024-08-01 19:49:53 -07:00
Krrish Dholakia
540d5f318b feat(litellm_logging.py): log exception response headers to langfuse 2024-08-01 18:01:07 -07:00
Ishaan Jaff
7b30cdd60c
Update prompt_injection.md 2024-08-01 18:00:02 -07:00
Ishaan Jaff
80831ce73f ci/cd - anyscale discontinued their API endoints - skip test 2024-08-01 17:58:48 -07:00
Ishaan Jaff
fc3463e178 fix model prices formatting 2024-08-01 17:28:31 -07:00
Krish Dholakia
caf11ce7da
Merge pull request #5002 from Manouchehri/gemini-1.5-pro-exp-0801-gemini-1
Add new model for gemini-1.5-pro-exp-0801.
2024-08-01 17:27:49 -07:00
Ishaan Jaff
ae13095065 bump: version 1.42.8 → 1.42.9 2024-08-01 17:16:15 -07:00
Ishaan Jaff
da036a049a fix test_traceparent_not_added_by_default 2024-08-01 17:16:06 -07:00
Ishaan Jaff
fc64c957cf
Merge pull request #5003 from BerriAI/litellm_add_db_llama
Add `databricks/databricks-meta-llama-3-1-70b-instruct`, 'databricks/databricks-meta-llama-3-1-405b-instruct'
2024-08-01 17:11:26 -07:00
Ishaan Jaff
1ce847f7c4 docs dbrx 2024-08-01 16:52:52 -07:00
Ishaan Jaff
8e1a7c0b2d docs add new dbrx models 2024-08-01 16:51:28 -07:00
Ishaan Jaff
a52ffb9365 add correct context window 2024-08-01 16:50:11 -07:00
Ishaan Jaff
be7e6b1c53 add new dbrx models 2024-08-01 16:46:41 -07:00
Ishaan Jaff
85f802d2c6 docs gcs buckets 2024-08-01 16:29:28 -07:00
Krish Dholakia
e2897317f5
Merge pull request #4992 from lowjiansheng/js/update-litellm-helm-chart-0.2.2
Update helm chart to 0.2.2
2024-08-01 16:24:56 -07:00
Ishaan Jaff
cf4e48da5f
Merge pull request #4999 from BerriAI/litellm_add_gcs_bucket_support
[Enterprise Proxy Feature] - Log to GCS Bucket 
2024-08-01 16:22:42 -07:00
Ishaan Jaff
998678f028 enforce premium user cheks on gcs bucket 2024-08-01 16:18:37 -07:00
Ishaan Jaff
0aaa4b29a1 docs logging to GCS 2024-08-01 16:16:33 -07:00
Krrish Dholakia
246b3227a9 fix(vertex_ai_partner.py): add /chat/completion codestral support
Closes https://github.com/BerriAI/litellm/issues/4984
2024-08-01 16:12:05 -07:00
Ishaan Jaff
3e39e8eb8f docs setting service accounts 2024-08-01 15:31:58 -07:00
Ishaan Jaff
6c368b703e init gcs using gcs_bucket 2024-08-01 15:25:19 -07:00
Ishaan Jaff
617b2b946c docs using gcs 2024-08-01 15:23:17 -07:00
Krrish Dholakia
1ffd96b348 fix(google.py): fix cost tracking for vertex ai mistral models 2024-08-01 15:22:32 -07:00
David Manouchehri
e6f18fdc62
Add new model for gemini-1.5-pro-exp-0801. 2024-08-01 22:20:19 +00:00
Krrish Dholakia
63735c9a54 build(model_prices_and_context_window.json): add mistral nemo latest to model cost map 2024-08-01 15:17:22 -07:00
Krrish Dholakia
2a7ed84a23 fix(databricks.py): fix error handling 2024-08-01 15:15:45 -07:00
Krrish Dholakia
1affd4e2ca fix: add type hints for APIError and AnthropicError status codes
Fixes https://github.com/BerriAI/litellm/issues/5000
2024-08-01 15:08:54 -07:00
Ishaan Jaff
327e7ece54 fix type errors 2024-08-01 15:02:29 -07:00
Ishaan Jaff
5962267bf5 delete object from gcs 2024-08-01 14:25:25 -07:00
Ishaan Jaff
877836afcf test writing logs to GCS bucket 2024-08-01 13:58:42 -07:00
Ishaan Jaff
9a5e1058c6 feat gcs bucket log payload 2024-08-01 13:49:14 -07:00
Ishaan Jaff
2a6756ab5b add better debugging statements for vertex logging 2024-08-01 13:34:59 -07:00
Ishaan Jaff
40e062b13a basic gcs logging test 2024-08-01 13:33:17 -07:00
Krrish Dholakia
aad0bbb08c fix(cost_calculator.py): respect litellm.suppress_debug_info for cost calc
Fixes https://github.com/BerriAI/litellm/issues/4818#issuecomment-2263795765
2024-08-01 12:27:09 -07:00
Ishaan Jaff
dce8e3efb8 testing fix - skip rate limit errors from anthropic api 2024-08-01 12:12:50 -07:00
Ishaan Jaff
bae8be340e docs enterprise 2024-08-01 12:10:19 -07:00
Ishaan Jaff
81cd217847 docs enterprise feature 2024-08-01 12:05:49 -07:00
Ishaan Jaff
c494d8ac9a docs enterprise feature 2024-08-01 12:05:38 -07:00
Ishaan Jaff
220b839693 docs - team based logging 2024-08-01 11:58:40 -07:00
Ishaan Jaff
5c810ec326
Merge pull request #4997 from BerriAI/litellm_otel_fail_handler
[Fix-Proxy] Log attributes on failed LLM calls
2024-08-01 11:57:45 -07:00
Ishaan Jaff
c87f97bf6d
Merge pull request #4995 from BerriAI/litellm_otel_fwd_traceparent
[Fix-OTEL Proxy] Only forward traceparent to llm api when `litellm.forward_traceparent_to_llm_provider=True`
2024-08-01 11:57:35 -07:00
Ishaan Jaff
96af712605 fix _handle_failure for otel 2024-08-01 11:12:31 -07:00
Ishaan Jaff
cc9a597d37 ui new build 2024-08-01 09:59:24 -07:00
Ishaan Jaff
457436e12e ui fix entering custom model names for azure 2024-08-01 09:58:37 -07:00
Krrish Dholakia
d02d3d9712 build(model_prices_and_context_window.json): add azure gpt-4o-mini regional + global standard pricing to model cost map 2024-08-01 09:44:40 -07:00
Ishaan Jaff
4a39006b30 forward_traceparent_to_llm_provider 2024-08-01 09:40:45 -07:00
Ishaan Jaff
d12578e4ea test_traceparent_not_added_by_default 2024-08-01 09:36:09 -07:00