Ishaan Jaff
3e4e72ff1b
Merge pull request #5461 from BerriAI/litellm_add_cerebras
...
[Feat] New Provider - Add Cerebras AI API
2024-08-31 16:30:56 -07:00
Ishaan Jaff
56f10224df
Merge pull request #5457 from BerriAI/litellm_track_spend_logs_for_vertex_pass_through_endpoints
...
[Feat-Proxy] track spend logs for vertex pass through endpoints
2024-08-31 16:30:15 -07:00
Ishaan Jaff
4bd85b9d83
add cerebras cost tracking
2024-08-31 16:29:26 -07:00
Ishaan Jaff
9a3873b9ed
mark flaky test as flaky
2024-08-31 15:02:56 -07:00
Ishaan Jaff
fd4157cf71
docs add cerebras
2024-08-31 14:57:12 -07:00
Krrish Dholakia
017dd88910
test: skip test on end of life model
2024-08-31 14:50:12 -07:00
Krish Dholakia
47ef1f9191
anthropic prompt caching cost tracking ( #5453 )
...
* fix(utils.py): support 'drop_params' for embedding requests
Fixes https://github.com/BerriAI/litellm/issues/5444
* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic
* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out
* fix: fix linting errors
* test: mark flaky test
2024-08-31 14:50:12 -07:00
Ishaan Jaff
2e0ee8c72f
skip end of life model in test
2024-08-31 14:48:52 -07:00
Krrish Dholakia
f450b99368
test: skip test on end of life model
2024-08-31 14:34:16 -07:00
Krish Dholakia
9c8f1d7815
anthropic prompt caching cost tracking ( #5453 )
...
* fix(utils.py): support 'drop_params' for embedding requests
Fixes https://github.com/BerriAI/litellm/issues/5444
* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic
* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out
* fix: fix linting errors
* test: mark flaky test
2024-08-31 14:09:35 -07:00
Ishaan Jaff
b8bc448479
ci/cd run again
2024-08-31 09:42:58 -07:00
Ishaan Jaff
9e557ed072
fix test
2024-08-31 08:39:52 -07:00
Ishaan Jaff
de9efe76ca
add cerebras api
2024-08-31 08:35:23 -07:00
Ishaan Jaff
cb6a0f0237
add cerebras config
2024-08-31 08:34:46 -07:00
Ishaan Jaff
b35bfb0302
fix cost tracking for vertex ai native
2024-08-31 08:22:27 -07:00
Ishaan Jaff
3a72197e77
Merge pull request #5455 from BerriAI/litellm_vtx_add_input_type_mapping
...
[Feat] Vertex embeddings - map `input_type` to `text_type`
2024-08-30 17:03:04 -07:00
Ishaan Jaff
745bf3245a
Merge pull request #5458 from BerriAI/litellm_fix_allow_passthrough_as_llm_api
...
[Fix-Proxy-Auth] allow pass through routes as LLM API routes
2024-08-30 17:02:42 -07:00
Ishaan Jaff
06857d108d
fix /spend logs call
2024-08-30 17:02:24 -07:00
Ishaan Jaff
2c86a62474
fix vertex ai test
2024-08-30 16:50:23 -07:00
Ishaan Jaff
f43060e8df
mark as async
2024-08-30 16:40:41 -07:00
Ishaan Jaff
11776dcda5
bump: version 1.44.12 → 1.44.13
2024-08-30 16:37:14 -07:00
Ishaan Jaff
414d2dcb52
call spend logs endpoint
2024-08-30 16:35:07 -07:00
Ishaan Jaff
c86d1cb391
fix tests
2024-08-30 16:29:32 -07:00
Ishaan Jaff
f3f85f6141
add test for vertex basic pass throgh
2024-08-30 16:26:00 -07:00
Ishaan Jaff
8ed0ffea54
fix use existing custom_auth.py
2024-08-30 16:22:28 -07:00
Ishaan Jaff
36fda54970
allow pass through routes as LLM API routes
2024-08-30 16:08:44 -07:00
Ishaan Jaff
9f18aa4588
fix test_vertexai_embedding_embedding_latest_input_type
2024-08-30 15:57:44 -07:00
Ishaan Jaff
f50374e81d
use helper class for pass through success handler
2024-08-30 15:52:47 -07:00
Ishaan Jaff
e1e1e2e566
add example custom
2024-08-30 15:46:45 -07:00
Ishaan Jaff
69dea613ca
ci/cd run again
2024-08-30 14:03:00 -07:00
Ishaan Jaff
9f87481ef0
docs add task type for vertex ai
2024-08-30 13:31:24 -07:00
Ishaan Jaff
541033ec7e
add VertexAITextEmbeddingConfig
2024-08-30 12:53:43 -07:00
Ishaan Jaff
bc45114c53
Merge pull request #5454 from BerriAI/litellm_refactor
...
[Refactor] Refactor vertex text to speech to be in vertex directory
2024-08-30 12:28:14 -07:00
Ishaan Jaff
518aa639fa
fix map input_type to task_type for vertex ai
2024-08-30 12:09:07 -07:00
Ishaan Jaff
7f303db955
Merge pull request #5450 from BerriAI/litellm_load_config_from_gcs
...
[Feat-Proxy] Load config.yaml from GCS Bucket
2024-08-30 12:08:54 -07:00
Ishaan Jaff
281b183c7c
Merge pull request #5452 from BerriAI/litellm_allow_qdrant_api_key_to_be_optional
...
[Fix-Proxy] - Allow Qdrant API Key to be optional
2024-08-30 12:07:57 -07:00
Ishaan Jaff
5056e1e400
Merge pull request #5451 from BerriAI/litellm_fix_vertex
...
[Fix-Proxy] Vertex SDK pass through - pass all relevant vertex creds
2024-08-30 11:45:16 -07:00
Ishaan Jaff
570a5a2825
fix dir structure for tts
2024-08-30 11:44:23 -07:00
Ishaan Jaff
15296b4fb7
fix allow qdrant api key to be optional
2024-08-30 11:13:23 -07:00
Ishaan Jaff
50014aa78e
vertex forward all headers from vertex
2024-08-30 11:05:23 -07:00
Ishaan Jaff
fcdfaac84b
Merge pull request #5419 from Manouchehri/gemini-1.5-pro-exp-0827-pricing
...
(models): Add gemini-1.5-pro-exp-0827 pricing.
2024-08-30 10:50:10 -07:00
Ishaan Jaff
a842723bb0
Merge pull request #5439 from BerriAI/litellm_use_correct_ai21_pricing
...
[Fix] Use correct Vertex AI AI21 Cost tracking
2024-08-30 10:49:42 -07:00
Ishaan Jaff
6109501274
update doc
2024-08-30 10:47:40 -07:00
Ishaan Jaff
c781fbcc55
doc using gcs bucket config.yaml
2024-08-30 10:44:41 -07:00
Ishaan Jaff
7d746064ab
add gcs bucket base
2024-08-30 10:41:39 -07:00
Ishaan Jaff
051ac50fca
use helper to get_config_file_contents_from_gcs
2024-08-30 10:26:42 -07:00
Ishaan Jaff
1bd2b2fc92
Merge pull request #5449 from BerriAI/litellm_Fix_vertex_multimodal
...
[Fix-Proxy] Allow running /health checks on vertex multimodal embedding requests
2024-08-30 10:21:42 -07:00
Ishaan Jaff
a6273a29fe
add test for test_vertexai_multimodal_embedding_text_input
2024-08-30 09:19:48 -07:00
Krish Dholakia
8d6a0bdc81
- merge - fix TypeError: 'CompletionUsage' object is not subscriptable #5441 ( #5448 )
...
* fix TypeError: 'CompletionUsage' object is not subscriptable (#5441 )
* test(test_team_logging.py): mark flaky test
---------
Co-authored-by: yafei lee <yafei@dao42.com>
2024-08-30 08:54:42 -07:00
JooHo Kim
5b1d9712c5
chore: Clarify support-related Exceptions in utils.py ( #5447 )
...
Improved the clarity of Exceptions in supports_system_messages, supports_response_schema, supports_function_calling, and supports_parallel_function_calling. Previously, it was difficult to determine the cause of Exception logs due to vague messaging. Each case now includes a more specific and appropriate Exception message.
2024-08-30 08:29:05 -07:00
