Ishaan Jaff
d9f3ac5159
Merge pull request #5463 from BerriAI/litellm_track_error_per_model
...
[Feat - Prometheus] - Track error_code, model metric
2024-08-31 16:36:04 -07:00
Ishaan Jaff
3e4e72ff1b
Merge pull request #5461 from BerriAI/litellm_add_cerebras
...
[Feat] New Provider - Add Cerebras AI API
2024-08-31 16:30:56 -07:00
Ishaan Jaff
56f10224df
Merge pull request #5457 from BerriAI/litellm_track_spend_logs_for_vertex_pass_through_endpoints
...
[Feat-Proxy] track spend logs for vertex pass through endpoints
2024-08-31 16:30:15 -07:00
Ishaan Jaff
4bd85b9d83
add cerebras cost tracking
2024-08-31 16:29:26 -07:00
Ishaan Jaff
9a3873b9ed
mark flaky test as flaky
2024-08-31 15:02:56 -07:00
Ishaan Jaff
fd4157cf71
docs add cerebras
2024-08-31 14:57:12 -07:00
Krrish Dholakia
336022e97c
test: skip test on end of life model
2024-08-31 14:50:52 -07:00
Krish Dholakia
65a9c933ad
anthropic prompt caching cost tracking ( #5453 )
...
* fix(utils.py): support 'drop_params' for embedding requests
Fixes https://github.com/BerriAI/litellm/issues/5444
* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic
* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out
* fix: fix linting errors
* test: mark flaky test
2024-08-31 14:50:52 -07:00
Krrish Dholakia
017dd88910
test: skip test on end of life model
2024-08-31 14:50:12 -07:00
Krish Dholakia
47ef1f9191
anthropic prompt caching cost tracking ( #5453 )
...
* fix(utils.py): support 'drop_params' for embedding requests
Fixes https://github.com/BerriAI/litellm/issues/5444
* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic
* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out
* fix: fix linting errors
* test: mark flaky test
2024-08-31 14:50:12 -07:00
Ishaan Jaff
2e0ee8c72f
skip end of life model in test
2024-08-31 14:48:52 -07:00
Ishaan Jaff
e6faaba56e
docs add litellm_error_code_metric_total
2024-08-31 14:46:41 -07:00
Krrish Dholakia
f450b99368
test: skip test on end of life model
2024-08-31 14:34:16 -07:00
Krish Dholakia
9c8f1d7815
anthropic prompt caching cost tracking ( #5453 )
...
* fix(utils.py): support 'drop_params' for embedding requests
Fixes https://github.com/BerriAI/litellm/issues/5444
* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic
* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out
* fix: fix linting errors
* test: mark flaky test
2024-08-31 14:09:35 -07:00
Ishaan Jaff
6ab601432b
feat prometheus add metric for failure / model
2024-08-31 10:05:23 -07:00
Ishaan Jaff
b8bc448479
ci/cd run again
2024-08-31 09:42:58 -07:00
Ishaan Jaff
9e557ed072
fix test
2024-08-31 08:39:52 -07:00
Ishaan Jaff
de9efe76ca
add cerebras api
2024-08-31 08:35:23 -07:00
Ishaan Jaff
cb6a0f0237
add cerebras config
2024-08-31 08:34:46 -07:00
Ishaan Jaff
b35bfb0302
fix cost tracking for vertex ai native
2024-08-31 08:22:27 -07:00
Ishaan Jaff
3a72197e77
Merge pull request #5455 from BerriAI/litellm_vtx_add_input_type_mapping
...
[Feat] Vertex embeddings - map `input_type` to `text_type`
2024-08-30 17:03:04 -07:00
Ishaan Jaff
745bf3245a
Merge pull request #5458 from BerriAI/litellm_fix_allow_passthrough_as_llm_api
...
[Fix-Proxy-Auth] allow pass through routes as LLM API routes
2024-08-30 17:02:42 -07:00
Ishaan Jaff
06857d108d
fix /spend logs call
2024-08-30 17:02:24 -07:00
Ishaan Jaff
2c86a62474
fix vertex ai test
2024-08-30 16:50:23 -07:00
Ishaan Jaff
f43060e8df
mark as async
2024-08-30 16:40:41 -07:00
Ishaan Jaff
11776dcda5
bump: version 1.44.12 → 1.44.13
2024-08-30 16:37:14 -07:00
Ishaan Jaff
414d2dcb52
call spend logs endpoint
2024-08-30 16:35:07 -07:00
Ishaan Jaff
c86d1cb391
fix tests
2024-08-30 16:29:32 -07:00
Ishaan Jaff
f3f85f6141
add test for vertex basic pass throgh
2024-08-30 16:26:00 -07:00
Ishaan Jaff
8ed0ffea54
fix use existing custom_auth.py
2024-08-30 16:22:28 -07:00
Ishaan Jaff
36fda54970
allow pass through routes as LLM API routes
2024-08-30 16:08:44 -07:00
Ishaan Jaff
9f18aa4588
fix test_vertexai_embedding_embedding_latest_input_type
2024-08-30 15:57:44 -07:00
Ishaan Jaff
f50374e81d
use helper class for pass through success handler
2024-08-30 15:52:47 -07:00
Ishaan Jaff
e1e1e2e566
add example custom
2024-08-30 15:46:45 -07:00
Ishaan Jaff
69dea613ca
ci/cd run again
2024-08-30 14:03:00 -07:00
Ishaan Jaff
9f87481ef0
docs add task type for vertex ai
2024-08-30 13:31:24 -07:00
Ishaan Jaff
541033ec7e
add VertexAITextEmbeddingConfig
2024-08-30 12:53:43 -07:00
Ishaan Jaff
bc45114c53
Merge pull request #5454 from BerriAI/litellm_refactor
...
[Refactor] Refactor vertex text to speech to be in vertex directory
2024-08-30 12:28:14 -07:00
Ishaan Jaff
518aa639fa
fix map input_type to task_type for vertex ai
2024-08-30 12:09:07 -07:00
Ishaan Jaff
7f303db955
Merge pull request #5450 from BerriAI/litellm_load_config_from_gcs
...
[Feat-Proxy] Load config.yaml from GCS Bucket
2024-08-30 12:08:54 -07:00
Ishaan Jaff
281b183c7c
Merge pull request #5452 from BerriAI/litellm_allow_qdrant_api_key_to_be_optional
...
[Fix-Proxy] - Allow Qdrant API Key to be optional
2024-08-30 12:07:57 -07:00
Ishaan Jaff
5056e1e400
Merge pull request #5451 from BerriAI/litellm_fix_vertex
...
[Fix-Proxy] Vertex SDK pass through - pass all relevant vertex creds
2024-08-30 11:45:16 -07:00
Ishaan Jaff
570a5a2825
fix dir structure for tts
2024-08-30 11:44:23 -07:00
Ishaan Jaff
15296b4fb7
fix allow qdrant api key to be optional
2024-08-30 11:13:23 -07:00
Ishaan Jaff
50014aa78e
vertex forward all headers from vertex
2024-08-30 11:05:23 -07:00
Ishaan Jaff
fcdfaac84b
Merge pull request #5419 from Manouchehri/gemini-1.5-pro-exp-0827-pricing
...
(models): Add gemini-1.5-pro-exp-0827 pricing.
2024-08-30 10:50:10 -07:00
Ishaan Jaff
a842723bb0
Merge pull request #5439 from BerriAI/litellm_use_correct_ai21_pricing
...
[Fix] Use correct Vertex AI AI21 Cost tracking
2024-08-30 10:49:42 -07:00
Ishaan Jaff
6109501274
update doc
2024-08-30 10:47:40 -07:00
Ishaan Jaff
c781fbcc55
doc using gcs bucket config.yaml
2024-08-30 10:44:41 -07:00
Ishaan Jaff
7d746064ab
add gcs bucket base
2024-08-30 10:41:39 -07:00
