Jay Alammar
21c6b2993e
Clean formatting
2024-09-06 17:54:23 -04:00
Jay Alammar
6d9f6a1b76
Update pricing and add cohere refresh models
2024-09-06 17:35:59 -04:00
Krish Dholakia
f584021f7c
LiteLLM Minor Fixes and Improvements ( #5537 )
...
* fix(vertex_ai): Fixes issue where multimodal message without text was failing vertex calls
Fixes https://github.com/BerriAI/litellm/issues/5515
* fix(azure.py): move to using httphandler for oidc token calls
Fixes issue where ssl certificates weren't being picked up as expected
Closes https://github.com/BerriAI/litellm/issues/5522
* feat: Allows admin to set a default_max_internal_user_budget in config, and allow setting more specific values as env vars
* fix(proxy_server.py): fix read for max_internal_user_budget
* build(model_prices_and_context_window.json): add regional gpt-4o-2024-08-06 pricing
Closes https://github.com/BerriAI/litellm/issues/5540
* test: skip re-test
2024-09-05 18:03:34 -07:00
David Manouchehri
0268877f28
Add azure/gpt-4o-2024-08-06 pricing. ( #5510 )
2024-09-04 09:40:18 -07:00
Krrish Dholakia
2797b30a50
build(model_prices_and_context_window.json): fix token information
2024-09-02 13:14:11 -07:00
Kyrylo Yefimenko
1a0d8e7260
Add pricing for ft:gpt-3.5-turbo-* ( #5471 )
2024-09-02 13:12:57 -07:00
Ishaan Jaff
4bd85b9d83
add cerebras cost tracking
2024-08-31 16:29:26 -07:00
Krish Dholakia
47ef1f9191
anthropic prompt caching cost tracking ( #5453 )
...
* fix(utils.py): support 'drop_params' for embedding requests
Fixes https://github.com/BerriAI/litellm/issues/5444
* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic
* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out
* fix: fix linting errors
* test: mark flaky test
2024-08-31 14:50:12 -07:00
Ishaan Jaff
fcdfaac84b
Merge pull request #5419 from Manouchehri/gemini-1.5-pro-exp-0827-pricing
...
(models): Add gemini-1.5-pro-exp-0827 pricing.
2024-08-30 10:50:10 -07:00
Kyrylo Yefimenko
a100b01b90
Add pricing for Openai ft:gpt-4o
2024-08-30 08:16:24 +01:00
Ishaan Jaff
26c03c9c8b
add pricing for vertex ai 21
2024-08-29 19:03:38 -07:00
David Manouchehri
19db80ffeb
(bedrock): Add new cross-region inference support for Bedrock.
2024-08-29 17:49:16 +00:00
Krish Dholakia
a857f4a8ee
Merge branch 'main' into litellm_main_staging
2024-08-28 18:05:27 -07:00
David Manouchehri
824a8b557b
(models): Add gemini-1.5-pro-exp-0827 pricing.
2024-08-28 22:04:34 +00:00
Krrish Dholakia
17646b50ec
build(model_prices_and_context_window.json): bedrock/llama3 models - region-based pricing
2024-08-28 13:07:56 -07:00
Krrish Dholakia
023d0f7664
build(model_prices_and_context_window.json): fix bedrock/llama3-1 pricing
2024-08-28 12:54:24 -07:00
Karl Leswing
ec57490585
Also have pricing details
2024-08-28 14:43:35 -04:00
Karl Leswing
b5ce54c202
Support for gemini experimental models
2024-08-28 14:33:18 -04:00
Krrish Dholakia
76c38c6d4b
build(model_prices_and_context_window.json): add bedrock mistral small
2024-08-28 10:12:16 -07:00
Ishaan Jaff
3dee98dc47
add jamba-1.5
2024-08-27 14:20:06 -07:00
Ishaan Jaff
e9808346a7
add jamba-1.5-mini models
2024-08-27 14:02:02 -07:00
John HU
9a18106745
Add pricing for imagen-3 and imagen-3-fast
2024-08-26 14:41:47 -07:00
Krish Dholakia
b2e182a42c
Merge pull request #5314 from thiswillbeyourgithub/fix_missing_openrouter_claude_sonnet_beta
...
fix/docs: was missing a beta model from openrouter of claude sonnet
2024-08-21 08:31:21 -07:00
Paul Gauthier
2432cbc912
openrouter/anthropic/claude-3.5-sonnet: supports_assistant_prefill:true
2024-08-21 05:55:10 -07:00
thiswillbeyourgithub
00f7238c64
fix: was missing openrouter beta model from claude sonnet
2024-08-21 14:45:09 +02:00
Krish Dholakia
5731287f1b
Merge pull request #5221 from kiriloman/adjust-pricing-file
...
[PRICING] Use specific llama2 and llama3 model names in Ollama
2024-08-17 14:03:20 -07:00
Kyrylo Yefimenko
e3cd8e169b
Use sepecific llama2 and llama3 model names in Ollama
2024-08-15 12:27:51 +01:00
Krrish Dholakia
1faa931f26
build(model_prices_and_context_window.json): add 'supports_assistant_prefill' to all vertex ai anthropic models
2024-08-14 14:08:12 -07:00
Krish Dholakia
4c6b14c301
Merge pull request #5203 from paul-gauthier/main
...
vertex_ai/claude-3-5-sonnet@20240620 support prefill
2024-08-14 14:06:20 -07:00
Aaron Bach
9d42dfb417
Update prices/context windows for Perplexity Llama 3.1 models
2024-08-14 13:20:22 -06:00
Paul Gauthier
6a32b05bb1
vertex_ai/claude-3-5-sonnet@20240620 support prefill
2024-08-14 10:14:19 -07:00
David Manouchehri
9617e578f3
(models): Add chatgpt-4o-latest.
2024-08-14 03:03:22 +00:00
Krrish Dholakia
19bb95f781
build(model_prices_and_context_window.json): add 'supports_assistant_prefill' to model info map
...
Closes https://github.com/BerriAI/litellm/issues/4881
2024-08-10 14:15:12 -07:00
Ishaan Jaff
c8997e3986
add cohere embed-multilingual-v2.0
2024-08-09 11:30:07 -07:00
Krrish Dholakia
5d664c0441
build(model_prices_and_context_window.json): Fixes https://github.com/BerriAI/litellm/issues/5113
2024-08-08 09:11:59 -07:00
Sam
8459046585
Add deepseek-coder-v2(-lite), mistral-large, codegeex4 to ollama
2024-08-08 10:51:59 +12:00
Ishaan Jaff
5743640250
feat add ft:gpt-4o-mini-2024-07-18
2024-08-07 07:46:23 -07:00
Krrish Dholakia
bc8857ca23
build(model_prices_and_context_window.json): remove duplicate entries
2024-08-06 22:50:41 -07:00
Krish Dholakia
c82fc0cac2
Merge branch 'main' into litellm_support_lakera_config_thresholds
2024-08-06 22:47:13 -07:00
Ishaan Jaff
51ffbbb3fa
fix pricing
2024-08-06 11:39:20 -07:00
Ishaan Jaff
79100e44fd
add gpt-4o-2024-08-06
2024-08-06 11:37:43 -07:00
Krrish Dholakia
e0c986c000
build(model_prices_and_context_window.json): update gpt-4o-mini max_output_tokens
...
Fixes https://github.com/BerriAI/litellm/issues/5045
2024-08-05 09:30:18 -07:00
Ishaan Jaff
e3119cef38
add sample spec to model cost map
2024-08-05 09:27:26 -07:00
Krrish Dholakia
57644be857
build(model_prices_and_context_window.json): add deepseek cache hit pricing
2024-08-03 08:56:25 -07:00
Ishaan Jaff
fc3463e178
fix model prices formatting
2024-08-01 17:28:31 -07:00
Krish Dholakia
caf11ce7da
Merge pull request #5002 from Manouchehri/gemini-1.5-pro-exp-0801-gemini-1
...
Add new model for gemini-1.5-pro-exp-0801.
2024-08-01 17:27:49 -07:00
Ishaan Jaff
a52ffb9365
add correct context window
2024-08-01 16:50:11 -07:00
Ishaan Jaff
be7e6b1c53
add new dbrx models
2024-08-01 16:46:41 -07:00
Krrish Dholakia
246b3227a9
fix(vertex_ai_partner.py): add /chat/completion codestral support
...
Closes https://github.com/BerriAI/litellm/issues/4984
2024-08-01 16:12:05 -07:00
David Manouchehri
e6f18fdc62
Add new model for gemini-1.5-pro-exp-0801.
2024-08-01 22:20:19 +00:00
