scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-13 23:11:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 152
36177 commits 2338 branches 1407 tags 2.6 GiB
Commit graph

36177 commits

This branch
This branch
All branches
Author SHA1 Message Date
Ryan Crabbe
e0ddb2a525 fix: guard print_aggregate against empty latencies 2026-02-23 10:06:10 -08:00
Kesku
058852ac5b lint 2026-02-23 18:05:13 +00:00
Kesku
e468d108a6 format 2026-02-23 18:05:07 +00:00
Kesku
5899e909fd feat(perplexity): update Responses API integration to match Agent API 
- Rename "Agentic Research API" to "Agent API"
Expand
- supported Responses API parameters
- Fix function
tool handling to pass custom function tools through unchanged instead of heuristically mapping them.
 -Update model registry with current Perplexity
models and presets
- Add Function Calling and Structured Outputs documentation sections.
- Unit tests for transformation logic.
 2026-02-23 18:05:03 +00:00
Ryan Crabbe
fb123ec52b refactor: use method-level import for MockOpenAITransport 2026-02-23 09:58:46 -08:00
Ryan Crabbe
95d9514054 fix: add auth headers and empty latencies guard to benchmark script 2026-02-23 09:58:40 -08:00
yuneng-jiang
bba98c2f15
Merge pull request #21886 from Chesars/docs/ui-contributing-pre-pr-checklist 
docs(ui): add pre-PR checklist to UI contributing guide
 2026-02-23 09:50:26 -08:00
Ryan Crabbe
8244ad1f0e docs: tweak benchmarks wording 2026-02-23 09:50:02 -08:00
Ryan Crabbe
5b41b009f6 docs: add network mock benchmarking section 2026-02-23 09:44:02 -08:00
Cesar Garcia
64d1de0552
docs: add Google GenAI SDK tutorial (JS & Python) (#21885) 
* docs: add Google GenAI SDK tutorial for JS and Python

Add tutorial for using Google's official GenAI SDK (@google/genai for JS,
google-genai for Python) with LiteLLM proxy. Covers pass-through and
native router endpoints, streaming, multi-turn chat, and multi-provider
routing via model_group_alias. Also updates pass-through docs to use the
new SDK replacing the deprecated @google/generative-ai.

* fix(docs): correct Python SDK env var name in GenAI tutorial

GOOGLE_GENAI_API_KEY does not exist in the google-genai SDK.
The correct env var is GEMINI_API_KEY (or GOOGLE_API_KEY).
Also note that the Python SDK has no base URL env var.

* fix(docs): replace non-existent GOOGLE_GENAI_BASE_URL env var in interactions.md

The Python google-genai SDK does not read GOOGLE_GENAI_BASE_URL.
Use http_options={"base_url": "..."} in code instead.
 2026-02-23 09:20:46 -08:00
Ryan Crabbe
d99d87f614 clean up mock transport: remove streaming, add defensive parsing 2026-02-23 09:16:47 -08:00
Julio Quinteros Pro
17d97f26f6
Merge pull request #21939 from jquinter/fix/model-prices-test-relative-path 
fix(tests): use absolute path for model_prices JSON validation test
 2026-02-23 14:10:47 -03:00
Henrique Cavarsan
7ae157198b
fix(proxy): recover from prisma-query-engine zombie process (#21899) 
* fix(proxy): recover from prisma-query-engine zombie process

* fix(proxy): remove unused imports and extract helper to fix PLR0915 in utils.py
 2026-02-23 08:57:01 -08:00
Julio Quinteros Pro
bf8c219860 fix(tests): use os.path instead of Path to avoid NameError 
Path is not imported at module level. Use os.path.join which is already
available.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-23 13:56:11 -03:00
Julio Quinteros Pro
a74b6eee23 Update tests/test_litellm/test_utils.py 
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
 2026-02-23 13:55:49 -03:00
Julio Quinteros Pro
11a774e110 fix(tests): use absolute path for model_prices JSON in validation test 
The test used a relative path 'litellm/model_prices_and_context_window.json'
which only works when pytest runs from a specific working directory.
Use os.path based on __file__ to resolve the path reliably.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-23 13:55:49 -03:00
Julio Quinteros Pro
ac6f2f3c52
Merge pull request #21938 from jquinter/fix/flaky-prisma-self-heal-test 
fix(tests): fix StopIteration in prisma self-heal cooldown test
 2026-02-23 13:29:03 -03:00
Julio Quinteros Pro
fb8b11cc0a fix(tests): use counter-based mock for time.time in prisma self-heal test 
The test used a fixed side_effect list for time.time(), but the number
of calls varies by Python version, causing StopIteration on 3.12 and
AssertionError on 3.14. Replace with an infinite counter-based callable
and assert the timestamp was updated rather than checking for an exact
value.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-23 13:25:02 -03:00
Harshit Jain
c6f60bed71
perf(spendlogs): optimize old spendlog deletion cron job 2026-02-23 19:44:30 +05:30
Krrish Dholakia
a26f83fd3c fix: update calendly on repo 2026-02-23 06:13:59 -08:00
Sameer Kankute
f97ee62fb0
Merge pull request #21909 from BerriAI/litellm_cost_tracking_gemini 
Add  Priority PayGo cost tracking gemini/vertex ai
 2026-02-23 18:58:57 +05:30
Sameer Kankute
61e63b6553
Merge pull request #21904 from BerriAI/litellm_fix_model_cost_map 
fix model cost map for anthropic fast and inference_geo
 2026-02-23 18:57:15 +05:30
Sameer Kankute
2f8d36be1b Fix test_aaamodel_prices_and_context_window_json_is_valid 2026-02-23 18:56:12 +05:30
Sameer Kankute
9b5bbee906
Merge pull request #21786 from BerriAI/litellm_oss_staging_02_21_2026 
Litellm oss staging 02 21 2026
 2026-02-23 18:51:55 +05:30
Sameer Kankute
8decf04d8a
Merge pull request #21877 from BerriAI/litellm_oss_staging_02_22_2026 
Litellm oss staging 02 22 2026
 2026-02-23 18:50:47 +05:30
Sameer Kankute
f6f46ae5ae Fix mypy issues 2026-02-23 18:46:25 +05:30
Sameer Kankute
37d45139f2
Merge pull request #21917 from BerriAI/litellm_fix_model_cost_map_wildcard 
Fix: Anthropic model wildcard access issue
 2026-02-23 18:45:49 +05:30
Sameer Kankute
16b25bd457
Merge pull request #21921 from Point72/ephrimstanley/batch-fixes-feb23 
State management fixes for CheckBatchCost
 2026-02-23 18:44:05 +05:30
Sameer Kankute
351921d5db Fix mypy issues 2026-02-23 18:41:28 +05:30
Sameer Kankute
a3c01b7259 Fix code qa issues 2026-02-23 18:39:46 +05:30
Sameer Kankute
4934d89cc7
Merge pull request #21872 from BerriAI/litellm_dev_02_21_2026_p4 
Litellm dev 02 19 2026 p2 (#21871)
 2026-02-23 18:35:57 +05:30
TomAlon
99184c48d9
Add Noma guardrails v2 based on custom guardrails (#21400) 2026-02-23 05:05:27 -08:00
Sameer Kankute
88cd0d31ed fix mypy issues: 2026-02-23 18:28:42 +05:30
Ephrim Stanley
27a33565e7 State management fixes for CheckBatchCost - Address greptile comments 2026-02-23 07:52:58 -05:00
Sameer Kankute
c7aafdf794
Merge pull request #21926 from BerriAI/main 
merge main in oss 21 02
 2026-02-23 18:17:30 +05:30
Sameer Kankute
57af8e6a93
Merge pull request #21924 from BerriAI/main 
merge main in oss 22 02
 2026-02-23 18:11:36 +05:30
Sameer Kankute
f23e549cce Fix PR review comments 2026-02-23 18:04:32 +05:30
Ephrim Stanley
7b5dc3fb9c State management fixes for CheckBatchCost 2026-02-23 07:16:25 -05:00
Harshit Jain
4c487acdf0
Merge pull request #21918 from Harshit28j/litellm_arrival_time_fix 
fix: ensure arrival_time is set before calculating queue time
 2026-02-23 17:41:05 +05:30
Sameer Kankute
164cde9bf6 Readd tpm limit 2026-02-23 17:23:12 +05:30
Sameer Kankute
eaf3900200 Fix name of title 2026-02-23 17:18:31 +05:30
Sameer Kankute
262235f266 Add ability to see which model cost map is getting used 2026-02-23 17:15:06 +05:30
Sameer Kankute
9b27cd8c0e Add incident report 2026-02-23 17:13:44 +05:30
Sameer Kankute
4ff1651699 Fix: Anthropic model wildcard access issue 2026-02-23 17:12:55 +05:30
Harshit Jain
9fc3c77c42
fix: ensure arrival_time is set before calculating queue time 2026-02-23 17:04:47 +05:30
Sameer Kankute
3561bfb96c
Merge pull request #21640 from ta-stripe/feat/regional-sts-endpoint-for-auth_with_role_name 
feat(bedrock): support optional regional STS endpoint in role assumption
 2026-02-23 13:28:54 +05:30
Sameer Kankute
55ee8cdd56
Merge pull request #21701 from ta-stripe/fix/bedrock-openai-imported-model-name-encoding 
fix(bedrock): encode model arns for OpenAI compatible bedrock imported models
 2026-02-23 13:25:02 +05:30
Sameer Kankute
4d8f5097fb Add model pricing 2026-02-23 13:16:27 +05:30
Sameer Kankute
20023bdcfb Add support for Priority PayGo for vertex ai and gemini 2026-02-23 13:15:47 +05:30
Sameer Kankute
f54fb9aeb1 Add tests for fast and us 2026-02-23 11:25:47 +05:30