Otavio Brito
acf8ec5b3c
add context caching support for vertex ai
2025-10-05 20:55:18 -03:00
Javier de la Torre
df232a71f1
feat(snowflake): add function calling support for Snowflake Cortex REST API
...
Add support for function calling (tools) with Snowflake Cortex models that support it (e.g., Claude 3.5 Sonnet).
Changes:
- Add 'tools' and 'tool_choice' to supported OpenAI parameters
- Implement request transformation: OpenAI function format → Snowflake tool_spec format
- Implement response transformation: Snowflake content_list with tool_use → OpenAI tool_calls
- Add tool_choice transformation: OpenAI nested format → Snowflake array format
Request transformation:
- Transform tools from nested {"type": "function", "function": {...}} to Snowflake's {"tool_spec": {"type": "generic", "name": "...", "input_schema": {...}}}
- Transform tool_choice from {"type": "function", "function": {"name": "..."}} to {"type": "tool", "name": ["..."]}
Response transformation:
- Parse Snowflake's content_list array containing tool_use objects
- Extract tool calls with tool_use_id, name, and input
- Convert to OpenAI's tool_calls format with proper JSON serialization
Testing:
- Add 7 unit tests covering request/response transformations
- Add integration test for Responses API with tool calling
- All tests passing
Fixes issue #15218
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-05 13:08:33 +02:00
kowyo
d9851d2598
fix comment
2025-10-05 12:17:08 +08:00
kowyo
619ab42c93
fix: only use think level for gpt-oss model
2025-10-05 12:16:00 +08:00
Kowyo
765252d7db
Merge branch 'BerriAI:main' into kowyo/fix-ollama-think
2025-10-05 10:45:28 +08:00
Ishaan Jaffer
b348a26bdc
docs fix
2025-10-04 18:32:45 -07:00
Ishaan Jaffer
b2dd50dd3e
docs key rotations
2025-10-04 18:29:01 -07:00
=
5197268a58
added and ran prettier autoformatter
2025-10-04 18:19:48 -07:00
Ishaan Jaffer
e58c2c5c3e
docs fix
2025-10-04 18:13:08 -07:00
Ishaan Jaffer
163416c683
docs fix
2025-10-04 18:12:47 -07:00
Ishaan Jaffer
6cf1806d3b
docs fix
2025-10-04 18:12:20 -07:00
Ishaan Jaffer
bd2559e65e
docs fix
2025-10-04 18:11:58 -07:00
Ishaan Jaffer
525b86687c
fix 1.77.7 stable
2025-10-04 18:11:01 -07:00
Ishaan Jaffer
4e88e21266
docs fix
2025-10-04 18:04:11 -07:00
Ishaan Jaffer
93022361e6
docs fix
2025-10-04 18:03:04 -07:00
Ishaan Jaffer
d12da2e56e
docs fix
2025-10-04 18:02:04 -07:00
Alexsander Hamir
9d6c06dc7a
doc: perf update ( #15211 )
2025-10-04 17:59:08 -07:00
Ishaan Jaffer
02cb7a4c3b
docs fix
2025-10-04 17:29:06 -07:00
Yuta Saito
ba0dcfc001
feat: add Global Cross-Region Sonnet 4
2025-10-05 09:25:39 +09:00
Ishaan Jaffer
8c495590b1
doc improvement
2025-10-04 17:21:41 -07:00
Ishaan Jaffer
553801c7b4
docs
2025-10-04 17:21:00 -07:00
Yuta Saito
9a1c0145da
feat: add Global Cross-Region Inference
2025-10-05 09:20:17 +09:00
Krrish Dholakia
b7ca138a8d
docs(prometheus.md): fix
2025-10-04 16:23:54 -07:00
Krrish Dholakia
98d709d351
fix(key_management_endpoints.py): retain error check when non proxy admin is trying to update key belonging to a different user
2025-10-04 16:22:35 -07:00
Ishaan Jaffer
97e00f694c
fix azure assistants test
2025-10-04 16:18:14 -07:00
Ishaan Jaffer
a1e5c9426f
bump to migrations to 0.2.25
2025-10-04 16:16:34 -07:00
Ishaan Jaffer
e9e91a4b28
fix remove dup migration
2025-10-04 16:13:33 -07:00
Krrish Dholakia
63cb2764fe
test: fix raise
2025-10-04 16:11:22 -07:00
Krrish Dholakia
8dc53c0438
docs: document updates
2025-10-04 16:06:18 -07:00
=
1ce21d1f58
Update key_management_endpoints.py
2025-10-04 16:02:15 -07:00
Krish Dholakia
a7152f3bd8
Merge pull request #15185 from BerriAI/litellm_dev_10_03_2025_p1
...
(MCP - feat) UI - show health status of MCP servers, allow setting extra headers on the UI, allow editing allowed tools on the UI
2025-10-04 15:46:02 -07:00
Krrish Dholakia
171b6b13b2
fix(litellm_pre_call_utils.py): fix return statement
2025-10-04 15:43:56 -07:00
Krrish Dholakia
2d1000c461
test: update tests
2025-10-04 15:31:25 -07:00
Krrish Dholakia
6500a4a822
fix: fix minor issues
2025-10-04 15:30:46 -07:00
Krish Dholakia
a9037ab61f
Merge branch 'main' into litellm_dev_10_03_2025_p1
2025-10-04 15:23:31 -07:00
Krish Dholakia
85c4dd1283
Merge pull request #15154 from BerriAI/litellm_dev_10_02_2025_p2
...
fix(proxy_server.py): handle decrypting model list from db, when lite…
2025-10-04 15:23:11 -07:00
Krish Dholakia
75e3f4e10d
Merge pull request #15120 from BerriAI/litellm_dev_10_01_2025_p2
...
(feat) Support 'guaranteed_throughput' when setting limits on keys belonging to a team
2025-10-04 15:22:47 -07:00
Krrish Dholakia
691a1fa6fe
fix(key_management_endpoints.py): fix check
2025-10-04 15:22:08 -07:00
Krish Dholakia
b188f76dbe
Merge pull request #15201 from BerriAI/litellm_staging_10_04_2025_p2
...
(security) prevent user key from updating other user keys + don't return all keys with blank key alias on /v2/key/info
2025-10-04 14:58:00 -07:00
Krrish Dholakia
bb5011597c
test: fix minor test
2025-10-04 14:55:04 -07:00
Krrish Dholakia
bf641fe39b
fix(team_endpoints.py): fix getattr
2025-10-04 14:51:35 -07:00
Ishaan Jaff
cb385e080f
Fix "azure_ai/grok-4-fast-reasoning" entry in "model_prices_and_context_window.json" ( #15204 )
...
* fix: azure_ai/grok-4-fast-non-reasoning
* fix pricing
2025-10-04 14:50:44 -07:00
Krrish Dholakia
b4c4776f56
fix: fix linting errors
2025-10-04 14:47:13 -07:00
Krrish Dholakia
f9ae931872
fix(proxy/utils.py): fix linting error
2025-10-04 14:41:16 -07:00
Krrish Dholakia
814e49df06
test: update tests
2025-10-04 14:39:50 -07:00
Ishaan Jaff
ec9cdf783a
Revert "Add streamGenerateContent cost tracking in passthrough ( #15199 )" ( #15202 )
...
This reverts commit 8095de506a
2025-10-04 14:37:02 -07:00
=
6ba077593f
Update test_key_generate_prisma.py
2025-10-04 14:36:19 -07:00
=
5e03ef7382
fixes bloated key alias network calls with lean endpoint
2025-10-04 14:32:15 -07:00
Krrish Dholakia
f500a866dd
fix: fix ui linting errors
2025-10-04 14:31:51 -07:00
Krrish Dholakia
056e6e9d43
fix(key_management_endpoints.py): fix security issue where user could update another user's key metadata
2025-10-04 14:25:06 -07:00
