Mubashir Osmani
dc267e9032
fix: ci/cd tests + lint errors ( #14646 )
...
* fix: lint errors + tests
* fixed ci tests
* fixed tests
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-09-17 18:00:59 -07:00
Ishaan Jaffer
d8d33853d5
docs fix posthog
2025-09-17 18:00:59 -07:00
Krrish Dholakia
32c6019ecc
fix(_health_endpoints.py): protect /health/test_connection - only allow users who are allowed to create models, to call this endpoint
...
Closes LIT-989
2025-09-17 18:00:59 -07:00
Krrish Dholakia
fc18f4decf
test: add unit testing
2025-09-17 18:00:59 -07:00
Krrish Dholakia
1598d3e955
fix(bedrock_guardrails.py): respect bedrock runtime endpoint when using guardrails
...
Closes LIT-983
2025-09-17 18:00:58 -07:00
Krrish Dholakia
4276d78169
test: fix test on ci/cd
2025-09-17 18:00:58 -07:00
Krrish Dholakia
00d8dedd16
test: update test
2025-09-17 17:44:14 -07:00
Krish Dholakia
44e0c730b9
Merge pull request #14653 from ARajan1084/in-memory-guardrail-fix
...
fix: In Memory Guardrail fails to update
2025-09-17 17:42:23 -07:00
Krrish Dholakia
adc71ad2e7
fix(langsmith.py): add langsmith_sampling_rate as a dynamic param
...
Closes LIT-879
2025-09-17 17:32:26 -07:00
=
268b984cb6
added test for updating in memory guardrails
2025-09-17 17:16:49 -07:00
Mubashir Osmani
8b804303ed
fix: ci/cd tests + lint errors ( #14646 )
...
* fix: lint errors + tests
* fixed ci tests
* fixed tests
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-09-17 17:06:43 -07:00
Ishaan Jaffer
e2be7e0b1f
docs fix posthog
2025-09-17 17:02:23 -07:00
Krish Dholakia
f51003538a
Merge pull request #14650 from BerriAI/litellm_dev_09_17_2025_p1
...
Bedrock Guardrails - support setting bedrock runtime endpoint + Protect `/health/test_connect` to prevent users without model creation permissions from calling it
2025-09-17 16:55:53 -07:00
Krrish Dholakia
1954bbffc0
test: fix test on ci/cd
2025-09-17 16:53:07 -07:00
=
66202d0ab7
updates in memory custom guardrail liteLLM params
2025-09-17 16:28:05 -07:00
Krrish Dholakia
2f45c7ffd3
feat(anthropic/chat/transformation.py): account for 1h vs. 5m cache creation token cost difference
...
Closes LIT-907
2025-09-17 16:16:20 -07:00
Krrish Dholakia
e32ce6b053
feat(anthropic/chat/transformation.py): separate 5m vs. 1h cache creation token details for anthropic cost tracking
2025-09-17 15:51:07 -07:00
Krish Dholakia
895c41efa3
Merge pull request #14619 from BerriAI/litellm_dev_09_16_2025_p1
...
UI - allow team member to view service account keys they create + Anthropic - include cache creation tokens in prompt token total (separate out during cost tracking)
2025-09-17 15:43:04 -07:00
Krrish Dholakia
d96e397de5
fix(_health_endpoints.py): protect /health/test_connection - only allow users who are allowed to create models, to call this endpoint
...
Closes LIT-989
2025-09-17 15:28:35 -07:00
Krrish Dholakia
530662d735
test: add unit testing
2025-09-17 14:54:44 -07:00
Krrish Dholakia
1ada663959
fix(bedrock_guardrails.py): respect bedrock runtime endpoint when using guardrails
...
Closes LIT-983
2025-09-17 14:41:40 -07:00
Sameer Kankute
69c01488bd
remove not needed names ( #14641 )
2025-09-17 14:26:48 -07:00
Krrish Dholakia
08ba38adeb
test: update unit test
2025-09-17 14:23:13 -07:00
Fabrício Ceschin
6591550fe8
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-17 13:33:02 -04:00
Ishaan Jaff
06f3991ed0
bump aiohttp==3.12.14 ( #14638 )
2025-09-17 09:44:39 -07:00
Sameerlite
1371abf880
add last message as default in gaurdrail
2025-09-17 21:08:19 +05:30
Daniel Klein
b8b30775a4
fix: update sonnet 4 configs to reflect million-context-window pricing
2025-09-17 11:33:23 -04:00
Carlos Marchal
e168161e64
Feat/add posthog observability ( #14610 )
...
* feat: add posthog observability
* docs: add posthog logging docs
* docs: posthog integration in proxy mode
2025-09-17 08:24:04 -07:00
Fabrício Ceschin
9fdbdaf846
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-17 09:36:08 -04:00
Akiva Kraines
115a3e9ded
feat: implement middle-truncation for spend log payloads
...
- Change truncation strategy from head-only to middle-truncation (35% start, 65% end)
- Preserve both beginning and end of long strings for better debugging context
- Apply same sanitization to response payloads when store_prompts_in_spend_logs is enabled
- Increase default MAX_STRING_LENGTH_PROMPT_IN_DB from 1000 to 2048 characters
- Update tests to verify new truncation behavior with 35%-65% split
This provides better diagnostic value by keeping the more important end context
while still maintaining storage limits.
2025-09-17 16:30:25 +03:00
Krish Dholakia
a74fda1159
Merge pull request #14625 from timelfrink/fix/mdx-compilation-error-compactifai
...
Fix: MDX compilation error in CompactifAI documentation
2025-09-16 23:06:50 -07:00
Krish Dholakia
bf0dd4a284
Merge pull request #14418 from iabhi4/deep-copy-issue
...
fix: avoid deepcopy crash with non-pickleables in Gemini/Vertex
2025-09-16 22:55:31 -07:00
Tim Elfrink
79d1992de0
Fix: MDX compilation error in CompactifAI documentation
...
- Replace (<5%) with (under 5%) in two locations to fix JSX parsing
- Resolves webpack build failure in Docusaurus documentation
- Maintains same meaning while avoiding MDX syntax conflicts
Fixes #14624
2025-09-17 07:50:38 +02:00
Krish Dholakia
ef14270dec
Merge pull request #14448 from vvidovic/propagate_metadata_to_vertexai_labels_docs
...
Describing the `labels` field use in the Vertex AI
2025-09-16 22:46:28 -07:00
Krish Dholakia
2563c0ab2d
Merge pull request #14534 from hula-la/fix/response-api-bugfixes
...
fix: improve response api handling and cold storage configuration
2025-09-16 22:46:03 -07:00
Krish Dholakia
fcf84027e8
Merge pull request #14555 from mubashir1osmani/dd_spend_metric
...
DataDog shows spend metrics
2025-09-16 22:44:47 -07:00
Krish Dholakia
635dc72211
Merge pull request #14604 from Sameerlite/litellm_gemini_api_base_update
...
Litellm gemini api base update
2025-09-16 22:38:44 -07:00
Krish Dholakia
701b4fffee
Merge pull request #14600 from mubashir1osmani/fix_all_docs
...
docs: helicone integration and mcp
2025-09-16 22:37:38 -07:00
Krish Dholakia
92c82a682e
Merge pull request #14613 from ronaldpereira/patch-1
...
Fix error message for missing OCI parameters
2025-09-16 22:36:00 -07:00
Krish Dholakia
6bccdcd530
Merge pull request #14620 from BerriAI/litellm_dev_09_16_2025_p2
...
(feat) Anthropic - document pricing for cache creation tokens above 1hr
2025-09-16 22:33:11 -07:00
Krish Dholakia
cd53f25427
Merge pull request #14622 from ARajan1084/guardrail-key-configuration-fix
...
Fix: 14473: Guardrail view, edit, and delete behavior
2025-09-16 22:32:12 -07:00
Krrish Dholakia
8273630e08
test: update tests
2025-09-16 22:30:40 -07:00
Tim Elfrink
7eecba6a85
Implement AWS Bedrock CountTokens API support
...
- Add support for both Converse and InvokeModel input formats
- Implement endpoint handling in pass_through_endpoints
- Add transformation logic for AWS Bedrock CountTokens API
- Simplify model resolution using existing router patterns
- Support token counting for messages and raw text inputs
2025-09-17 07:30:31 +02:00
Mubashir Osmani
0fde408e35
added langfuse logging for responses api ( #14597 )
...
* added langfuse logging for responses api
* tests added
2025-09-16 21:43:19 -07:00
Oleksandr Tereshchenko
f507bf8881
Fix AttributeError: NoneType object has no attribute 'get' ( #14609 )
2025-09-16 21:38:01 -07:00
mubashir1osmani
439577fd35
fixed lint errors
2025-09-17 00:31:29 -04:00
mubashir1osmani
e56b11cb54
added tests
2025-09-17 00:19:03 -04:00
mubashir1osmani
fc7de7a1c5
added user_api_key_spend
2025-09-17 00:10:02 -04:00
=
626c48b783
removed problematic tooltips; used generic GuardrailSelector component
2025-09-16 19:42:53 -07:00
Krrish Dholakia
0e747aaaf1
test: fix test
2025-09-16 19:20:12 -07:00
