litellm/proxy_server_config.yaml
Sameer Kankute 9196e3aa90
refactor(anthropic/context_management): streaming iterator compaction fixes and compact polyfill improvements
- Extract usage-merge helper; guard empty slice-only compaction result
- Silently drop trailing chunks after usage; remove dead _polyfill_result key
- Fix bedrock None context_mgmt; stream per-instance queue; sync polyfill; trailing-chunk passthrough
- Apply context_management on sync path; clear held stop_reason chunk in async iterator
- Fix post-compaction question selection, system type, sync stream merge
- Skip tool_result-only user turns; bedrock: elif for context_management
- Add streaming iterator compaction test suite

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-27 17:25:10 +05:30

19 lines
No EOL
597 B
YAML

model_list:
- model_name: claude-sonnet-4-6
litellm_params:
model: bedrock/converse/global.anthropic.claude-sonnet-4-6
# aws_region_name: "global"
- model_name: claude-sonnet-4-5
litellm_params:
model: bedrock/converse/global.anthropic.claude-sonnet-4-5-20250929-v1:0
# aws_region_name: "global"
- model_name: gpt-5.4-mini
litellm_params:
model: openai/gpt-5.4-mini
api_key: os.environ/OPENAI_API_KEY
general_settings:
context_management_summary_model: gpt-5.4-mini
litellm_settings:
use_chat_completions_url_for_anthropic_messages: true