litellm/.github
Maxx Rodriguez 1ec4b9e3ad feat(caching): add response caching support for anthropic_messages call type
Adds caching support for the anthropic_messages call type (/v1/messages endpoint),
enabling response caching for both streaming and non-streaming requests via the
existing litellm.cache infrastructure.

Changes:
- Add 'anthropic_messages' to CachingSupportedCallTypes
- Include Anthropic-specific params (system, stop_sequences, top_k) in cache key
- Add cache read/replay branch in _convert_cached_result_to_model_response
- Add streaming cache write in AgenticAnthropicStreamingIterator._persist_to_cache()
- Comprehensive test coverage (24 tests)

Fixes #25653
2026-05-11 12:00:47 -07:00
..
actions/helm-oci-chart-releaser chore: fixes 2026-04-05 01:30:57 -07:00
codeql [Infra] Improve CodeQL scanning coverage and schedule 2026-03-27 12:04:09 -07:00
ISSUE_TEMPLATE docs: document new github + gitlab ci scripts 2026-03-25 20:17:10 -07:00
observatory Add observatory test workflow for RC/stable releases 2026-03-01 15:30:09 -03:00
screenshots fix(team_endpoints): auto-add SSO team members to org on move (proxy admin only) (#26377) 2026-04-24 08:36:25 -07:00
scripts style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
workflows feat(caching): add response caching support for anthropic_messages call type 2026-05-11 12:00:47 -07:00
dependabot.yaml chore: fixes 2026-04-05 01:30:57 -07:00
deploy-to-aws.png Add files via upload 2023-10-25 16:33:53 -07:00
FUNDING.yml Update FUNDING.yml 2023-09-22 09:51:35 -07:00
pull_request_template.md docs: update pull_request_template to add Linear ticket mentioning 2026-04-27 17:31:03 -07:00
template.yaml (chore) cleanup 2024-02-09 09:28:13 -08:00