Murilo Pires a0018c9d04 feat: add prompt caching support for LiteLLM (#5791) (#6074) ... * feat: add prompt caching support for LiteLLM (#5791) - Add litellmUsePromptCache configuration option to provider settings - Implement cache control headers in LiteLLM handler when enabled - Add UI checkbox for enabling prompt caching (only shown for supported models) - Track cache read/write tokens in usage data - Add comprehensive test for prompt caching functionality - Reuse existing translation keys for consistency across languages This allows LiteLLM users to benefit from prompt caching with supported models like Claude 3.7, reducing costs and improving response times. * fix: improve LiteLLM prompt caching to work for multi-turn conversations - Convert system message to structured format with cache_control - Handle both string and array content types for user messages - Apply cache_control to content items, not just message level - Update tests to match new message structure This ensures prompt caching works correctly for all messages in a conversation, not just the initial system prompt and first user message. * fix: resolve TypeScript linter error for cache_control property Use type assertion to handle cache_control property that's not in OpenAI types		2025-07-28 12:56:06 -07:00
..
providers	feat: add prompt caching support for LiteLLM (#5791) (#6074)	2025-07-28 12:56:06 -07:00
transform	Update the max-token calculation in model-params to use the shared logic (#5720)	2025-07-15 02:20:22 -04:00
index.ts	basic hugging face provider (#6134)	2025-07-23 15:19:23 -04:00