mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-04 02:31:27 +00:00
971037577c
Add prepend_system_prompt helper to merge system parameter into messages for cache key computation. Update async_filter_deployments to prepend system prompt before computing affinity and pass tools to async_get_model_id. Update async_log_success_event to prepend system prompt and pass tools to async_add_model_id. Add test coverage for system parameter in cache affinity.
38 lines
437 B
JSON
38 lines
437 B
JSON
{
|
|
"LIT001": {
|
|
"limit": 22174
|
|
},
|
|
"LIT002": {
|
|
"limit": 26715
|
|
},
|
|
"LIT003": {
|
|
"limit": 261
|
|
},
|
|
"LIT004": {
|
|
"limit": 38
|
|
},
|
|
"LIT005": {
|
|
"limit": 0
|
|
},
|
|
"LIT006": {
|
|
"limit": 1035
|
|
},
|
|
"LIT007": {
|
|
"limit": 0
|
|
},
|
|
"LIT008": {
|
|
"limit": 945
|
|
},
|
|
"LIT009": {
|
|
"limit": 0
|
|
},
|
|
"LIT010": {
|
|
"limit": 16394
|
|
},
|
|
"LIT011": {
|
|
"limit": 5504
|
|
},
|
|
"LIT012": {
|
|
"limit": 4486
|
|
}
|
|
}
|