scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-03 02:22:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 81
litellm/litellm
History
Julio Quinteros Pro 75d9f4d84f fix: use atomic increment-first pattern for model RPM rate limiting 
Replace racy check-then-increment RPM logic with atomic increment-first
pattern to prevent concurrent requests from bypassing the rate limit.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-23 19:11:52 -03:00
..
a2a_protocol fix: prompt registry 2026-02-18 00:34:54 +05:30
anthropic_interface fix: prompt registry 2026-02-18 00:34:54 +05:30
assistants Contributor PR - Support OPENAI_BASE_URL in addition to OPENAI_API_BASE (#9995) (#10423) 2025-04-29 21:27:37 -07:00
batch_completion fix: prompt registry 2026-02-18 00:34:54 +05:30
batches fix: prompt registry 2026-02-18 00:34:54 +05:30
caching Merge pull request #21926 from BerriAI/main 2026-02-23 18:17:30 +05:30
completion_extras fix code quality tests and mypy 2026-02-18 17:36:36 +05:30
containers fix: prompt registry 2026-02-18 00:34:54 +05:30
endpoints/speech/speech_to_completion_bridge fix: fix import errors 2025-09-14 09:32:21 -07:00
evals fix: prompt registry 2026-02-18 00:34:54 +05:30
experimental_mcp_client fix: prompt registry 2026-02-18 00:34:54 +05:30
files fix: prompt registry 2026-02-18 00:34:54 +05:30
fine_tuning Litellm managed file updates combined (#11040) 2025-05-22 17:20:41 -07:00
google_genai fix: prompt registry 2026-02-18 00:34:54 +05:30
images Add None as default image value 2026-01-19 09:08:38 +05:30
integrations Merge pull request #21786 from BerriAI/litellm_oss_staging_02_21_2026 2026-02-23 18:51:55 +05:30
interactions fix: prompt registry 2026-02-18 00:34:54 +05:30
litellm_core_utils Merge pull request #21909 from BerriAI/litellm_cost_tracking_gemini 2026-02-23 18:58:57 +05:30
llms Merge pull request #21942 from BerriAI/litellm_network_mock 2026-02-23 10:07:11 -08:00
ocr [Feat] /ocr - Add VertexAI OCR provider support + cost tracking (#16216) 2025-11-03 15:56:49 -08:00
passthrough fix(types): fix mypy errors in pass-through endpoint query param types 2026-02-19 12:24:14 -03:00
proxy feat: Singapore guardrail policies (PDPA + MAS AI Risk Management) (#21948) 2026-02-23 12:08:22 -08:00
proxy_auth fix: prompt registry 2026-02-18 00:34:54 +05:30
rag fix: prompt registry 2026-02-18 00:34:54 +05:30
realtime_api fix: prompt registry 2026-02-18 00:34:54 +05:30
rerank_api fix: prompt registry 2026-02-18 00:34:54 +05:30
responses fix(responses): eliminate per-chunk thread spawning in async streaming path (#21709) 2026-02-20 16:26:23 -08:00
router_strategy fix(lint): fix ruff/flake8 violations - unused imports, PLR0915, print statements (#21846) 2026-02-21 15:07:47 -08:00
router_utils fix: use atomic increment-first pattern for model RPM rate limiting 2026-02-23 19:11:52 -03:00
search [Bug Fix] Exa Search API - ensure request params are sent to Exa AI (#15855) 2025-10-23 11:56:30 -07:00
secret_managers fix: prompt registry 2026-02-18 00:34:54 +05:30
skills fix: prompt registry 2026-02-18 00:34:54 +05:30
types fix: add INCOMPLETE status to Interactions API enum and test 2026-02-23 15:07:41 -03:00
vector_store_files Vector store files Stable Release (#16643) 2025-11-15 13:00:33 -08:00
vector_stores Fix vector store configuration synchronization failure 2025-12-05 11:46:14 +05:30
videos fix: respect videos content db creds 2025-12-10 23:00:01 +05:30
__init__.py Merge pull request #21942 from BerriAI/litellm_network_mock 2026-02-23 10:07:11 -08:00
_lazy_imports.py fix: prompt registry 2026-02-18 00:34:54 +05:30
_lazy_imports_registry.py Merge branch 'main' into litellm_oss_staging_02_17_2026 2026-02-18 17:26:33 +05:30
_logging.py fix: prompt registry 2026-02-18 00:34:54 +05:30
_redis.py fix: close leaked Redis connection pools on cache eviction and disconnect 2026-02-20 17:09:32 -08:00
_service_logger.py fix: prompt registry 2026-02-18 00:34:54 +05:30
_uuid.py Fix: revert fastuuid optional dependency, always use fastuuid in .__uid helper (#14941) 2025-09-26 09:14:20 -07:00
_version.py Virtual key based policies in Aim Guardrails (#9499) 2025-04-01 21:57:23 -07:00
anthropic_beta_headers_config.json fix: enable context-1m-2025-08-07 beta header for vertex_ai provider (#21867) 2026-02-21 20:12:23 -08:00
anthropic_beta_headers_manager.py fix: prompt registry 2026-02-18 00:34:54 +05:30
budget_manager.py Squashed commit of the following: (#9709) 2025-04-02 21:24:54 -07:00
constants.py [Fix] Replace deprecated claude-3-7-sonnet in test_anthropic_completion, add store to OPENAI_CHAT_COMPLETION_PARAMS 2026-02-20 17:26:19 -08:00
cost.json
cost_calculator.py Add support for Priority PayGo for vertex ai and gemini 2026-02-23 13:15:47 +05:30
exceptions.py fix: prompt registry 2026-02-18 00:34:54 +05:30
main.py Merge pull request #21926 from BerriAI/main 2026-02-23 18:17:30 +05:30
model_prices_and_context_window_backup.json Merge pull request #21909 from BerriAI/litellm_cost_tracking_gemini 2026-02-23 18:58:57 +05:30
mypy.ini fix mypy 2025-09-27 12:21:32 -07:00
policy_templates_backup.json feat: Singapore guardrail policies (PDPA + MAS AI Risk Management) (#21948) 2026-02-23 12:08:22 -08:00
py.typed
router.py Agent Builder - support new experimental agent builder, to ensure agents pass compliance checks (#21817) 2026-02-21 15:32:47 -08:00
scheduler.py fix: prompt registry 2026-02-18 00:34:54 +05:30
timeout.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
utils.py Merge pull request #21904 from BerriAI/litellm_fix_model_cost_map 2026-02-23 18:57:15 +05:30