mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-06 02:48:13 +00:00
556e8f89c8
Several CI jobs run the proxy against a model whose api_base is a shared "fake OpenAI endpoint" hosted on Railway (exampleopenaiendpoint-production.up.railway.app) so the E2E runs return canned responses without paying for or depending on a live provider. When that single deployment is down, every one of those jobs fails with "404 Application not found" even though nothing in the PR is broken; the whole repo is coupled to the uptime of one free external service. This adds tests/_fake_openai_endpoint_server.py, a small canned-response OpenAI-shaped server (chat, text, embeddings, streaming with usage, and the "429" rate-limit special case), and a reusable start_fake_openai_endpoint CircleCI command that runs it on host port 8190 and waits until healthy. The affected jobs now inject FAKE_OPENAI_API_BASE pointing at the local server, and the example configs they mount resolve api_base from that env var. The intentionally bad fallback URL in proxy_server_config.yaml is left untouched so the fallback test still exercises a failing upstream. Wired into build_and_test, litellm_router_testing, db_migration_disable_update_check, proxy_logging_guardrails_model_info_tests, proxy_spend_accuracy_tests, proxy_multi_instance_tests, proxy_store_model_in_db_tests, and proxy_build_from_pip_tests. |
||
|---|---|---|
| .. | ||
| _health_check_test_config.yaml | ||
| adaptive_router_example.yaml | ||
| aliases_config.yaml | ||
| azure_config.yaml | ||
| bad_schema.prisma | ||
| custom_auth.py | ||
| custom_auth_basic.py | ||
| custom_callbacks.py | ||
| custom_callbacks1.py | ||
| custom_guardrail.py | ||
| custom_handler.py | ||
| disable_schema_update.yaml | ||
| enterprise_config.yaml | ||
| langfuse_config.yaml | ||
| load_balancer.yaml | ||
| multi_instance_simple_config.yaml | ||
| oai_misc_config.yaml | ||
| opentelemetry_config.yaml | ||
| otel_test_config.yaml | ||
| pass_through_config.yaml | ||
| pipeline_test_guardrails.py | ||
| reject_clientside_metadata_tags_config.yaml | ||
| simple_config.yaml | ||
| spend_tracking_config.yaml | ||
| store_model_db_config.yaml | ||
| test_pipeline_config.yaml | ||
| tool_permission_example.yaml | ||
| websearch_interception_config.yaml | ||