mirror of
https://github.com/BerriAI/litellm.git
synced 2026-08-28 05:25:59 +00:00
8e61b32b8e
* feat(xai): add grok-4.20 beta 2 models with pricing (#23900)
Add three grok-4.20 beta 2 model variants from xAI:
- grok-4.20-multi-agent-beta-0309 (reasoning + multi-agent)
- grok-4.20-beta-0309-reasoning (reasoning)
- grok-4.20-beta-0309-non-reasoning
Pricing (from https://docs.x.ai/docs/models):
- Input: $2.00/1M tokens ($0.20/1M cached)
- Output: $6.00/1M tokens
- Context: 2M tokens
All variants support vision, function calling, tool choice, and web search.
Closes LIT-2171
* docs: add Quick Install section for litellm --setup wizard (#23905)
* docs: add Quick Install section for litellm --setup wizard
* docs: clarify setup wizard is for local/beginner use
* feat(setup): interactive setup wizard + install.sh (#23644)
* feat(setup): add interactive setup wizard + install.sh
Adds `litellm --setup` — a Claude Code-style TUI onboarding wizard that
guides users through provider selection, API key entry, and proxy config
generation, then optionally starts the proxy immediately.
- litellm/setup_wizard.py: wizard with ASCII art, numbered provider menu
(OpenAI, Anthropic, Azure, Gemini, Bedrock, Ollama), API key prompts,
port/master-key config, and litellm_config.yaml generation
- litellm/proxy/proxy_cli.py: adds --setup flag that invokes the wizard
- scripts/install.sh: curl-installable script (detect OS/Python, pip
install litellm[proxy], launch wizard)
Usage:
curl -fsSL https://raw.githubusercontent.com/BerriAI/litellm/main/scripts/install.sh | sh
litellm --setup
* fix(install.sh): remove orange color, add LITELLM_BRANCH env var for branch installs
* fix(install.sh): install from git branch so --setup is available for QA
* fix(install.sh): remove stale LITELLM_BRANCH reference that caused unbound variable error
* fix(install.sh): force-reinstall from git to bypass cached PyPI version
* fix(install.sh): show pip progress bar during install
* fix(install.sh): always launch wizard via $PYTHON_BIN -m litellm, not PATH binary
* fix(install.sh): use litellm.proxy.proxy_cli module (no __main__.py exists)
* fix(install.sh): suppress RuntimeWarning from module invocation
* fix(install.sh): use Python bin-dir litellm binary to avoid CWD sys.path shadowing
* fix(install.sh): use sysconfig.get_path('scripts') to find pip-installed litellm binary
* fix(install.sh): redirect stdin from /dev/tty on exec so wizard gets terminal, not exhausted pipe
* fix(install.sh): warn about git clone duration, drop --no-cache-dir so re-runs are faster
* feat(setup_wizard): arrow-key selector, updated model names
* fix(setup_wizard): use sysconfig binary to start proxy, not python -m litellm
* feat(setup_wizard): credential validation after key entry + clear next-steps after proxy start
* style(install.sh): show git clone warning in blue
* refactor(setup_wizard): class with static methods, use check_valid_key from litellm.utils
* address greptile review: fix yaml escaping, port validation, display name collisions, tests
- setup_wizard.py: add _yaml_escape() for safe YAML embedding of API keys
- setup_wizard.py: add _styled_input() with readline ANSI ignore markers
- setup_wizard.py: change DIVIDER to _divider() fn to avoid import-time color capture
- setup_wizard.py: validate port range 1-65535, initialize before loop
- setup_wizard.py: qualify azure display names (azure-gpt-4o) to avoid collision with openai
- setup_wizard.py: work on env_copy in _build_config to avoid mutating caller's dict
- setup_wizard.py: skip model_list entries for providers with no credentials
- setup_wizard.py: prompt for azure deployment name
- setup_wizard.py: wrap os.execlp in try/except with friendly fallback
- setup_wizard.py: wrap config write in try/except OSError
- setup_wizard.py: fix _validate_and_report to use two print lines (no \r overwrite)
- setup_wizard.py: add .gitignore tip next to key storage notice
- setup_wizard.py: fix run_setup_wizard() return type annotation to None
- scripts/install.sh: drop pipefail (not supported by dash on Ubuntu when invoked as sh)
- scripts/install.sh: use litellm[proxy] from PyPI (not hardcoded dev branch)
- scripts/install.sh: guard /dev/tty read with -r check for Docker/CI compat
- scripts/install.sh: remove --force-reinstall to avoid downgrading dependencies
- tests/test_litellm/test_setup_wizard.py: 13 unit tests for _build_config and _yaml_escape
* style: black format setup_wizard.py
* fix: address remaining greptile issues - Windows compat, YAML quoting, credential flow
- guard termios/tty imports with try/except ImportError for Windows compat
- quote master_key as YAML double-quoted scalar (same as env vars)
- remove unused port param from _build_config signature
- _validate_and_report now returns the final key so re-entered creds are stored
- add test for master_key YAML quoting
* fix: add --port to suggested command, guard /dev/tty exec in install.sh
* fix: quote api_base in YAML, skip azure if no deployment, only redraw on state change
* fix: address greptile review comments
- _yaml_escape: add control character escaping (\n, \r, \t)
- test: fix tautological assertion in test_build_config_azure_no_deployment_skipped
- test: add tests for control character escaping in _yaml_escape
* feat(ui): remove Chat UI page link and banner from sidebar and playground (#23908)
* feat(guardrails): MCPJWTSigner - built-in guardrail for zero trust MCP auth (#23897)
* Allow pre_mcp_call guardrail hooks to mutate outbound MCP headers
* Enhance MCPServerManager to support hook-modified arguments and extra headers. Update tests to validate argument mutation and header injection behavior, including warnings for OpenAPI-backed servers when headers are present.
* Refactor MCPServerManager to raise HTTPException for extra headers in OpenAPI-backed servers. Update tests to reflect this change, ensuring proper exception handling instead of logging warnings.
* Allow pre_mcp_call guardrail hooks to mutate outbound MCP headers
* Enhance MCPServerManager to support hook-modified arguments and extra headers. Update tests to validate argument mutation and header injection behavior, including warnings for OpenAPI-backed servers when headers are present.
* Refactor MCPServerManager to raise HTTPException for extra headers in OpenAPI-backed servers. Update tests to reflect this change, ensuring proper exception handling instead of logging warnings.
* feat(guardrails): add MCPJWTSigner built-in guardrail for zero trust MCP auth
Signs outbound MCP tool calls with a LiteLLM-issued RS256 JWT so MCP servers
can trust a single signing authority instead of every upstream IdP.
Enable in config.yaml:
guardrails:
- guardrail_name: mcp-jwt-signer
litellm_params:
guardrail: mcp_jwt_signer
mode: pre_mcp_call
default_on: true
JWT carries sub (user_id), act.sub (team_id, RFC 8693), tool-level scope, iss,
aud, iat/exp/nbf. RSA-2048 keypair auto-generated at startup unless
MCP_JWT_SIGNING_KEY env var is set.
Adds /.well-known/jwks.json endpoint and jwks_uri to /.well-known/openid-configuration
so MCP servers can verify LiteLLM-issued tokens via OIDC discovery.
* Update MCPServerManager to raise HTTPException with status code 400 for extra headers in OpenAPI-backed servers. Adjust tests to verify the correct status code and exception message.
* fix: address P1 issues in MCPJWTSigner
- OpenAPI servers: warn + skip header injection instead of 500
- JWKS Cache-Control: 5min for auto-generated keys, 1h for persistent
- sub claim: fallback to apikey:{token_hash} for anonymous callers
- ttl_seconds: validate > 0 at init time
* docs: add MCP zero trust auth guide with architecture diagram
* docs: add FastMCP JWT verification guide to zero trust doc
* fix: address remaining Greptile review issues (round 2)
- mcp_server_manager: warn when hook Authorization overwrites existing header
- __init__: remove _mcp_jwt_signer_instance from __all__ (private internal)
- discoverable_endpoints: copy dict instead of mutating in-place on OIDC augmentation
- test docstring: reflect warn-and-continue behavior for OpenAPI servers
- test: update scope assertions for least-privilege (no mcp:tools/list on tool-call JWTs)
* fix: address Greptile round 3 feedback
- initialize_guardrail: validate mode='pre_mcp_call' at init time — misconfigured
mode silently bypasses JWT injection, which is a zero-trust bypass
- _build_claims: remove duplicate inline 'import re' (module-level import already present)
- _types.py: add TODO comment explaining jwt_claims is forward-compat plumbing
for a follow-up PR that will forward upstream IdP claims into outbound MCP JWTs
* feat(mcp_jwt_signer): add verify+re-sign, claim ops, two-token model, configurable scopes
Addresses all missing pieces from the scoping doc review:
FR-5 (Verify + re-sign): MCPJWTSigner now accepts access_token_discovery_uri
and token_introspection_endpoint. When set, the incoming Bearer token is
extracted from raw_headers (threaded through pre_call_tool_check), verified
against the IdP's JWKS (JWT) or introspected (opaque), and only re-signed if
valid. Falls back to user_api_key_dict.jwt_claims for LiteLLM JWT-auth mode.
FR-12 (Configurable end-user identity mapping): end_user_claim_sources
ordered list drives sub resolution — sources: token:<claim>, litellm:user_id,
litellm:email, litellm:end_user_id, litellm:team_id.
FR-13 (Claim operations): add_claims (insert-if-absent), set_claims (always
override), remove_claims (delete) applied in that order.
FR-14 (Two-token model): channel_token_audience + channel_token_ttl issue a
second JWT injected as x-mcp-channel-token: Bearer <token>.
FR-15 (Incoming claim validation): required_claims raises HTTP 403 when any
listed claim is absent; optional_claims passes listed claims from verified
token into the outbound JWT.
FR-9 (Debug headers): debug_headers: true emits x-litellm-mcp-debug with kid,
sub, iss, exp, scope.
FR-10 (Configurable scopes): allowed_scopes replaces auto-generation. Also
fixed: tool-call JWTs no longer grant mcp:tools/list (overpermission).
P1 fixes:
- proxy/utils.py: _convert_mcp_hook_response_to_kwargs merges rather than
replaces extra_headers, preserving headers from prior guardrails.
- mcp_server_manager.py: warns when hook injects Authorization alongside a
server-configured authentication_token (previously silent).
- mcp_server_manager.py: pre_call_tool_check now accepts raw_headers and
extracts incoming_bearer_token so FR-5 verification has the raw token.
- proxy/utils.py: remove stray inline import inspect inside loop (pre-existing
lint error, now cleaned up).
Tests: 43 passing (28 new tests covering all FR flags + P1 fixes).
* feat(mcp_jwt_signer): add verify+re-sign, claim ops, two-token model, configurable scopes (core)
Remaining files from the FR implementation:
mcp_jwt_signer.py — full rewrite with all new params:
FR-5: access_token_discovery_uri, token_introspection_endpoint,
verify_issuer, verify_audience + _verify_incoming_jwt(),
_introspect_opaque_token()
FR-12: end_user_claim_sources ordered resolution chain
FR-13: add_claims, set_claims, remove_claims
FR-14: channel_token_audience, channel_token_ttl → x-mcp-channel-token
FR-15: required_claims (raises 403), optional_claims (passthrough)
FR-9: debug_headers → x-litellm-mcp-debug
FR-10: allowed_scopes; tool-call JWTs no longer over-grant tools/list
mcp_server_manager.py:
- pre_call_tool_check gains raw_headers param to extract incoming_bearer_token
- Silent Authorization override warning fixed: now fires when server has
authentication_token AND hook injects Authorization
tests/test_mcp_jwt_signer.py:
28 new tests covering all FR flags + P1 fixes (43 total, all passing)
* fix(mcp_jwt_signer): address pre-landing review issues
- Remove stale TODO comment on UserAPIKeyAuth.jwt_claims — the field is
already populated and consumed by MCPJWTSigner in the same PR
- Fix _get_oidc_discovery to only cache the OIDC discovery doc when
jwks_uri is present; a malformed/empty doc now retries on the next
request instead of being permanently cached until proxy restart
- Add FR-5 test coverage for _fetch_jwks (cache hit/miss),
_get_oidc_discovery (cache/no-cache on bad doc), _verify_incoming_jwt
(valid token, expired token), _introspect_opaque_token (active,
inactive, no endpoint), and the end-to-end 401 hook path — 53 tests
total, all passing
* docs(mcp_zero_trust): rewrite as use-case guide covering all new JWT signer features
Add scenario-driven sections for each new config area:
- Verify+re-sign with Okta/Azure AD (access_token_discovery_uri,
end_user_claim_sources, token_introspection_endpoint)
- Enforcing caller attributes with required_claims / optional_claims
- Adding metadata via add_claims / set_claims / remove_claims
- Two-token model for AWS Bedrock AgentCore Gateway
(channel_token_audience / channel_token_ttl)
- Controlling scopes with allowed_scopes
- Debugging JWT rejections with debug_headers
Update JWT claims table to reflect configurable sub (end_user_claim_sources)
* fix(mcp_jwt_signer): wire all config.yaml params through initialize_guardrail
The factory was only passing issuer/audience/ttl_seconds to MCPJWTSigner.
All FR-5/9/10/12/13/14/15 params (access_token_discovery_uri,
end_user_claim_sources, add/set/remove_claims, channel_token_audience,
required/optional_claims, debug_headers, allowed_scopes, etc.) were
silently dropped, making every advertised advanced feature non-functional
when loaded from config.yaml.
Add regression test that asserts every param is wired through correctly.
* docs(mcp_zero_trust): add hero image
* docs(mcp_zero_trust): apply Linear-style edits
- Lead with the problem (unsigned direct calls bypass access controls)
- Shorter statement section headers instead of question-form headers
- Move diagram/OIDC discovery block after the reader is bought in
- Add 'read further only if you need to' callout after basic setup
- Two-token section now opens from the user problem not product jargon
- Add concrete 403 error response example in required_claims section
- Debug section opens from the symptom (MCP server returning 401)
- Lowercase claims reference header for consistency
* fix(mcp_jwt_signer): fix algorithm confusion attack + add OIDC discovery 24h TTL
- Remove alg from unverified JWT header; use signing_jwk.algorithm_name from JWKS key instead.
Reading alg from attacker-controlled headers enables alg:none / HS256 confusion attacks.
- Add _oidc_discovery_fetched_at timestamp and _OIDC_DISCOVERY_TTL = 86400 (24h).
Without a TTL the cached discovery doc never refreshes, so IdP key rotation is invisible.
---------
Co-authored-by: Noah Nistler <60981020+noahnistler@users.noreply.github.com>
* fix(ci): stabilize CI - formatting, type errors, test polling, security CVEs, router bug, batch resolution
Fix 1: Run Black formatter on 35 files
Fix 2: Fix MyPy type errors:
- setup_wizard.py: add type annotation for 'selected' set variable
- user_api_key_auth.py: remove redundant type annotation on jwt_claims reassignment
Fix 3: Fix spend accuracy test burst 2 polling to wait for expected total
spend instead of just 'any increase' from burst 2
Fix 4: Bump Next.js 16.1.6 -> 16.1.7 to fix CVE-2026-27978, CVE-2026-27979,
CVE-2026-27980, CVE-2026-29057
Fix 5: Fix router _pre_call_checks model variable being overwritten inside
loop, causing wrong model lookups on subsequent deployments. Use local
_deployment_model variable instead.
Fix 6: Add missing resolve_output_file_ids_to_unified call in batch retrieve
non-terminal-to-terminal path (matching the terminal path behavior)
Co-authored-by: Ishaan Jaff <ishaan-jaff@users.noreply.github.com>
* chore: regenerate poetry.lock to sync with pyproject.toml
Co-authored-by: Ishaan Jaff <ishaan-jaff@users.noreply.github.com>
* fix: format merged files from main and regenerate poetry.lock
Co-authored-by: Ishaan Jaff <ishaan-jaff@users.noreply.github.com>
* fix(mypy): annotate jwt_claims as Optional[dict] to fix type incompatibility
Co-authored-by: Ishaan Jaff <ishaan-jaff@users.noreply.github.com>
* fix(ci): update router region test to use gpt-4.1-mini (fix flaky model lookup)
Replace deprecated gpt-3.5-turbo-1106 with gpt-4.1-mini + mock_response in
test_router_region_pre_call_check, following the same pattern used in commit
|
||
|---|---|---|
| .. | ||
| claude_code_marketplace | ||
| claude_code_max | ||
| release_notes | ||
| 1_instance_proxy.png | ||
| 2_instance_proxy.png | ||
| 10_instance_proxy.png | ||
| a2a_agent_spend.png | ||
| a2a_gateway.png | ||
| a2a_gateway2.png | ||
| a2a_trace_grouping.png | ||
| add_agent.png | ||
| add_agent1.png | ||
| add_agent_1.png | ||
| add_Guard2.gif | ||
| add_guard5.gif | ||
| add_internal_user.png | ||
| add_mcp.png | ||
| add_model_access.png | ||
| add_model_key.png | ||
| add_prompt.png | ||
| add_prompt_use_var.png | ||
| add_prompt_use_var1.png | ||
| add_prompt_var.png | ||
| add_stdio_mcp.png | ||
| admin_settings_ui_theme.png | ||
| admin_settings_ui_theme_logo.png | ||
| admin_team_guardrails.png | ||
| admin_ui_2.png | ||
| admin_ui_disabled.png | ||
| admin_ui_spend.png | ||
| admin_ui_viewer.png | ||
| agent2.png | ||
| agent_1.png | ||
| agent_2.png | ||
| agent_3.png | ||
| agent_4.png | ||
| agent_hub_clean.png | ||
| agent_id.png | ||
| agent_key.png | ||
| agent_team.png | ||
| agent_usage.png | ||
| agent_usage_analytics.png | ||
| agent_usage_filter.png | ||
| agent_usage_ui_navigation.png | ||
| ai_hub_with_agents.png | ||
| alerting_metadata.png | ||
| alt_dashboard.png | ||
| aporia_post.png | ||
| aporia_pre.png | ||
| aporia_projs.png | ||
| app_role2.png | ||
| app_role3.png | ||
| app_roles.png | ||
| argilla.png | ||
| arize.png | ||
| athina_dashboard.png | ||
| auto_prompt_caching.png | ||
| auto_router.png | ||
| auto_router2.png | ||
| azure_blob.png | ||
| azure_content_safety_guardrails.jpg | ||
| basic_litellm.gif | ||
| batches_cost_tracking.png | ||
| bench_llm.png | ||
| bulk_edit_graphic.png | ||
| bulk_select_users.png | ||
| callback_api.png | ||
| claude_cli_tag_usage.png | ||
| claude_code_byok_screenshot.png | ||
| claude_code_max.png | ||
| claude_code_websearch.png | ||
| cloud_run0.png | ||
| cloud_run1.png | ||
| cloud_run2.png | ||
| cloud_run3.png | ||
| code_interp.png | ||
| codellama_formatted_input.png | ||
| codellama_input.png | ||
| compare_llms.png | ||
| control_model_access_jwt.png | ||
| create_budget_modal.png | ||
| create_default_team.png | ||
| create_guard.gif | ||
| create_guard3.gif | ||
| create_guard_tool_permission.png | ||
| create_key_in_team.gif | ||
| create_key_in_team_oweb.gif | ||
| create_key_no_team.png | ||
| create_key_with_default_team.png | ||
| create_key_with_default_team_success.png | ||
| create_rule_tool_permission.png | ||
| create_service_account.png | ||
| create_team_gif_good.gif | ||
| create_team_member_rate_limits.png | ||
| create_user.png | ||
| cursor_add_credential.png | ||
| cursor_log_detail.png | ||
| cursor_logs.png | ||
| cursor_mcp_installed.png | ||
| custom_prompt_management.png | ||
| custom_root_path.png | ||
| custom_swagger.png | ||
| custom_tag_headers.png | ||
| customer_usage.png | ||
| customer_usage_analytics.png | ||
| customer_usage_filter.png | ||
| customer_usage_ui_navigation.png | ||
| cyberark1.png | ||
| cyberark2.png | ||
| dash_output.png | ||
| dashboard_log.png | ||
| dd_llm_obs.png | ||
| dd_small1.png | ||
| deadlock_fix_1.png | ||
| deadlock_fix_2.png | ||
| debug_langfuse.png | ||
| debug_sso.png | ||
| deepeval_dashboard.png | ||
| deepeval_visible_trace.png | ||
| default_teams_product_ss.jpg | ||
| default_user_settings_admin_ui.png | ||
| default_user_settings_with_default_team.png | ||
| delete_spend_logs.jpg | ||
| deploy-to-aws.png | ||
| edit_prompt.png | ||
| edit_prompt2.png | ||
| edit_prompt3.png | ||
| edit_prompt4.png | ||
| elastic_otel.png | ||
| elasticsearch_demo.png | ||
| email_2.png | ||
| email_2_0.png | ||
| email_event_1.png | ||
| email_event_2.png | ||
| email_notifs.png | ||
| email_regen.png | ||
| email_regen2.png | ||
| end_user_enforcement.png | ||
| enterprise_vs_oss_2.png | ||
| entra_create_team.png | ||
| ephemeral_token.png | ||
| fallback_login.png | ||
| favicon.png | ||
| favicon_converted.ico | ||
| files_api_graphic.png | ||
| final_public_model_hub_view.png | ||
| gcp_acc_1.png | ||
| gcp_acc_2.png | ||
| gcp_acc_3.png | ||
| gcs_bucket.png | ||
| gd_fail.png | ||
| gd_success.png | ||
| gemini_context_caching.png | ||
| gemini_realtime.png | ||
| google_oauth2.png | ||
| google_redirect.png | ||
| grafana_1.png | ||
| grafana_2.png | ||
| grafana_3.png | ||
| guardrail_playground.png | ||
| hcorp.png | ||
| hcorp_create_virtual_key.png | ||
| hcorp_virtual_key.png | ||
| hero.png | ||
| hf_filter_inference_providers.png | ||
| hf_inference_endpoint.png | ||
| hosted_debugger_usage_page.png | ||
| image_handling.png | ||
| instances_vs_rps.png | ||
| invitation_link.png | ||
| kb.png | ||
| kb_2.png | ||
| kb_3.png | ||
| kb_4.png | ||
| kb_openai1.png | ||
| kb_pg1.png | ||
| kb_vertex1.png | ||
| kb_vertex2.png | ||
| kb_vertex3.png | ||
| key_delete.png | ||
| key_email.png | ||
| key_email_2.png | ||
| key_logging.png | ||
| key_logging2.png | ||
| key_logging_arize.png | ||
| key_r.png | ||
| key_u.png | ||
| lago.jpeg | ||
| lago_2.png | ||
| langfuse-example-trace-multiple-models-min.png | ||
| langfuse-litellm-ui.png | ||
| langfuse.png | ||
| langfuse_otel.png | ||
| langfuse_prmpt_mgmt.png | ||
| langfuse_prompt_id.png | ||
| langfuse_prompt_management_model_config.png | ||
| langfuse_small.png | ||
| langsmith.png | ||
| langsmith_new.png | ||
| latency.png | ||
| levo_logo.png | ||
| levo_logo_dark.png | ||
| litellm_adk.png | ||
| litellm_codex.gif | ||
| litellm_create_team.gif | ||
| litellm_custom_ai.png | ||
| litellm_entra_id.png | ||
| litellm_gateway.png | ||
| litellm_hosted_ui_add_models.png | ||
| litellm_hosted_ui_create_key.png | ||
| litellm_hosted_ui_router.png | ||
| litellm_hosted_usage_dashboard.png | ||
| litellm_load_test.png | ||
| litellm_mcp.png | ||
| litellm_proxy_setup.png | ||
| litellm_setup_openweb.gif | ||
| litellm_streamlit_playground.png | ||
| litellm_thinking_openweb.gif | ||
| litellm_ui_3.gif | ||
| litellm_ui_admin.png | ||
| litellm_ui_copy_id.png | ||
| litellm_ui_create_key.png | ||
| litellm_ui_login.png | ||
| litellm_user_heirarchy.png | ||
| litellm_virtual_key.gif | ||
| literalai.png | ||
| locust.png | ||
| locust_load_test.png | ||
| locust_load_test1.png | ||
| locust_load_test2.png | ||
| locust_load_test2_setup.png | ||
| logfire.png | ||
| lunary-trace.png | ||
| make_agents_public.png | ||
| make_public_modal.png | ||
| make_public_modal_confirmation.png | ||
| managed_files_arch.png | ||
| max_budget_for_internal_users.png | ||
| mcp_2.png | ||
| mcp_allow_all_ui.png | ||
| mcp_aws_sigv4_ui.png | ||
| mcp_cost.png | ||
| mcp_create_access_group.png | ||
| mcp_key.png | ||
| mcp_key_access_group.png | ||
| mcp_oauth.png | ||
| mcp_on_public_ai_hub.png | ||
| mcp_openapi_custom_name_badge.png | ||
| mcp_openapi_tool_edit_panel.png | ||
| mcp_openapi_tools_loaded.png | ||
| mcp_playground.png | ||
| mcp_server_on_ai_hub.png | ||
| mcp_tool_testing_playground.png | ||
| mcp_tools.png | ||
| mcp_ui.png | ||
| mcp_updates.jpg | ||
| mcp_zero_trust_gateway.png | ||
| message_redaction_logging.png | ||
| message_redaction_spend_logs.png | ||
| mlflow_tool_calling_tracing.png | ||
| mlflow_tracing.png | ||
| model_compare_overview.png | ||
| model_hub.png | ||
| model_hub_admin_view.png | ||
| model_hub_public.png | ||
| ms_teams_alerting.png | ||
| msft_auto_team.png | ||
| msft_default_settings.png | ||
| msft_enterprise_app.png | ||
| msft_enterprise_assign_group.png | ||
| msft_enterprise_select_group.png | ||
| msft_member_1.png | ||
| msft_member_2.png | ||
| msft_member_3.png | ||
| msft_sso_sign_in.png | ||
| multi_instance_rate_limiting.png | ||
| multiple_deployments.png | ||
| new_user_email.png | ||
| new_user_login.png | ||
| ngrok_public_url.gif | ||
| oauth_2_success.png | ||
| okta_access_policies.png | ||
| okta_authorization_server.png | ||
| okta_callback_url.png | ||
| okta_client_credentials.png | ||
| okta_redirect_uri.png | ||
| okta_security_api.png | ||
| openmeter.png | ||
| openmeter_img_2.png | ||
| opik.png | ||
| opik_key_metadata.png | ||
| otel_debug_trace.png | ||
| otel_parent.png | ||
| pagerduty_fail.png | ||
| pagerduty_hanging.png | ||
| passthrough_method_setup.png | ||
| passthrough_query_default.png | ||
| perf_imp.png | ||
| pii_masking_v2.png | ||
| policy_team_attach.png | ||
| policy_test_matching.png | ||
| presidio_1.png | ||
| presidio_2.png | ||
| presidio_3.png | ||
| presidio_4.png | ||
| presidio_5.png | ||
| presidio_screenshot.png | ||
| prevent_deadlocks.jpg | ||
| project_spend.png | ||
| prom_config.png | ||
| prompt_history.png | ||
| prompt_management_architecture_doc.png | ||
| prompt_table.png | ||
| promptlayer.png | ||
| proxy_langfuse.png | ||
| pt_1.png | ||
| pt_2.png | ||
| pt_guard1.png | ||
| pt_guard2.png | ||
| public_agent_hub.png | ||
| raw_request_log.png | ||
| raw_response_headers.png | ||
| realtime_api.png | ||
| render1.png | ||
| render2.png | ||
| response_cost_img.png | ||
| retool_litellm_connection.gif | ||
| retool_litellm_logs.gif | ||
| retool_llm_setup.gif | ||
| retool_resource_setup.gif | ||
| router_architecture.png | ||
| sagemaker_deploy.png | ||
| sagemaker_domain.png | ||
| sagemaker_endpoint.png | ||
| sagemaker_jumpstart.png | ||
| scaling_architecture.png | ||
| scim_0.png | ||
| scim_1.png | ||
| scim_2.png | ||
| scim_3.png | ||
| scim_4.png | ||
| scim_integration.png | ||
| secret_manager_hashicorp_vault_settings.png | ||
| secret_manager_settings.png | ||
| secret_manager_settings_additional_settings.png | ||
| secret_manager_settings_create_button.png | ||
| secret_manager_settings_create_team.png | ||
| select_default_team.png | ||
| sentinel.png | ||
| sentry.png | ||
| separate_health_app_architecture.png | ||
| slack.png | ||
| soft_budget_alert.png | ||
| spend_log_deletion_multi_pod.jpg | ||
| spend_log_deletion_working.png | ||
| spend_logs_table.png | ||
| spend_per_user.png | ||
| static_headers.png | ||
| success_bulk_edit.png | ||
| swagger.png | ||
| tag_budget1.png | ||
| tag_budget2.png | ||
| tag_create.png | ||
| tag_invalid.png | ||
| tag_valid.png | ||
| team_logging1.png | ||
| team_logging2.png | ||
| team_logging3.png | ||
| team_logging4.png | ||
| team_member_permissions.png | ||
| test_key_budget.gif | ||
| test_python_server_1.png | ||
| test_python_server_2.png | ||
| throughput.png | ||
| traceloop_dash.png | ||
| ui_3.gif | ||
| ui_access_groups.png | ||
| ui_add_cred_2.png | ||
| ui_auto_prompt_caching.png | ||
| ui_clean_login.png | ||
| ui_cloudzero.png | ||
| ui_cred_3.png | ||
| ui_cred_4.png | ||
| ui_cred_add.png | ||
| ui_deleted_keys_table.png | ||
| ui_endpoint_activity.png | ||
| ui_granular_router_settings.png | ||
| ui_invite_link.png | ||
| ui_invite_user.png | ||
| ui_key.png | ||
| ui_link.png | ||
| ui_logout.png | ||
| ui_model_compare_cost_metrics.png | ||
| ui_model_compare_enter_prompt.png | ||
| ui_model_compare_guardrails_config.png | ||
| ui_model_compare_model_parameters.png | ||
| ui_model_compare_overview.png | ||
| ui_model_compare_responses.png | ||
| ui_model_compare_select_model.png | ||
| ui_model_compare_sync_across_models.png | ||
| ui_model_compare_tags_config.png | ||
| ui_model_compare_vector_stores_config.png | ||
| ui_playground_navigation.png | ||
| ui_request_logs.png | ||
| ui_request_logs_content.png | ||
| ui_self_serve_create_key.png | ||
| ui_session_logs.png | ||
| ui_spend_logs_settings.png | ||
| ui_store_model_in_db.png | ||
| ui_team_soft_budget_alerts.png | ||
| ui_team_soft_budget_email_example.png | ||
| ui_tools.png | ||
| ui_usage.png | ||
| use_model_cred.png | ||
| user_info_with_default_team.png | ||
| wandb.png | ||
| webrtc_flow.png | ||
