scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-15 23:31:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 165
litellm/litellm-proxy-extras
History
Krrish Dholakia 977ab6682c feat(managed agents): add v1 Fargate-backed managed-agent endpoints 
Adds the full v1 managed_agents stack under
`/v1/managed_agents/*`:

- Sandbox templates: `POST/GET/DELETE /v1/managed_agents/sandbox-templates`
  Builds a Docker harness, pushes to ECR, registers a Fargate task definition.
- Agents: `POST/GET /v1/managed_agents/agents` with model + prompt + branch
  override.
- Sessions: `POST /v1/managed_agents/agents/{id}/session`,
  `GET/DELETE /v1/managed_agents/sessions/{id}`. Spawns a Fargate task,
  waits for ready, seeds the harness chat session (and optional first
  prompt) in one call.
- Passthrough: `POST /v1/managed_agents/sessions/{id}/message`,
  SSE `/events`, raw `/raw/{path}` for direct opencode access.

Includes:
  * Prisma schema for `LiteLLM_ManagedAgent{SandboxTemplate,,Session}Table`
    plus migrations under litellm-proxy-extras.
  * Background reconciler that stops orphaned Fargate tasks every 60s,
    wired into proxy_server lifespan.
  * Sample opencode Dockerfile + entrypoint under
    `managed_agents_endpoints/sample_harnesses/opencode/`.
  * Unit tests for templates, agents, sessions, lifecycle, bootstrap,
    git validation, and dockerfile registry.

Schema-validated end-to-end against a real Postgres instance (round-trip
create→include→update→delete). All 60 unit tests pass.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-07 15:17:21 -07:00
..
dist adding build 2026-03-21 22:55:04 -07:00
litellm_proxy_extras feat(managed agents): add v1 Fargate-backed managed-agent endpoints 2026-05-07 15:17:21 -07:00
tests [Fix] v2 resolver: swallow non-connection DB errors; wrap resolve failures 2026-04-21 15:53:07 -07:00
build_and_publish.md build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
LICENSE install prisma migration files - connects litellm proxy to litellm's prisma migration files (#9637) 2025-03-29 15:27:09 -07:00
migration_runbook.md [Infra] Add freshness and destructive guards to migration workflow 2026-04-21 12:00:23 -07:00
pyproject.toml [Infra] Promote internal staging to main (#27245) 2026-05-05 16:15:03 -07:00
README.md build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00

README.md

Additional files for the proxy. Reduces the size of the main litellm package.

Currently, only stores the migration.sql files for litellm-proxy.

To install, run:

uv add litellm-proxy-extras

OR

uv tool install 'litellm[proxy]' # installs litellm-proxy-extras and other proxy dependencies

To use the migrations, run:

litellm --use_prisma_migrate