litellm/litellm-proxy-extras/litellm_proxy_extras
Krrish Dholakia 977ab6682c feat(managed agents): add v1 Fargate-backed managed-agent endpoints
Adds the full v1 managed_agents stack under
`/v1/managed_agents/*`:

- Sandbox templates: `POST/GET/DELETE /v1/managed_agents/sandbox-templates`
  Builds a Docker harness, pushes to ECR, registers a Fargate task definition.
- Agents: `POST/GET /v1/managed_agents/agents` with model + prompt + branch
  override.
- Sessions: `POST /v1/managed_agents/agents/{id}/session`,
  `GET/DELETE /v1/managed_agents/sessions/{id}`. Spawns a Fargate task,
  waits for ready, seeds the harness chat session (and optional first
  prompt) in one call.
- Passthrough: `POST /v1/managed_agents/sessions/{id}/message`,
  SSE `/events`, raw `/raw/{path}` for direct opencode access.

Includes:
  * Prisma schema for `LiteLLM_ManagedAgent{SandboxTemplate,,Session}Table`
    plus migrations under litellm-proxy-extras.
  * Background reconciler that stops orphaned Fargate tasks every 60s,
    wired into proxy_server lifespan.
  * Sample opencode Dockerfile + entrypoint under
    `managed_agents_endpoints/sample_harnesses/opencode/`.
  * Unit tests for templates, agents, sessions, lifecycle, bootstrap,
    git validation, and dockerfile registry.

Schema-validated end-to-end against a real Postgres instance (round-trip
create→include→update→delete). All 60 unit tests pass.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-07 15:17:21 -07:00
..
migrations feat(managed agents): add v1 Fargate-backed managed-agent endpoints 2026-05-07 15:17:21 -07:00
__init__.py install prisma migration files - connects litellm proxy to litellm's prisma migration files (#9637) 2025-03-29 15:27:09 -07:00
_logging.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
schema.prisma feat(managed agents): add v1 Fargate-backed managed-agent endpoints 2026-05-07 15:17:21 -07:00
utils.py [Fix] v2 resolver: swallow non-connection DB errors; wrap resolve failures 2026-04-21 15:53:07 -07:00