mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-07 08:26:10 +00:00
3653e5893f
* feat(terraform): close key/team schema gaps, fix team read envelope, add import support * feat(terraform): add fallback resource/data source and key/team block resources * feat(terraform): add access group and unified access group resources and data sources * feat(terraform): add guardrail and prompt resources and data sources * feat(terraform): add agent and search tool resources and data sources * feat(terraform): add user and budget resources and data sources * feat(terraform): add tag and project resources and data sources * docs(terraform): changelog and readme for parity additions * feat(terraform): add data sources for keys, teams, models, organizations, and mcp servers * fix(terraform): key update 400 on empty budget_duration, key info envelope, config-supplied key * fix(terraform): hash raw keys to SHA-256 tokens in key lookup URLs and block resource IDs
88 lines
3.4 KiB
Markdown
88 lines
3.4 KiB
Markdown
# litellm_agent Resource
|
|
|
|
Manages an A2A (Agent-to-Agent) agent on the LiteLLM proxy. Agents are AI-powered entities that can be discovered, invoked, and composed using the A2A protocol.
|
|
|
|
## Example Usage
|
|
|
|
```hcl
|
|
resource "litellm_agent" "hello_world" {
|
|
agent_name = "hello-world-agent"
|
|
|
|
agent_card_params = jsonencode({
|
|
protocolVersion = "1.0"
|
|
name = "Hello World Agent"
|
|
description = "Just a hello world agent"
|
|
url = "http://localhost:9999/"
|
|
version = "1.0.0"
|
|
defaultInputModes = ["text"]
|
|
defaultOutputModes = ["text"]
|
|
capabilities = {
|
|
streaming = true
|
|
}
|
|
skills = [
|
|
{
|
|
id = "hello_world"
|
|
name = "Returns hello world"
|
|
description = "just returns hello world"
|
|
tags = ["hello world"]
|
|
examples = ["hi", "hello world"]
|
|
}
|
|
]
|
|
})
|
|
|
|
litellm_params = jsonencode({
|
|
make_public = false
|
|
})
|
|
|
|
object_permission = jsonencode({
|
|
models = ["gpt-4-proxy"]
|
|
mcp_servers = ["my-mcp-server-id"]
|
|
})
|
|
|
|
static_headers = {
|
|
"x-api-key" = var.agent_api_key
|
|
}
|
|
|
|
extra_headers = ["x-request-id"]
|
|
|
|
tpm_limit = 100000
|
|
rpm_limit = 1000
|
|
session_tpm_limit = 10000
|
|
session_rpm_limit = 100
|
|
}
|
|
```
|
|
|
|
## Argument Reference
|
|
|
|
The following arguments are supported:
|
|
|
|
* `agent_name` - (Required) Name of the agent. Must be unique on the proxy.
|
|
* `agent_card_params` - (Required) The A2A agent card as a JSON object string (use `jsonencode`). Supports the standard A2A card fields: `name`, `description`, `url`, `version`, `protocolVersion`, `capabilities`, `skills`, `defaultInputModes`, `defaultOutputModes`, `preferredTransport`, `iconUrl`, `provider`, `documentationUrl`, and more. The proxy merges LiteLLM-fronting fields (such as `supportedInterfaces`) into the stored card, so the value you configure stays authoritative in state.
|
|
* `litellm_params` - (Optional, Sensitive) LiteLLM-specific parameters as a JSON object string. May include secrets such as `api_key`, so the value is never read back from the API; the configured value is authoritative.
|
|
* `object_permission` - (Optional) Access control permissions as a JSON object string with keys `mcp_servers`, `mcp_access_groups`, `mcp_tool_permissions`, `models`, and `agents`.
|
|
* `static_headers` - (Optional, Sensitive) Map of static headers sent with agent requests. May hold tokens, so it is never read back from the API.
|
|
* `extra_headers` - (Optional) List of incoming request header names to forward to the agent.
|
|
* `tpm_limit` - (Optional) Tokens per minute limit for the agent.
|
|
* `rpm_limit` - (Optional) Requests per minute limit for the agent.
|
|
* `session_tpm_limit` - (Optional) Per-session tokens per minute limit.
|
|
* `session_rpm_limit` - (Optional) Per-session requests per minute limit.
|
|
|
|
## Attribute Reference
|
|
|
|
In addition to all arguments above, the following attributes are exported:
|
|
|
|
* `id` - The agent ID assigned by LiteLLM.
|
|
* `created_at` - Timestamp when the agent was created.
|
|
* `updated_at` - Timestamp when the agent was last updated.
|
|
* `created_by` - User who created the agent.
|
|
* `updated_by` - User who last updated the agent.
|
|
|
|
## Import
|
|
|
|
Agents can be imported using the agent ID:
|
|
|
|
```shell
|
|
terraform import litellm_agent.example <agent_id>
|
|
```
|
|
|
|
Note: `litellm_params` and `static_headers` cannot be recovered on import because the API never returns their unmasked values; re-apply after import to set them.
|