mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-07 08:26:10 +00:00
Litellm docs a2a cost tracking (#17913)
* docs - a2a cost tracking * docs fix * docs a2a cost trackign * docs langgraph agents
This commit is contained in:
Ishaan Jaff
GitHub
parent
ab9ec11ba8
commit
2f82c223d3
3 changed files with 178 additions and 0 deletions
115
docs/my-website/docs/a2a_cost_tracking.md
Normal file
115
docs/my-website/docs/a2a_cost_tracking.md
Normal file
|
|
@ -0,0 +1,115 @@
|
|||
# A2A Agent Cost Tracking
|
||||
|
||||
LiteLLM supports adding custom cost tracking for A2A agents. You can configure:
|
||||
|
||||
- **Flat cost per query** - A fixed cost charged for each agent request
|
||||
- **Cost by input/output tokens** - Variable cost based on token usage
|
||||
|
||||
This allows you to track and attribute costs for agent usage across your organization, making it easy to see how much each team or project is spending on agent calls.
|
||||
|
||||
## Quick Start
|
||||
|
||||
### 1. Navigate to Agents
|
||||
|
||||
From the sidebar, click on "Agents" to open the agent management page.
|
||||
|
||||
|
||||
|
||||
### 2. Create a New Agent
|
||||
|
||||
Click "+ Add New Agent" to open the creation form. You'll need to provide a few basic details:
|
||||
|
||||
- **Agent Name** - A unique identifier for your agent (used in API calls)
|
||||
- **Display Name** - A human-readable name shown in the UI
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
### 3. Configure Cost Settings
|
||||
|
||||
Scroll down and click on "Cost Configuration" to expand the cost settings panel. This is where you define how much to charge for agent usage.
|
||||
|
||||
|
||||
|
||||
### 4. Set Cost Per Query
|
||||
|
||||
Enter the cost per query amount (in dollars). For example, entering `0.05` means each request to this agent will be charged $0.05.
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
### 5. Create the Agent
|
||||
|
||||
Once you've configured everything, click "Create Agent" to save. Your agent is now ready to use with cost tracking enabled.
|
||||
|
||||
|
||||
|
||||
## Testing Cost Tracking
|
||||
|
||||
Let's verify that cost tracking is working by sending a test request through the Playground.
|
||||
|
||||
### 1. Go to Playground
|
||||
|
||||
Click "Playground" in the sidebar to open the interactive testing interface.
|
||||
|
||||
|
||||
|
||||
### 2. Select A2A Endpoint
|
||||
|
||||
By default, the Playground uses the chat completions endpoint. To test your agent, click "Endpoint Type" and select `/v1/a2a/message/send` from the dropdown.
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
### 3. Select Your Agent
|
||||
|
||||
Now pick the agent you just created from the agent dropdown. You should see it listed by its display name.
|
||||
|
||||
|
||||
|
||||
### 4. Send a Test Message
|
||||
|
||||
Type a message and hit send. You can use the suggested prompts or write your own.
|
||||
|
||||
|
||||
|
||||
Once the agent responds, the request is logged with the cost you configured.
|
||||
|
||||
|
||||
|
||||
## Viewing Cost in Logs
|
||||
|
||||
Now let's confirm the cost was actually tracked.
|
||||
|
||||
### 1. Navigate to Logs
|
||||
|
||||
Click "Logs" in the sidebar to see all recent requests.
|
||||
|
||||
|
||||
|
||||
### 2. View Cost Attribution
|
||||
|
||||
Find your agent request in the list. You'll see the cost column showing the amount you configured. This cost is now attributed to the API key that made the request, so you can track spend per team or project.
|
||||
|
||||
|
||||
|
||||
## Cost Configuration Options
|
||||
|
||||
You can mix and match these options depending on your pricing model:
|
||||
|
||||
| Field | Description |
|
||||
|-------|-------------|
|
||||
| **Cost Per Query ($)** | Fixed cost charged for each agent request |
|
||||
| **Input Cost Per Token ($)** | Cost per input token processed |
|
||||
| **Output Cost Per Token ($)** | Cost per output token generated |
|
||||
|
||||
For most use cases, a flat cost per query is simplest. Use token-based pricing if your agent costs vary significantly based on input/output length.
|
||||
|
||||
## Related
|
||||
|
||||
- [A2A Agent Gateway](./a2a.md)
|
||||
- [Spend Tracking](./proxy/cost_tracking.md)
|
||||
|
||||
|
|
@ -233,8 +233,65 @@ curl -s --request POST \
|
|||
|
||||
|
||||
|
||||
## LiteLLM A2A Gateway
|
||||
|
||||
You can also connect to LangGraph agents through LiteLLM's A2A (Agent-to-Agent) Gateway UI. This provides a visual way to register and test agents without writing code.
|
||||
|
||||
### 1. Navigate to Agents
|
||||
|
||||
From the sidebar, click "Agents" to open the agent management page, then click "+ Add New Agent".
|
||||
|
||||
|
||||
|
||||
### 2. Select LangGraph Agent Type
|
||||
|
||||
Click "A2A Standard" to see available agent types, then search for "langgraph" and select "Connect to LangGraph agents via the LangGraph Platform API".
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
### 3. Configure the Agent
|
||||
|
||||
Fill in the following fields:
|
||||
|
||||
- **Agent Name** - A unique identifier (e.g., `lan-agent`)
|
||||
- **LangGraph API Base** - Your LangGraph server URL, typically `http://127.0.0.1:2024/`
|
||||
- **API Key** - Optional. LangGraph doesn't require an API key by default
|
||||
- **Assistant ID** - Not used by LangGraph, you can enter any string here
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
Click "Create Agent" to save.
|
||||
|
||||
|
||||
|
||||
### 4. Test in Playground
|
||||
|
||||
Go to "Playground" in the sidebar to test your agent. Change the endpoint type to `/v1/a2a/message/send`.
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
### 5. Select Your Agent and Send a Message
|
||||
|
||||
Pick your LangGraph agent from the dropdown and send a test message.
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
The agent responds with its capabilities. You can now interact with your LangGraph agent through the A2A protocol.
|
||||
|
||||
|
||||
|
||||
## Further Reading
|
||||
|
||||
- [LangGraph Platform Documentation](https://langchain-ai.github.io/langgraph/cloud/quick_start/)
|
||||
- [LangGraph GitHub](https://github.com/langchain-ai/langgraph)
|
||||
- [A2A Agent Gateway](../a2a.md)
|
||||
- [A2A Cost Tracking](../a2a_cost_tracking.md)
|
||||
|
||||
|
|
|
|||
|
|
@ -411,7 +411,13 @@ const sidebars = {
|
|||
label: "/a2a - A2A Agent Gateway",
|
||||
items: [
|
||||
"a2a",
|
||||
"a2a_cost_tracking",
|
||||
"a2a_agent_permissions",
|
||||
{
|
||||
type: "link",
|
||||
label: "Adding LangGraph Agents",
|
||||
href: "/docs/providers/langgraph#litellm-a2a-gateway",
|
||||
},
|
||||
],
|
||||
},
|
||||
"assistants",
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue