scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-08-28 05:25:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 36
litellm/cookbook
History
Yassin Kortam 59118ae5b6
feat(cookbook): add a Grafana dashboard for the OTel GenAI metrics (#35159) 
The existing dashboards in this folder chart the litellm_* Prometheus metrics.
Nothing charted the gen_ai.* metrics the OpenTelemetry v2 integration emits, and
Grafana's own prebuilt GenAI dashboards cannot: twenty of their twenty-two panels
filter on telemetry_sdk_name="openlit", a label LiteLLM does not carry and has no
setting to add.

Ten panels over the six gen_ai instruments: spend, tokens, request count and p95
duration as stats, then request rate, spend per hour, tokens per minute split by
input and output, and p95 duration, time to first token, and provider generation
time by model. Template variables for data source, service, and model.

Verified against a live Grafana Cloud stack with real traffic across three
models. The readme documents the attribute filter the panels depend on, since the
default attribute set gives nearly every request its own series and makes every
rate-based panel read zero.
2026-07-30 17:29:40 +00:00
..
ai_coding_tool_guides Litellm fix update bedrock models (#24947) 2026-04-01 19:22:54 -07:00
anthropic_agent_sdk style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
benchmark docs: document new github + gitlab ci scripts 2026-03-25 20:17:10 -07:00
codellama-server docs: remove phone numbers from readme and docs 2026-03-25 12:40:40 -07:00
community-resources (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
gollem_go_agent_framework chore(cookbook): bump Go directive to 1.26.3 in gollem example (#29234) 2026-05-28 18:12:31 -07:00
litellm-ollama-docker-image chore(deps): refresh dependency locks 2026-05-04 11:36:18 -07:00
litellm_proxy_server feat(cookbook): add a Grafana dashboard for the OTel GenAI metrics (#35159) 2026-07-30 17:29:40 +00:00
litellm_router (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
litellm_router_load_test fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
livekit_agent_sdk style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
logging_observability docs litellm x langfuse cookbook 2025-02-14 09:31:51 -08:00
misc style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
mock_guardrail_server Guardrails API - new structured_messages param (#17518) 2025-12-04 22:08:00 -08:00
mock_prompt_management_server doc: add right readme.md 2026-02-18 03:33:23 +05:30
Benchmarking_LLMs_by_use_case.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
Claude_(Anthropic)_with_Streaming_liteLLM_Examples.ipynb (docs) update how to use litellm streaming 2023-11-21 11:19:32 -08:00
Evaluating_LLMs.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
google_adk_litellm_tutorial.ipynb [Docs] Using litellm with Google ADK (#10777) 2025-05-12 16:41:49 -07:00
liteLLM_A121_Jurrasic_example.ipynb add AI21 tutorial 2023-08-22 20:34:18 -07:00
LiteLLM_Azure_and_OpenAI_example.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
liteLLM_Baseten.ipynb Update Baseten LiteLLM integration 2025-08-19 12:21:05 -07:00
LiteLLM_batch_completion.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
LiteLLM_Bedrock.ipynb (docs) bedrock cookbook 2023-11-06 18:00:52 -08:00
liteLLM_clarifai_Demo.ipynb Clarifai - Added streaming and async completion support 2024-05-03 14:03:38 +00:00
LiteLLM_CometAPI.ipynb bump openai 2.8.0 2025-11-19 17:47:18 -08:00
LiteLLM_Comparing_LLMs.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
LiteLLM_Completion_Cost.ipynb add completion costs notebook 2023-09-06 18:43:09 -07:00
liteLLM_function_calling.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
liteLLM_Getting_Started.ipynb getting started cookbook litellm 2023-09-23 10:38:59 -07:00
LiteLLM_HuggingFace.ipynb fix img URL for tests 2025-11-22 09:41:15 -08:00
liteLLM_IBM_Watsonx.ipynb (docs) updated watsonx cookbook 2024-04-24 17:19:02 +02:00
liteLLM_Langchain_Demo.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
litellm_model_fallback.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
LiteLLM_NovitaAI_Cookbook.ipynb Add new model provider Novita AI (#7582) (#9527) 2025-05-12 21:49:30 -07:00
liteLLM_Ollama.ipynb docs 2023-09-21 12:33:39 -07:00
LiteLLM_OpenRouter.ipynb Add new model provider Novita AI (#7582) (#9527) 2025-05-12 21:49:30 -07:00
LiteLLM_Petals.ipynb cookbook petals 2023-09-20 09:34:33 -07:00
LiteLLM_PromptLayer.ipynb fix: prompt registry 2026-02-18 00:34:54 +05:30
liteLLM_Replicate_Demo.ipynb fix replicate docs 2023-09-06 12:35:50 -07:00
liteLLM_Streaming_Demo.ipynb add streaming example cookbook 2023-08-09 14:29:23 -07:00
litellm_test_multiple_llm_demo.ipynb Rename Untitled155.ipynb to litellm_test_multiple_llm_demo.ipynb 2023-08-10 18:56:26 -07:00
litellm_Test_Multiple_Providers.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
LiteLLM_User_Based_Rate_Limits.ipynb add notebook on using litellm budget manager 2023-09-12 20:53:55 -07:00
liteLLM_VertextAI_Example.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
Migrating_to_LiteLLM_Proxy_from_OpenAI_Azure_OpenAI.ipynb fix: prompt registry 2026-02-18 00:34:54 +05:30
mlflow_langchain_tracing_litellm_proxy.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
nova_sonic_realtime.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
Parallel_function_calling.ipynb (docs) parallel function calling with Azure OpenAI 2023-11-18 14:36:56 -08:00
Proxy_Batch_Users.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
result.html (docs) add embedding() profile 2023-11-30 19:04:51 -08:00
TogetherAI_liteLLM.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
Using_Nemo_Guardrails_with_LiteLLM_Server.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
veo_video_generation.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
VLLM_Model_Testing.ipynb Add files via upload 2023-09-06 19:27:06 -07:00