litellm/cookbook
Ishaan Jaff 4d941c914e
[Feat] Responses API Session Handling - Multi media support (#13347)
* rename ResponsesSessionHandler

* use ResponsesSessionHandler

* test session handler

* refactor ResponsesSessionHandler

* fix get_proxy_server_request_from_spend_log

* use constant for LITELLM_TRUNCATED_PAYLOAD_FIELD

* add _should_check_cold_storage_for_full_payload

* add get_class_type_for_custom_logger_name

* get_active_custom_logger_for_callback_name

* add get_proxy_server_request_from_cold_storage to CustomLogger

* add ColdStorageHandler

* start using cold storage integration

* add get_proxy_server_request_from_cold_storage

* fixes from manual testing

* s3 v2 fix getting region name

* ChatCompletionImageUrlObject

* use _get_configured_cold_storage_custom_logger

* fixes for _should_check_cold_storage_for_full_payload

* fix _download_object_from_s3

* test_s3_v2_with_cold_storage

* add cold_storage_object_key to StandardLoggingMetadata

* use get_proxy_server_request_from_cold_storage_with_object_key

* add cold_storage_object_key to SpendLogsMetadata

* add cold_storage_object_key

* get_proxy_server_request_from_cold_storage_with_object_key

* use get_proxy_server_request_from_cold_storage_with_object_key

* test responses API

* add get_proxy_server_request_from_cold_storage_with_object_key

* session handler fixes

* test session handler

* fix ruff checks

* _download_object_from_s3

* cleanup

* test

* lint fix

* test_e2e_cold_storage_successful_retrieval

* test_e2e_generate_cold_storage_object_key_successful

* test_async_gcs_pub_sub_v1

* test fix

* test fix

* test fix

* test_standard_logging_metadata_has_cold_storage_object_key_field

* test_sanitize_request_body_for_spend_logs_payload_basic

* test_transform_input_image_item_to_image_item_with_image_data
2025-08-07 10:59:53 -07:00
..
benchmark (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
codellama-server (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
community-resources (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
litellm-ollama-docker-image build(deps): bump litellm in /cookbook/litellm-ollama-docker-image 2025-03-20 21:03:29 +00:00
litellm_proxy_server feat(grafana_dashboard): enable datasource selection via templating (#10257) 2025-04-25 08:49:29 -07:00
litellm_router (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
litellm_router_load_test (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
logging_observability docs litellm x langfuse cookbook 2025-02-14 09:31:51 -08:00
misc [Feat] Responses API Session Handling - Multi media support (#13347) 2025-08-07 10:59:53 -07:00
Benchmarking_LLMs_by_use_case.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
Claude_(Anthropic)_with_Streaming_liteLLM_Examples.ipynb (docs) update how to use litellm streaming 2023-11-21 11:19:32 -08:00
Evaluating_LLMs.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
google_adk_litellm_tutorial.ipynb [Docs] Using litellm with Google ADK (#10777) 2025-05-12 16:41:49 -07:00
liteLLM_A121_Jurrasic_example.ipynb add AI21 tutorial 2023-08-22 20:34:18 -07:00
LiteLLM_Azure_and_OpenAI_example.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
liteLLM_Baseten.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
LiteLLM_batch_completion.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
LiteLLM_Bedrock.ipynb (docs) bedrock cookbook 2023-11-06 18:00:52 -08:00
liteLLM_clarifai_Demo.ipynb Clarifai - Added streaming and async completion support 2024-05-03 14:03:38 +00:00
LiteLLM_Comparing_LLMs.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
LiteLLM_Completion_Cost.ipynb add completion costs notebook 2023-09-06 18:43:09 -07:00
liteLLM_function_calling.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
liteLLM_Getting_Started.ipynb getting started cookbook litellm 2023-09-23 10:38:59 -07:00
LiteLLM_HuggingFace.ipynb Add inference providers support for Hugging Face (#8258) (#9738) (#9773) 2025-04-05 10:50:15 -07:00
liteLLM_IBM_Watsonx.ipynb (docs) updated watsonx cookbook 2024-04-24 17:19:02 +02:00
liteLLM_Langchain_Demo.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
litellm_model_fallback.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
LiteLLM_NovitaAI_Cookbook.ipynb Add new model provider Novita AI (#7582) (#9527) 2025-05-12 21:49:30 -07:00
liteLLM_Ollama.ipynb docs 2023-09-21 12:33:39 -07:00
LiteLLM_OpenRouter.ipynb Add new model provider Novita AI (#7582) (#9527) 2025-05-12 21:49:30 -07:00
LiteLLM_Petals.ipynb cookbook petals 2023-09-20 09:34:33 -07:00
LiteLLM_PromptLayer.ipynb edit promptlayer cookbook 2023-08-26 13:37:08 -07:00
liteLLM_Replicate_Demo.ipynb fix replicate docs 2023-09-06 12:35:50 -07:00
liteLLM_Streaming_Demo.ipynb add streaming example cookbook 2023-08-09 14:29:23 -07:00
litellm_test_multiple_llm_demo.ipynb Rename Untitled155.ipynb to litellm_test_multiple_llm_demo.ipynb 2023-08-10 18:56:26 -07:00
litellm_Test_Multiple_Providers.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
LiteLLM_User_Based_Rate_Limits.ipynb add notebook on using litellm budget manager 2023-09-12 20:53:55 -07:00
liteLLM_VertextAI_Example.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
Migrating_to_LiteLLM_Proxy_from_OpenAI_Azure_OpenAI.ipynb build: cookbook on migrating to litellm proxy from openai/azure sdk 2024-07-27 16:09:50 -07:00
mlflow_langchain_tracing_litellm_proxy.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
Parallel_function_calling.ipynb (docs) parallel function calling with Azure OpenAI 2023-11-18 14:36:56 -08:00
Proxy_Batch_Users.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
result.html (docs) add embedding() profile 2023-11-30 19:04:51 -08:00
TogetherAI_liteLLM.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
Using_Nemo_Guardrails_with_LiteLLM_Server.ipynb (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
VLLM_Model_Testing.ipynb Add files via upload 2023-09-06 19:27:06 -07:00