scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-11-03 07:23:33 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 166
litellm/litellm-rust/crates/inference-ocr/AGENTS.md
yujonglee b6f91a221b
refactor(inference): rename RouteError to Error (#47771) 
Every other crate names its error Error. The format crates already re-exported
it under that name, so only the inference crate and a few importers change
2026-10-21 07:03:18 -07:00

796 B
Raw Permalink Blame History

  • Shared base and layering rules: ../inference/AGENTS.md
  • This crate owns OCR call orchestration. Payloads belong in litellm-llms-types, transformations and the request handler in llms/src/base_llm/ocr and llms/src/<provider>/ocr
  • The route returns its completed response directly
  • Route closures supply OCR-specific host capabilities, such as the caller's Azure AD token provider (src/route.rs)
  • Provider code reaches the caller's hooks mid-call only through litellm_llms::base_llm::ocr::handler::CallHooks, which this crate implements over its host until it folds into litellm_host::interceptors::Interceptors
  • OCR failures use base_llm/ocr/error.rs, the recorded exception to litellm_inference::Error until OCR folds into litellm_llms::Error