From 6e4a575b0fca78b4412a994da8ab921670cdb7ce Mon Sep 17 00:00:00 2001 From: ishaan-jaff Date: Sat, 4 Nov 2023 17:55:32 -0700 Subject: [PATCH] (docs) lm eval harness --- .../docs/tutorials/lm_evaluation_harness.md | 15 ++++++++++++++- 1 file changed, 14 insertions(+), 1 deletion(-) diff --git a/docs/my-website/docs/tutorials/lm_evaluation_harness.md b/docs/my-website/docs/tutorials/lm_evaluation_harness.md index e9beb28be25..3cb63d0087f 100644 --- a/docs/my-website/docs/tutorials/lm_evaluation_harness.md +++ b/docs/my-website/docs/tutorials/lm_evaluation_harness.md @@ -21,11 +21,16 @@ $ litellm --model huggingface/tinyllama --api_base https://k58ory32yinf1ly0.us-e OpenAI Compatible Endpoint at http://0.0.0.0:8000 -**Step 2: Set OpenAI API Base** +**Step 2: Set OpenAI API Base & Key** ```shell $ export OPENAI_API_BASE=http://0.0.0.0:8000 ``` +LM Harness requires you to set an OpenAI API key `OPENAI_API_SECRET_KEY` for running benchmarks +```shell +export OPENAI_API_SECRET_KEY=anything +``` + **Step 3: Run LM-Eval-Harness** ```shell @@ -34,4 +39,12 @@ python3 -m lm_eval \ --model_args engine=davinci \ --task crows_pairs_english_age +``` + +## Debugging + +### Making a test request to your proxy +This command makes a test Completion, ChatCompletion request to your proxy server +```shell +litellm --test ``` \ No newline at end of file