Hamish IvisonandGitHub 7ae7689a76 fixing eval script (#552)

2025-02-04 23:53:28 -05:00

..

alpaca_farm.sh

add the parameter "tokenizer_mode" when using the vllm.LLM() function (#144)

2024-04-12 13:50:29 -07:00

bbh.sh

Update demonstration eval scripts.

2023-10-28 21:07:56 -07:00

codex_humaneval.sh

first pass on mbpp

2024-04-26 22:32:54 +00:00

dummy_length_scorer.py

Docs for scripts (#221)

2024-08-08 09:01:45 -04:00

faster_oe_eval_mmlu.sh

faster mmlu oe-eval (#441)

2025-01-07 16:39:49 -08:00

fetch_mmlu_jobs.py

faster mmlu oe-eval (#441)

2025-01-07 16:39:49 -08:00

gsm.sh

Update demonstration eval scripts.

2023-10-28 21:07:56 -07:00

ifeval.sh

Add IFEval for formatting instruction following and Xstest evaluation for refusal (#133)

2024-03-29 15:59:28 -07:00

MATH.sh

Add MATH evaluation

2024-03-25 13:19:08 -07:00

mbpp.sh

add note on code execution flag

2024-04-26 22:40:28 +00:00

mmlu.sh

Use import_module to dynamically import the chat formatting function, allowing more flexibility for user-defined formatting.

2023-09-04 12:08:25 -07:00

oe-eval.sh

fixing eval script (#552)

2025-02-04 23:53:28 -05:00

toxigen.sh

Update demonstration eval scripts.

2023-10-28 21:07:56 -07:00

truthfulqa.sh

fix-trutuful-to-truthfulqa (#400)

2024-10-24 10:09:54 -07:00

tulu3_baselines_unseen.sh

Last fix for unseen evals. (#426)

2024-11-11 13:09:35 -08:00

tulu3_baselines.sh

increase safety GPUs (#409)

2024-10-30 14:05:58 -07:00

tydiqa.sh

Use import_module to dynamically import the chat formatting function, allowing more flexibility for user-defined formatting.

2023-09-04 12:08:25 -07:00

xstest.sh

Add IFEval for formatting instruction following and Xstest evaluation for refusal (#133)

2024-03-29 15:59:28 -07:00