Prompt Junky

LM Evaluation Harness

Online · Nationwide

LM Evaluation Harness

EleutherAI's harness for few-shot benchmarking of language models across hundreds of academic tasks. It standardises prompt formatting so results are comparable between models and backends.

Preview of the business's website.

Services

  • Hundreds of benchmark tasks
  • Few-shot prompt formatting
  • Multiple inference backends
  • Reproducible scoring

Highlights

  • #python
  • #benchmarks
  • #research
  • #mit

Source: Official GitHub repository. Last checked 2026-11-11. Spot an error? Tell us.

Nearby and similar

More prompt tools

All prompt tools

Books

These links go to searches on Amazon. If you buy something after following one, this site may earn a commission at no extra cost to you. Nothing here is a paid placement, and no listing on this site pays to be included or ranked.As an Amazon Associate I earn from qualifying purchases.