Skip to content
HARBAN AI LABS
HARBAN AI LABS
Work with us

Search

Search

Find paper breakdowns, models, benchmarks, AI tools, services and guides across the site.

4 results for “MMLU”

Paper breakdowns

1 paper breakdown
  1. Chinchilla: how to split a compute budget between model size and training dataA technical reading of the 2022 paper that concluded large language models were undertrained — the three ways it estimated compute-optimal scaling, the Chinchilla-versus-Gopher test, and why later work revisits the recipe./research/chinchilla-compute-optimal-training

Benchmarks

2 benchmarks
  1. MMLU-ProReasoning-heavy knowledge questions across 14 disciplines with ten answer options per question (~12K items)./benchmarks/mmlu-pro
  2. Measuring Massive Multitask Language Understanding (MMLU)Broad academic and professional knowledge across 57 subjects via four-option multiple-choice questions./benchmarks/mmlu

Articles

1 article
  1. How to read an AI benchmark table without fooling yourselfEight questions to ask before you trust a row on a leaderboard: who ran it, which version, under what settings, whether the benchmark still separates models, whether the model has seen it, what the grader checks, how big the noise is, and which harness produced it./insights/how-to-read-an-ai-benchmark-table

Model registry/models
Benchmarks/benchmarks
Paper breakdowns/research
AI tools directory/tools
Work with us/work-with-us