Guides
Guides for AI evaluators
Free, practical guides to AI evaluation work: what AI evaluators do, how to prepare for platform assessments, and how to write strong A vs B justifications.
Getting started
What AI evaluators do and how people get into the work.
- What Does an AI Evaluator Do? A Beginner’s GuideLearn what an AI evaluator does, how to judge answers using evidence, and how to practise with a worked example before your first AtomicEval challenge.5 min read · 14 Oct 2026
- Why AI Evaluation Matters—and What the Work Can PayExplore why AI evaluation matters, the skills behind the work, and quoted pay examples from hiring platforms, with context for beginners and Indian applicants.5 min read · 14 Oct 2026
Platform test prep
How to prepare for the assessments AI training platforms use.
Evaluation skills
Comparing responses, writing justifications and using rubrics.
- Ten Common Beginner AI Evaluation Mistakes—and How to Fix ThemAvoid ten beginner AI evaluation mistakes with practical fixes, a worked example, and a short exercise to help you judge responses and explain your choices.6 min read · 14 Oct 2026
- Why Do LLMs Hallucinate? What OpenAI's Research ExplainsLearn what OpenAI's research explains about LLM hallucinations, why guessing can earn rewards, and how to evaluate factual answers and uncertainty with care.6 min read · 14 Oct 2026