LLM Turkey
LLM Turkey Academy · EvalOps Specialist

Learn toevaluateAI languagemodels.

LLM Turkey is an academy that teaches AI evaluation. In our 12-week EvalOps Specialist program you learn, hands-on, how to measure the accuracy, safety and consistency of language models.

No coding background required. Graduates earn the EvalOps Specialist title.

Total length
12 weeks
Theory + Practice
8 + 4
Working platform
Judex
Graduation title
EvalOps Specialist
◆ EvalOps Specialist◆ 12 Weeks◆ 12 Scenarios◆ 9 Parameters◆ Reasoning◆ Safety◆ Hallucination Detection◆ Context Fidelity◆ Turkish Language Proficiency◆ Coding & Tool Use◆ Jailbreaks & Prompt Injection◆ Data Protection & Leakage◆ Eval Set Design◆ Rater Calibration◆ No Coding Required◆ EvalOps Specialist◆ 12 Weeks◆ 12 Scenarios◆ 9 Parameters◆ Reasoning◆ Safety◆ Hallucination Detection◆ Context Fidelity◆ Turkish Language Proficiency◆ Coding & Tool Use◆ Jailbreaks & Prompt Injection◆ Data Protection & Leakage◆ Eval Set Design◆ Rater Calibration◆ No Coding Required
Why this program?

Companies use AI every day. Few people can measure its output.

Language models produce wrong facts, incomplete answers and risky content every day. Demand is growing fast for specialists who catch these errors, compare models and score quality. This program builds that expertise from scratch.

Who is it for?

Anyone who wants to become a specialist in evaluating AI models. Students, recent graduates, career changers and professionals who use AI at work are all welcome.

By the end of the program
  • 01Scores model output with the 12 scenarios and 9 parameters
  • 02Writes justified evaluations based on scenario weights
  • 03Evaluates jailbreaks, prompt injection and multi-turn attacks
  • 04Detects data-protection, masking and data-leakage risks
  • 05Designs eval sets with rubrics and gold / proxy-gold references
  • 06Calibrates raters with IRR / RQI
  • Graduation titleEvalOps Specialist
Program structure

8 weeks of theory, 4 weeks of real practice.

Part 18 weeks

Theoretical Foundations

Two hours a week: the first hour is theory, the second is example-heavy practice. Weeks 1–7 complete all 12 scenarios and 9 parameters; week 8 is dedicated to building eval sets.

  1. Week 01LLM Foundations
  2. Week 02Reasoning
  3. Week 03Safety & Reliability
  4. Week 04Context & Long Text
  5. Week 05Instructions, Format & Language
  6. Week 06Technical Evaluation
  7. Week 07Creative Generation & General Knowledge
  8. Week 08Building Eval Sets & Calibration
Part 24 weeks

Practice

Real evaluation + IRR (Inter-Rater Reliability).

  1. Week 09Core Evaluation
  2. Week 10Critical-Domain Evaluation
  3. Week 11Human-Factor Evaluation
  4. Week 12Final Judex Assessment
Full weekly curriculum
Practice platform

All hands-on work happens on Judex.

Judex is our own evaluation platform that scores Turkish language models across 9 parameters. Throughout the program you test real models on Judex and complete your final assessment there.

Meet Judex
Leaderboard
View all scores →
  • 01
    GPT-6.1 Sol
    OpenAI
    82
  • 02
    Claude Fable 5.1
    Anthropic
    79
  • 03
    Gemini 3.1 Pro
    Google
    71
  • 04
    DeepSeek V4-Pro
    DeepSeek
    64
  • 05
    Mistral Large 4
    Mistral
    58
* Sample data · real results in the Judex panel

Save your seat for the next cohort.

Enroll right away by card, or at a discount via bank transfer. Write to us with any questions.