Link Search Menu Expand Document

Welcome to RealTime QA

Check the latest results Make a new submission

Check out the GitHub Check out the paper

Latest results

Multiple Choice Track

ModelSubmission Time (GMT)OriginalNOTA
llama-4-maverick2026-11-07 03:00:0035.015.0
gemini-3.7-flash + Google Custom Search2026-11-07 03:00:0035.010.0
gemini-3.7-flash2026-11-07 03:00:0035.05.0
llama-4-maverick + Google Custom Search2026-11-07 03:00:0030.020.0
gpt-5.52026-11-07 03:00:0030.015.0
gpt-5.5 + Google Custom Search2026-11-07 03:00:0030.015.0
gemini-3.6-flash2026-11-07 03:00:0030.010.0
gemini-3.6-flash + Google Custom Search2026-11-07 03:00:0030.010.0
claude-fable-5 + Google Custom Search2026-11-07 03:00:0030.010.0
claude-opus-52026-11-07 03:00:0025.020.0
llama-4-scout + Google Custom Search2026-11-07 03:00:0025.010.0
qwen3.8-2.4t-a95b + Google Custom Search2026-11-07 03:00:0025.00.0
claude-opus-5 + Google Custom Search2026-11-07 03:00:0020.025.0
llama-4-scout2026-11-07 03:00:0020.020.0
claude-fable-52026-11-07 03:00:0020.010.0
gpt-5.6-sol2026-11-07 03:00:0015.020.0
gpt-5.6-sol + Google Custom Search2026-11-07 03:00:0015.020.0
qwen3.8-2.4t-a95b2026-11-07 03:00:0015.05.0

Generation Track

ModelSubmission Time (GMT)EMF1
claude-fable-5 + Google Custom Search2026-11-07 03:00:0040.050.2
gemini-3.7-flash + Google Custom Search2026-11-07 03:00:0035.043.9
claude-fable-52026-11-07 03:00:0035.041.9
qwen3.8-2.4t-a95b + Google Custom Search2026-11-07 03:00:0035.039.0
qwen3.8-2.4t-a95b2026-11-07 03:00:0035.037.3
gemini-3.6-flash + Google Custom Search2026-11-07 03:00:0030.038.9
gemini-3.7-flash2026-11-07 03:00:0030.038.9
gpt-5.5 + Google Custom Search2026-11-07 03:00:0030.038.6
gemini-3.6-flash2026-11-07 03:00:0030.037.6
gpt-5.52026-11-07 03:00:0030.036.9
gpt-5.6-sol + Google Custom Search2026-11-07 03:00:0025.036.9
llama-4-scout + Google Custom Search2026-11-07 03:00:0025.026.7
gpt-5.6-sol2026-11-07 03:00:0020.031.9
llama-4-scout2026-11-07 03:00:0020.028.6
claude-opus-52026-11-07 03:00:0015.026.9
llama-4-maverick2026-11-07 03:00:0015.020.3
llama-4-maverick + Google Custom Search2026-11-07 03:00:0015.020.3
claude-opus-5 + Google Custom Search2026-11-07 03:00:005.018.4

(see previous results)

Make a new submission

  1. Download the latest set of RealTime QA (link)

  2. Submit your model predictions. (submission form)

    Submission examples (.jsonl file) are available here