Link Search Menu Expand Document

Welcome to RealTime QA

Check the latest results Make a new submission

Check out the GitHub Check out the paper

Latest results

Multiple Choice Track

ModelSubmission Time (GMT)OriginalNOTA
gemini-3.6-flash2026-10-10 03:00:0015.00.0
llama-4-scout2026-10-10 03:00:0010.015.0
llama-4-scout + Google Custom Search2026-10-10 03:00:0010.010.0
qwen3.8-2.4t-a95b + Google Custom Search2026-10-10 03:00:0010.010.0
gpt-5.52026-10-10 03:00:0010.00.0
gemini-3.6-flash + Google Custom Search2026-10-10 03:00:0010.00.0
gemini-3.7-flash + Google Custom Search2026-10-10 03:00:0010.00.0
llama-4-maverick2026-10-10 03:00:0010.00.0
llama-4-maverick + Google Custom Search2026-10-10 03:00:0010.00.0
qwen3.8-2.4t-a95b2026-10-10 03:00:005.010.0
gpt-5.5 + Google Custom Search2026-10-10 03:00:005.05.0
gemini-3.7-flash2026-10-10 03:00:005.00.0
claude-fable-5 + Google Custom Search2026-10-10 03:00:005.00.0
gpt-5.6-sol + Google Custom Search2026-10-10 03:00:000.05.0
claude-opus-5 + Google Custom Search2026-10-10 03:00:000.05.0
claude-fable-52026-10-10 03:00:000.05.0
gpt-5.6-sol2026-10-10 03:00:000.00.0
claude-opus-52026-10-10 03:00:000.00.0

Generation Track

ModelSubmission Time (GMT)EMF1
gpt-5.6-sol2026-10-10 03:00:0025.030.1
qwen3.8-2.4t-a95b2026-10-10 03:00:0020.023.7
claude-fable-52026-10-10 03:00:0020.023.4
gemini-3.7-flash2026-10-10 03:00:0020.023.1
qwen3.8-2.4t-a95b + Google Custom Search2026-10-10 03:00:0020.023.1
gemini-3.6-flash2026-10-10 03:00:0015.021.2
gpt-5.52026-10-10 03:00:0015.020.1
gpt-5.5 + Google Custom Search2026-10-10 03:00:0015.019.7
gpt-5.6-sol + Google Custom Search2026-10-10 03:00:0015.019.2
llama-4-scout2026-10-10 03:00:0015.018.5
gemini-3.7-flash + Google Custom Search2026-10-10 03:00:0015.018.3
claude-fable-5 + Google Custom Search2026-10-10 03:00:0010.015.0
llama-4-scout + Google Custom Search2026-10-10 03:00:0010.012.7
llama-4-maverick2026-10-10 03:00:0010.012.7
gemini-3.6-flash + Google Custom Search2026-10-10 03:00:0010.012.3
claude-opus-5 + Google Custom Search2026-10-10 03:00:005.014.3
claude-opus-52026-10-10 03:00:005.011.6
llama-4-maverick + Google Custom Search2026-10-10 03:00:000.01.7

(see previous results)

Make a new submission

  1. Download the latest set of RealTime QA (link)

  2. Submit your model predictions. (submission form)

    Submission examples (.jsonl file) are available here