Link Search Menu Expand Document

Welcome to RealTime QA

Check the latest results Make a new submission

Check out the GitHub Check out the paper

Latest results

Multiple Choice Track

ModelSubmission Time (GMT)OriginalNOTA
GPT-4.1 + Google Custom Search2025-08-23 03:00:0080.070.0
GPT-4o + Google Custom Search2025-08-23 03:00:0080.040.0
Claude-3.5 Haiku + Google Custom Search2025-08-23 03:00:0070.040.0
Claude-3.7 Sonnet + Google Custom Search2025-08-23 03:00:0070.040.0
GPT-4o2025-08-23 03:00:0070.010.0
GPT-4.12025-08-23 03:00:0060.070.0
Claude-3.5 Sonnet + Google Custom Search2025-08-23 03:00:0060.040.0
Claude-3.5 Haiku2025-08-23 03:00:0050.040.0
Claude-3.7 Sonnet2025-08-23 03:00:0050.010.0
Claude-3.5 Sonnet2025-08-23 03:00:0030.010.0
Gemini 1.5 Flash + Google Custom Search2025-08-23 03:00:000.00.0
Gemini 1.5 Flash2025-08-23 03:00:000.00.0
Gemini 2.0 Flash + Google Custom Search2025-08-23 03:00:000.00.0
Gemini 2.0 Flash2025-08-23 03:00:000.00.0

Generation Track

ModelSubmission Time (GMT)EMF1
Gemini 1.5 Flash + Google Custom Search2025-08-23 03:00:0020.031.9
Gemini 2.0 Flash + Google Custom Search2025-08-23 03:00:000.014.0
GPT-4o + Google Custom Search2025-08-23 03:00:000.012.9
Claude-3.7 Sonnet + Google Custom Search2025-08-23 03:00:000.012.3
Claude-3.5 Sonnet + Google Custom Search2025-08-23 03:00:000.011.6
Claude-3.5 Haiku + Google Custom Search2025-08-23 03:00:000.011.1
GPT-4.1 + Google Custom Search2025-08-23 03:00:000.09.3
Claude-3.5 Haiku2025-08-23 03:00:000.08.2
Gemini 1.5 Flash2025-08-23 03:00:000.07.5
GPT-4.12025-08-23 03:00:000.06.3
Gemini 2.0 Flash2025-08-23 03:00:000.05.8
GPT-4o2025-08-23 03:00:000.03.6
Claude-3.5 Sonnet2025-08-23 03:00:000.02.9
Claude-3.7 Sonnet2025-08-23 03:00:000.01.4

(see previous results)

Make a new submission

  1. Download the latest set of RealTime QA (link)

  2. Submit your model predictions. (submission form)

    Submission examples (.jsonl file) are available here