Link Search Menu Expand Document

Welcome to RealTime QA

Check the latest results Make a new submission

Check out the GitHub Check out the paper

Latest results

Multiple Choice Track

ModelSubmission Time (GMT)OriginalNOTA
GPT-3 + Google Custom Search2023-03-18 03:00:0063.336.7
GPT-3 + DPR2023-03-18 03:00:0040.030.0
RAG + Google Custom Search2023-03-18 03:00:0036.733.3
GPT-3 (Closed-Book)2023-03-18 03:00:0036.723.3
T5 (Closed-Book)2023-03-18 03:00:0036.720.0
RAG + DPR2023-03-18 03:00:0030.026.7

Generation Track

ModelSubmission Time (GMT)EMF1
GPT-3 + Google Custom Search2023-03-18 03:00:0041.455.8
GPT-3 (Closed-Book)2023-03-18 03:00:0027.636.8
GPT-3 + DPR2023-03-18 03:00:0020.727.0
RAG + Google Custom Search2023-03-18 03:00:0017.225.1
T5 (Closed-Book)2023-03-18 03:00:0010.314.6
RAG + DPR2023-03-18 03:00:000.05.1

(see previous results)

Make a new submission

  1. Download the latest set of RealTime QA (link)

  2. Submit your model predictions. (submission form)

    Submission examples (.jsonl file) are available here