Results on March 17, 2023

Multiple Choice Track

| Model | Submission Time (GMT) | Original | NOTA | |:————-|:———|:———|:—–| «««< HEAD |GPT-3 + Google Custom Search|2023-03-18 03:00:00|53.3|40.0| |T5 (Closed-Book)|2023-03-18 03:00:00|46.7|26.7| |GPT-3 (Closed-Book)|2023-03-18 03:00:00|43.3|30.0| |RAG + Google Custom Search|2023-03-18 03:00:00|40.0|20.0| |GPT-3 + DPR|2023-03-18 03:00:00|33.3|26.7| |RAG + DPR|2023-03-18 03:00:00|33.3|20.0| ======= |GPT-3 + Google Custom Search|2023-03-18 03:00:00|63.3|36.7| |GPT-3 + DPR|2023-03-18 03:00:00|40.0|30.0| |RAG + Google Custom Search|2023-03-18 03:00:00|36.7|33.3| |GPT-3 (Closed-Book)|2023-03-18 03:00:00|36.7|23.3| |T5 (Closed-Book)|2023-03-18 03:00:00|36.7|20.0| |RAG + DPR|2023-03-18 03:00:00|30.0|26.7|

47d842d0f38fdcd993d4c8ee341c39ee5a6ae5bf

Generation Track

| Model | Submission Time (GMT) | EM | F1 | |:————-|:———|:———|:—–| «««< HEAD |GPT-3 + Google Custom Search|2023-03-18 03:00:00|24.1|35.8| |GPT-3 (Closed-Book)|2023-03-18 03:00:00|20.7|31.1| |T5 (Closed-Book)|2023-03-18 03:00:00|10.3|18.8| |GPT-3 + DPR|2023-03-18 03:00:00|10.3|16.6| |RAG + Google Custom Search|2023-03-18 03:00:00|0.0|0.0| |RAG + DPR|2023-03-18 03:00:00|0.0|0.0| ======= |GPT-3 + Google Custom Search|2023-03-18 03:00:00|41.4|55.8| |GPT-3 (Closed-Book)|2023-03-18 03:00:00|27.6|36.8| |GPT-3 + DPR|2023-03-18 03:00:00|20.7|27.0| |RAG + Google Custom Search|2023-03-18 03:00:00|17.2|25.1| |T5 (Closed-Book)|2023-03-18 03:00:00|10.3|14.6| |RAG + DPR|2023-03-18 03:00:00|0.0|5.1|

47d842d0f38fdcd993d4c8ee341c39ee5a6ae5bf