SimpleQA

On October 31, OpenAI announced that it is open-sourcing a new benchmark called SimpleQA, which measures the ability of language models to answer short fact-seeking questions, in order to measure the accuracy of language models. One of the open challenges in AI is how to train models to generate factually correct answers. Current language models sometimes produce incorrect output or unsubstantiated answers, a problem known as "hallucinations". Language models that can generate more accurate and less illusory answers are more reliable and can be used...