Hallucination test

March 19 news, 1AI learned from the official WeChat public number of the China Academy of Information and Communication Technology, in order to find out the current situation of the big model hallucination, and to promote the application of the big model to go deep and practical, the Artificial Intelligence Institute of the China Academy of Information and Communication Technology initiated the big model hallucination test based on the previous AI Safety Benchmark measurement work. Big model hallucination (AI Hallucination) refers to the fact that when generating content or answering questions, the model produces content that appears to be reasonable, but in fact is inconsistent with user input (faithfulness hallucination) or does not conform to the facts (factual hallucination). With big models in healthcare ...