HealthBench

A few days ago, OpenAI announced an AI health system evaluation standard, 'HealthBench', which is claimed to be 'the most iconic of AGI'. Specifically, HealthBench aims to better measure the performance of AI systems in the medical field. The benchmark was created by OpenAI in collaboration with 262 doctors in 60 countries around the world, and includes 5,000 real medical conversations, each with a customized rating scale to evaluate the model's responses. HealthBench's model performance...