{"id":16493,"date":"2024-07-26T09:43:43","date_gmt":"2024-07-26T01:43:43","guid":{"rendered":"https:\/\/www.1ai.net\/?p=16493"},"modified":"2024-07-26T09:43:43","modified_gmt":"2024-07-26T01:43:43","slug":"%e5%9b%bd%e9%99%85%e9%a6%96%e4%b8%aa%ef%bc%8c%e6%88%91%e5%9b%bd%e5%9b%a2%e9%98%9f%e5%bc%80%e5%8f%91%e7%b3%96%e5%b0%bf%e7%97%85%e8%af%8a%e7%96%97%e5%a4%9a%e6%a8%a1%e6%80%81%e5%a4%a7%e6%a8%a1%e5%9e%8b-d","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/16493.html","title":{"rendered":"The first in the world, a Chinese team developed a multimodal large model for diabetes diagnosis and treatment, DeepDR-LLM"},"content":{"rendered":"

According to the official WeChat account of Shanghai Sixth People's Hospital, the team of Professor Jia Weiping and Professor Li Huating from the Shanghai Sixth People's Hospital affiliated to Shanghai Jiao Tong University School of Medicine, the team of Professor Sheng Bin from the Department of Computer Science, School of Electrical Engineering, Shanghai Jiao Tong University\/Key Laboratory of Artificial Intelligence, Ministry of Education, together with the team of Professor Huang Tianyin from Tsinghua University and the team of Professor Qin Yuzong from the National University of Singapore, have established a cross-disciplinary medical and engineering research project.The world's first multimodal integrated intelligent system of vision-large language model for diabetes diagnosis and treatment DeepDR-LLM<\/a><\/strong>The results were published in Nature Medicine on July 19, 2024 (titled Integrated image-based deep learning and language models for primary diabetes care).<\/p>\n

According to reports, the DeepDR-LLM system combines the advantages of large language models and deep learning technology to achieveMultimodal generation of medical imaging diagnosis and treatment opinions<\/strong>Function, can provideDiabetic retinopathy auxiliary diagnosis results<\/strong>andPersonalized comprehensive diabetes management advice<\/strong>.<\/p>\n

The system was retrospectively validated in a multicenter cohort covering seven countries in Asia, Africa and Europe, and prospectively validated in real-world settings for China's primary care. This is the first time that the system has provided the world with a comprehensive and reliable data set for the diabetes healthcare vertical.Multimodal large model<\/a>Application effectivenessHigh-quality evidence<\/strong>The research team said that the study proved that the DeepDR-LLM system canEffectively improve DR screening and primary diabetes management<\/strong>, providing a basis for future global diabetes governanceRevolutionary digital solutions<\/strong>.<\/p>\n

\"get-826\"<\/div>\n

Previous AI system research and development has mainly focused onDiabetes complications screening or auxiliary management<\/strong>With the rapid development of generative artificial intelligence technology represented by ChatGPT around the world, multimodal large models are constantly promoting the emergence of new application scenarios and models in the medical field, but these modelsNot yet<\/strong>Provide accurate and safe diabetes care based on the patient's medical images and specific conditionsComprehensive diagnosis and treatment recommendations<\/strong>.<\/p>\n

In response to the current technical gaps and actual clinical needs, the team successfully developed the world's first visual-large language model multimodal integrated intelligent system DeepDR-LLM for primary diagnosis and treatment of diabetes. It can be adapted to include LLaMA<\/strong> The LLM module integrates the training network layer with the inherent weight parameters of the large language model.Breaking through the bottleneck of multi-modal large model optimization under low computing resource constraints<\/strong>, and further based on 372,000 pieces of data and knowledge on diagnosis and treatment of chronic diseases and management of chronic diseases at the grassroots level<\/strong>Efficient optimization training has been achieved, enabling the DeepDR-LLM system to generate accurate diabetes management advice based on individual patients\u2019 clinical information.<\/p>\n

Attached research results:<\/p>\n

https:\/\/www.nature.com\/articles\/s41591-024-03139-8<\/p>\n

 <\/p>","protected":false},"excerpt":{"rendered":"

From the official public number of Shanghai Sixth People's Hospital, we learned that the team of Prof. Jia Weiping and Prof. Li Huating from the Sixth People's Hospital affiliated to Shanghai Jiaotong University School of Medicine, along with Prof. Sheng Bin's team from the Department of Computer Science, Electric College of Shanghai Jiaotong University \/ Key Laboratory of Artificial Intelligence of the Ministry of Education, and together with Prof. Huang Tianyin's team from Tsinghua University and Prof. Qin Yuzhong's team from National University of Singapore, have constructed the first multimodal integrated intelligent system for DeepDR-LLM, the first multimodal integrated visual-large language model for diabetes diagnosis and treatment in the world, was published in Nature Medicine on July 19, 2024 (Integrated image-based deep learning and language).<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[148,146],"tags":[3718,602],"collection":[],"class_list":["post-16493","post","type-post","status-publish","format-standard","hentry","category-headline","category-news","tag-deepdr-llm","tag-602"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/16493","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=16493"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/16493\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=16493"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=16493"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=16493"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=16493"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}