{"id":15798,"date":"2024-07-18T08:42:57","date_gmt":"2024-07-18T00:42:57","guid":{"rendered":"https:\/\/www.1ai.net\/?p=15798"},"modified":"2024-07-18T08:42:57","modified_gmt":"2024-07-18T00:42:57","slug":"%e6%99%ba%e6%ba%90%e7%a0%94%e7%a9%b6%e9%99%a2%e6%8e%a8%e5%87%ba%e6%96%b0%e4%b8%80%e4%bb%a3%e6%97%a0%e7%bc%96%e7%a0%81%e5%99%a8%e8%a7%86%e8%a7%89%e8%af%ad%e8%a8%80%e5%a4%9a%e6%a8%a1%e6%80%81%e5%a4%a7","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/15798.html","title":{"rendered":"AI Research Institute launches a new generation of encoder-free visual language multimodal large model EVE"},"content":{"rendered":"<p>\u8fd1\u671f\uff0c<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e5%a4%9a%e6%a8%a1%e6%80%81%e5%a4%a7%e6%a8%a1%e5%9e%8b\" title=\"\u3010\u67e5\u770b\u542b\u6709[\u591a\u6a21\u6001\u5927\u6a21\u578b]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">\u591a\u6a21\u6001\u5927\u6a21\u578b<\/a>\u7684\u7814\u7a76\u548c\u5e94\u7528\u53d6\u5f97\u4e86\u663e\u8457\u8fdb\u5c55\u3002\u56fd\u5916\u516c\u53f8\u5982OpenAI\u3001Google\u3001Microsoft\u7b49\u63a8\u51fa\u4e86\u4e00\u7cfb\u5217\u5148\u8fdb\u7684\u6a21\u578b\uff0c\u56fd\u5185\u4e5f\u6709\u667a\u8c31AI\u3001\u9636\u8dc3\u661f\u8fb0\u7b49\u673a\u6784\u5728\u8be5\u9886\u57df\u53d6\u5f97\u4e86\u7a81\u7834\u3002\u8fd9\u4e9b\u6a21\u578b\u901a\u5e38\u4f9d\u8d56\u89c6\u89c9\u7f16\u7801\u5668\u6765\u63d0\u53d6\u89c6\u89c9\u7279\u5f81\u5e76\u4e0e\u5927\u8bed\u8a00\u6a21\u578b\u7ed3\u5408\uff0c\u4f46\u5b58\u5728\u8bad\u7ec3\u5206\u79bb\u5bfc\u81f4\u7684\u89c6\u89c9\u5f52\u7eb3\u504f\u7f6e\u95ee\u9898\uff0c\u9650\u5236\u4e86\u591a\u6a21\u6001\u5927\u6a21\u578b\u7684\u90e8\u7f72\u6548\u7387\u548c\u6027\u80fd\u3002<\/p>\n<p>\u4e3a\u89e3\u51b3\u8fd9\u4e9b\u95ee\u9898\uff0c<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e6%99%ba%e6%ba%90%e7%a0%94%e7%a9%b6%e9%99%a2\" title=\"\u3010\u67e5\u770b\u542b\u6709[\u667a\u6e90\u7814\u7a76\u9662]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">\u667a\u6e90\u7814\u7a76\u9662<\/a>\u8054\u5408\u5927\u8fde\u7406\u5de5\u5927\u5b66\u3001\u5317\u4eac\u5927\u5b66\u7b49\u9ad8\u6821\u63a8\u51fa\u4e86\u65b0\u4e00\u4ee3\u65e0\u7f16\u7801\u5668\u7684\u89c6\u89c9\u8bed\u8a00\u6a21\u578bEVE\u3002EVE\u901a\u8fc7\u7cbe\u7ec6\u5316\u8bad\u7ec3\u7b56\u7565\u548c\u989d\u5916\u7684\u89c6\u89c9\u76d1\u7763\uff0c\u5c06\u89c6\u89c9-\u8bed\u8a00\u8868\u5f81\u3001\u5bf9\u9f50\u548c\u63a8\u7406\u6574\u5408\u5230\u7edf\u4e00\u7684\u7eaf\u89e3\u7801\u5668\u67b6\u6784\u4e2d\u3002\u4f7f\u7528\u516c\u5f00\u6570\u636e\uff0cEVE\u5728\u591a\u4e2a\u89c6\u89c9-\u8bed\u8a00\u57fa\u51c6\u6d4b\u8bd5\u4e2d\u8868\u73b0\u4f18\u5f02\uff0c\u63a5\u8fd1\u751a\u81f3\u4f18\u4e8e\u57fa\u4e8e\u7f16\u7801\u5668\u7684\u4e3b\u6d41\u591a\u6a21\u6001\u65b9\u6cd5\u3002<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-15799\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/07\/6385682080913376559203452.jpg\" alt=\"\" width=\"1000\" height=\"359\" \/><\/p>\n<p>EVE\u7684\u4e3b\u8981\u7279\u70b9\u5305\u62ec:<\/p>\n<ul>\n<li>\u539f\u751f\u89c6\u89c9\u8bed\u8a00\u6a21\u578b:\u53bb\u9664\u89c6\u89c9\u7f16\u7801\u5668\uff0c\u5904\u7406\u4efb\u610f\u56fe\u50cf\u957f\u5bbd\u6bd4\uff0c\u663e\u8457\u4f18\u4e8e\u540c\u7c7b\u578bFuyu-8B\u6a21\u578b\u3002<\/li>\n<li>\u6570\u636e\u548c\u8bad\u7ec3\u4ee3\u4ef7\u5c11:\u9884\u8bad\u7ec3\u4f7f\u7528OpenImages\u3001SAM\u548cLAION\u7b49\u516c\u5f00\u6570\u636e\uff0c\u8bad\u7ec3\u65f6\u95f4\u8f83\u77ed\u3002<\/li>\n<li>\u900f\u660e\u548c\u9ad8\u6548\u7684\u63a2\u7d22:\u4e3a\u7eaf\u89e3\u7801\u5668\u7684\u539f\u751f\u591a\u6a21\u6001\u67b6\u6784\u63d0\u4f9b\u4e86\u9ad8\u6548\u3001\u900f\u660e\u7684\u53d1\u5c55\u8def\u5f84\u3002<\/li>\n<\/ul>\n<p>\u6a21\u578b\u7ed3\u6784:<\/p>\n<ul>\n<li>Patch Embedding Layer:\u901a\u8fc7\u5355\u5c42\u5377\u79ef\u5c42\u548c\u5e73\u5747\u6c60\u5316\u5c42\u83b7\u53d6\u56fe\u50cf2D\u7279\u5f81\u56fe\uff0c\u589e\u5f3a\u5c40\u90e8\u7279\u5f81\u548c\u5168\u5c40\u4fe1\u606f\u3002<\/li>\n<li>Patch Aligning Layer:\u6574\u5408\u591a\u5c42\u7f51\u7edc\u89c6\u89c9\u7279\u5f81\uff0c\u5b9e\u73b0\u4e0e\u89c6\u89c9\u7f16\u7801\u5668\u8f93\u51fa\u7684\u7ec6\u7c92\u5ea6\u5bf9\u9f50\u3002<\/li>\n<\/ul>\n<p>\u8bad\u7ec3\u7b56\u7565:<\/p>\n<ul>\n<li>\u5927\u8bed\u8a00\u6a21\u578b\u5f15\u5bfc\u7684\u9884\u8bad\u7ec3\u9636\u6bb5:\u5efa\u7acb\u89c6\u89c9\u548c\u8bed\u8a00\u4e4b\u95f4\u7684\u521d\u6b65\u8054\u7cfb\u3002<\/li>\n<li>\u751f\u6210\u5f0f\u9884\u8bad\u7ec3\u9636\u6bb5:\u63d0\u9ad8\u6a21\u578b\u5bf9\u89c6\u89c9-\u8bed\u8a00\u5185\u5bb9\u7684\u7406\u89e3\u80fd\u529b\u3002<\/li>\n<li>\u76d1\u7763\u5f0f\u7684\u5fae\u8c03\u9636\u6bb5:\u89c4\u8303\u6a21\u578b\u9075\u5faa\u8bed\u8a00\u6307\u4ee4\u548c\u5b66\u4e60\u5bf9\u8bdd\u6a21\u5f0f\u7684\u80fd\u529b\u3002<\/li>\n<\/ul>\n<p>\u5b9a\u91cf\u5206\u6790:EVE\u5728\u591a\u4e2a\u89c6\u89c9\u8bed\u8a00\u57fa\u51c6\u6d4b\u8bd5\u4e2d\u8868\u73b0\u4f18\u5f02\uff0c\u4e0e\u591a\u79cd\u4e3b\u6d41\u7684\u57fa\u4e8e\u7f16\u7801\u5668\u7684\u89c6\u89c9\u8bed\u8a00\u6a21\u578b\u76f8\u5f53\u3002\u5c3d\u7ba1\u5728\u51c6\u786e\u54cd\u5e94\u7279\u5b9a\u6307\u4ee4\u65b9\u9762\u5b58\u5728\u6311\u6218\uff0c\u4f46\u901a\u8fc7\u9ad8\u6548\u7684\u8bad\u7ec3\u7b56\u7565\uff0cEVE\u5b9e\u73b0\u4e86\u4e0e\u5e26\u7f16\u7801\u5668\u57fa\u7840\u7684\u89c6\u89c9\u8bed\u8a00\u6a21\u578b\u76f8\u5f53\u7684\u6027\u80fd\u3002<\/p>\n<p>EVE\u5c55\u793a\u4e86\u65e0\u7f16\u7801\u5668\u539f\u751f\u89c6\u89c9\u8bed\u8a00\u6a21\u578b\u7684\u6f5c\u529b\uff0c\u672a\u6765\u53ef\u80fd\u901a\u8fc7\u8fdb\u4e00\u6b65\u7684\u6027\u80fd\u63d0\u5347\u3001\u65e0\u7f16\u7801\u5668\u67b6\u6784\u7684\u4f18\u5316\u548c\u539f\u751f\u591a\u6a21\u6001\u7684\u6784\u5efa\uff0c\u7ee7\u7eed\u63a8\u52a8\u591a\u6a21\u6001\u6a21\u578b\u7684\u53d1\u5c55\u3002<\/p>\n<p>\u8bba\u6587\u5730\u5740:\u00a0\u00a0https:\/\/arxiv.org\/abs\/2406.11832<\/p>\n<p>\u9879\u76ee\u4ee3\u7801:\u00a0\u00a0https:\/\/github.com\/baaivision\/EVE<\/p>\n<p>\u6a21\u578b\u5730\u5740:\u00a0\u00a0https:\/\/huggingface.co\/BAAI\/EVE-7B-HD-v1.0<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Recently, the research and application of multimodal large models have made significant progress. Foreign companies such as OpenAI, Google, and Microsoft have introduced a series of advanced models, and domestic organizations such as Smart Spectrum AI and Step Star have made breakthroughs in this field. These models usually rely on visual coders to extract visual features and combine them with large language models, but suffer from visual generalization bias due to training separation, which limits the deployment efficiency and performance of multimodal large models. To address these issues, Zhiyuan Research Institute, in conjunction with Dalian University of Technology and Peking University, has introduced EVE, a next-generation encoder-less visual language model.EVE integrates visual-linguistic representations, alignment, and inference into a unified pure decoder architecture through a refined training strategy and additional visual supervision. Using the public<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[146],"tags":[2258,602,1739],"collection":[],"class_list":["post-15798","post","type-post","status-publish","format-standard","hentry","category-news","tag-eve","tag-602","tag-1739"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/15798","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=15798"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/15798\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=15798"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=15798"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=15798"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=15798"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}