{"id":2193,"date":"2023-12-23T09:43:05","date_gmt":"2023-12-23T01:43:05","guid":{"rendered":"https:\/\/www.1ai.net\/?p=2193"},"modified":"2023-12-23T09:43:05","modified_gmt":"2023-12-23T01:43:05","slug":"%e6%89%b3%e5%9b%9e%e4%b8%80%e5%b1%80%ef%bc%81gemini-pro%e5%a4%9a%e6%a8%a1%e6%80%81%e8%83%bd%e5%8a%9b%e5%92%8cgpt-4v%e4%b8%8d%e7%9b%b8%e4%b8%8a%e4%b8%8b","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/2193.html","title":{"rendered":"Back in the game! Gemini-Pro&#039;s multimodal capabilities are on par with GPT-4V"},"content":{"rendered":"<p>\u8fd1\u671f\u7684<a href=\"https:\/\/www.1ai.net\/en\/tag\/gemini-pro\" title=\"\u3010\u67e5\u770b\u542b\u6709[Gemini-Pro]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">Gemini-Pro<\/a>\u8bc4\u6d4b\u62a5\u544a\u663e\u793a\u5176\u5728<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e5%a4%9a%e6%a8%a1%e6%80%81\" title=\"\u3010\u67e5\u770b\u542b\u6709[\u591a\u6a21\u6001]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">\u591a\u6a21\u6001<\/a>\u9886\u57df\u53d6\u5f97\u4e86\u663e\u8457\u7684\u8fdb\u5c55\uff0c\u4e0eGPT-4V\u4e0d\u76f8\u4e0a\u4e0b\uff0c\u751a\u81f3\u5728\u67d0\u4e9b\u65b9\u9762\u8868\u73b0\u66f4\u4e3a\u51fa\u8272\u3002\u9996\u5148\uff0c\u5728\u591a\u6a21\u6001\u4e13\u6709\u57fa\u51c6MME\u4e0a\u7684\u7efc\u5408\u8868\u73b0\u4e2d\uff0cGemini-Pro\u4ee51933.4\u7684\u9ad8\u5206\u8d85\u8d8a\u4e86GPT-4V\uff0c\u5c55\u73b0\u51fa\u5728\u611f\u77e5\u548c\u8ba4\u77e5\u65b9\u9762\u7684\u5168\u9762\u4f18\u52bf\u3002\u800c\u572837\u4e2a\u89c6\u89c9\u7406\u89e3\u4efb\u52a1\u4e2d\uff0cGemini-Pro\u5728\u6587\u672c\u7ffb\u8bd1\u3001\u989c\u8272\/\u5730\u6807\/\u4eba\u7269\u8bc6\u522b\u4ee5\u53caOCR\u7b49\u4efb\u52a1\u4e2d\u8868\u73b0\u7a81\u51fa\uff0c\u663e\u793a\u4e86\u5176\u5728\u57fa\u7840\u611f\u77e5\u9886\u57df\u7684\u5353\u8d8a\u80fd\u529b\u3002<\/p>\n<p class=\"article-content__img\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-2194\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2023\/12\/6383885329082789481304987.jpg\" alt=\"\" width=\"490\" height=\"438\" \/><\/p>\n<p>\u8bba\u6587\u5730\u5740:https:\/\/arxiv.org\/pdf\/2312.12436.pdf<\/p>\n<p>\u9879\u76ee\u5730\u5740:https:\/\/github.com\/BradyFU\/Awesome-Multimodal-Large-Language-Models<\/p>\n<p>\u7136\u800c\uff0c\u8bc4\u6d4b\u4e5f\u63ed\u793a\u4e86\u4e24\u8005\u7684\u5dee\u5f02\u3002\u5728\u540d\u4eba\u8bc6\u522b\u4efb\u52a1\u4e0a\uff0cGPT-4V\u7684\u5f97\u5206\u4e3a0\uff0c\u4e3b\u8981\u56e0\u5176\u62d2\u7edd\u56de\u7b54\u76f8\u5173\u95ee\u9898\u3002\u800c\u5728\u4f4d\u7f6e\u8bc6\u522b\u4efb\u52a1\u4e2d\uff0c\u4e24\u8005\u90fd\u5448\u73b0\u51fa\u4e0d\u4f73\u7684\u8868\u73b0\uff0c\u663e\u793a\u5b83\u4eec\u5bf9\u7a7a\u95f4\u4f4d\u7f6e\u4fe1\u606f\u7684\u4e0d\u654f\u611f\u3002\u6b64\u5916\uff0c\u5f00\u6e90\u6a21\u578bSPHINX\u5728\u611f\u77e5\u4efb\u52a1\u4e0a\u4e0eGPT-4V\u548cGemini\u5e73\u9f50\u751a\u81f3\u66f4\u4f18\uff0c\u4f46\u5728\u8ba4\u77e5\u65b9\u9762\u5b58\u5728\u8f83\u5927\u5dee\u8ddd\u3002<\/p>\n<p>\u8bc4\u6d4b\u62a5\u544a\u5206\u4e3a\u57fa\u7840\u611f\u77e5\u3001<span class=\"spamTxt\">\u9ad8\u7ea7<\/span>\u8ba4\u77e5\u3001\u6311\u6218\u6027\u89c6\u89c9\u4efb\u52a1\u548c\u5404\u79cd\u4e13\u5bb6\u80fd\u529b\u56db\u5927\u9886\u57df\uff0c\u5bf9Gemini-Pro\u7684\u89c6\u89c9\u7406\u89e3\u80fd\u529b\u8fdb\u884c\u4e86\u8be6\u7ec6\u8bc4\u4f30\u3002\u57fa\u7840\u611f\u77e5\u6d4b\u8bd5\u6db5\u76d6\u4e86\u5bf9\u8c61\u7ea7\u611f\u77e5\u3001\u573a\u666f\u7ea7\u611f\u77e5\u548c\u57fa\u4e8e\u77e5\u8bc6\u7684\u611f\u77e5\u80fd\u529b\uff0c\u5176\u4e2dGemini-Pro\u5728\u989c\u8272\/\u5730\u6807\/\u4eba\u7269\u8bc6\u522b\u548cOCR\u7b49\u4efb\u52a1\u4e2d\u7684\u8868\u73b0\u7a81\u51fa\u3002<\/p>\n<p><span class=\"spamTxt\">\u9ad8\u7ea7<\/span>\u8ba4\u77e5\u6d4b\u8bd5\u5219\u6d89\u53ca\u5bcc\u542b\u6587\u672c\u7684\u89c6\u89c9\u63a8\u7406\u3001\u62bd\u8c61\u89c6\u89c9\u63a8\u7406\u3001\u89e3\u51b3\u79d1\u5b66\u95ee\u9898\u3001\u60c5\u611f\u5206\u6790\u548c\u667a\u529b\u6e38\u620f\u7b49\u4efb\u52a1\uff0c\u663e\u793aGemini-Pro\u5728\u516c\u5f0f\u751f\u6210\u548c\u62bd\u8c61\u89c6\u89c9\u523a\u6fc0\u65b9\u9762\u53d6\u5f97\u826f\u597d\u6210\u7ee9\u3002<\/p>\n<p>\u6311\u6218\u6027\u89c6\u89c9\u4efb\u52a1\u5305\u62ec\u6307\u79f0\u8868\u8fbe\u5f0f\u7406\u89e3\u3001\u76ee\u6807\u8ddf\u8e2a\u548c\u89c6\u89c9\u6545\u4e8b\u751f\u6210\u7b49\uff0cGemini-Pro\u5728\u8fd9\u4e9b\u4efb\u52a1\u4e2d\u5c55\u73b0\u4e86\u6df1\u539a\u7684\u89c6\u89c9\u611f\u77e5\u548c\u7406\u89e3\u80fd\u529b\u3002\u6700\u540e\uff0c\u5404\u79cd\u4e13\u5bb6\u80fd\u529b\u6d4b\u8bd5\u6d89\u53ca\u7f3a\u9677\u68c0\u6d4b\u548c\u7ecf\u6d4e\u5206\u6790\u7b49\u4efb\u52a1\uff0cGemini-Pro\u5728\u80a1\u4ef7\u8d70\u52bf\u56fe\u7684\u5206\u6790\u4e0a\u663e\u793a\u4e86\u51fa\u8272\u7684\u4e13\u4e1a\u77e5\u8bc6\u3002\u7136\u800c\uff0c\u8bc4\u6d4b\u4e5f\u6307\u51faGemini-Pro\u5728\u4e00\u4e9b\u4efb\u52a1\u4e0a\u5b58\u5728\u5e7b\u89c9\u95ee\u9898\uff0c\u9700\u8981\u8fdb\u4e00\u6b65\u6539\u8fdb\u3002<\/p>\n<p>Gemini-Pro\u5728\u591a\u6a21\u6001\u9886\u57df\u53d6\u5f97\u4e86\u4ee4\u4eba\u77a9\u76ee\u7684\u6210\u5c31\uff0c\u5c55\u73b0\u4e86\u5176\u5728\u89c6\u89c9\u7406\u89e3\u80fd\u529b\u4e0a\u7684\u5f3a\u5927\u6f5c\u529b\u3002\u7136\u800c\uff0c\u8bc4\u6d4b\u4e5f\u7a81\u663e\u4e86\u5728\u7279\u5b9a\u4efb\u52a1\u548c\u9886\u57df\u4ecd\u9700\u8fdb\u4e00\u6b65\u63d0\u5347\u7684\u7a7a\u95f4\u3002Gemini-Pro\u7684\u8868\u73b0\u8868\u660e\u4e86\u591a\u6a21\u6001\u6280\u672f\u7684\u6f5c\u5728\u5a01\u529b\uff0c\u4e3a\u672a\u6765\u7684\u7814\u7a76\u548c\u5e94\u7528\u63d0\u4f9b\u4e86\u6709\u76ca\u7684\u542f\u793a\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The recent Gemini-Pro review report shows that it has made significant progress in the multimodal domain, on par with the GPT-4V, and even outperforming it in some aspects. First, in the overall performance on the proprietary multimodal benchmark MME, Gemini-Pro surpassed GPT-4V with a high score of 1933.4, demonstrating comprehensive advantages in perception and cognition. And among the 37 visual understanding tasks, Gemini-Pro excelled in text translation, color\/landmark\/people recognition, and OCR, demonstrating its superior ability in the basic perceptual domain. Paper address:https:\/\/arxiv.org\/pdf\/2312.12436.pdf Project address:https:\/\/gith<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[146],"tags":[741,592],"collection":[],"class_list":["post-2193","post","type-post","status-publish","format-standard","hentry","category-news","tag-gemini-pro","tag-592"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/2193","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=2193"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/2193\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=2193"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=2193"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=2193"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=2193"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}