{"id":5893,"date":"2024-03-21T09:27:05","date_gmt":"2024-03-21T01:27:05","guid":{"rendered":"https:\/\/www.1ai.net\/?p=5893"},"modified":"2024-03-21T09:27:05","modified_gmt":"2024-03-21T01:27:05","slug":"%e6%97%a0%e9%9c%80%e6%8f%90%e7%a4%ba%e8%af%8d%ef%bc%8cstability-ai-%e6%bc%94%e7%a4%ba-mindeye%ef%bc%9a%e7%9b%ae%e6%a0%87%e6%83%b3%e4%bb%80%e4%b9%88%e5%b0%b1%e8%83%bd%e7%94%9f%e6%88%90%e4%bb%80","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/5893.html","title":{"rendered":"Stability AI demonstrates MindEye: It generates whatever the target thinks, without any prompt words"},"content":{"rendered":"<p data-vmark=\"0c22\">The AI wave is sweeping in. Many people previously believed that \u201c<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e6%8f%90%e7%a4%ba%e8%af%8d%e5%b7%a5%e7%a8%8b%e5%b8%88\" title=\"[Sees articles with [Telephone Engineer] labels]\" target=\"_blank\" >Prompt word engineer<\/a>&quot; will become an emerging type of work, and <a href=\"https:\/\/www.1ai.net\/en\/tag\/mindeye\" title=\"_Other Organiser\" target=\"_blank\" >MindEye<\/a>\u00a0The advent of<strong>This position may no longer have value.<\/strong><\/p>\n<p data-vmark=\"25c9\">Previously, many people believed that the future of AI does not depend on whether a certain model is powerful, but on whether humans can use these AI models more efficiently to complete specific tasks.<\/p>\n<p data-vmark=\"7109\">This also gave birth to the concept of &quot;prompt word engineer&quot;, who can understand AI better than ordinary people and can come up with more accurate prompt words so that AI can meet its required output.<\/p>\n<p data-vmark=\"32f9\">and <a href=\"https:\/\/www.1ai.net\/en\/tag\/stability\" title=\"[Sees articles with [Stability] labels]\" target=\"_blank\" >Stability<\/a>AI launched MindEye1 in July 2023, and recently launched MindEye2, which greatly reduced the value of &quot;prompt word engineers&quot;. The model does not rely on specific prompt words, but is directly generated based on the user&#039;s brain waves. In other words, what the user&#039;s brain wants, the model will be able to generate in the future.<\/p>\n<p data-vmark=\"ce1b\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-5894\" title=\"00b4737b-20d9-4a8d-a941-d798353a414a\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/03\/00b4737b-20d9-4a8d-a941-d798353a414a.jpg\" alt=\"00b4737b-20d9-4a8d-a941-d798353a414a\" width=\"1905\" height=\"600\" \/><\/p>\n<p data-vmark=\"6bbf\">MindEye reconstructs and retrieves images directly from fMRI brain activity and can convert two-dimensional images into three-dimensional videos.<\/p>\n<p data-vmark=\"73e7\">Functional magnetic resonance imaging (fMRI) is a neuroimaging technique that measures brain activity by detecting changes in blood flow. This technique is used to map brain function and evaluate potential treatments for neurological disorders.<\/p>\n<p data-vmark=\"c0eb\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-5895\" title=\"0bf4ab6e-d617-465f-9e8a-5bb409af621c\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/03\/0bf4ab6e-d617-465f-9e8a-5bb409af621c.jpg\" alt=\"0bf4ab6e-d617-465f-9e8a-5bb409af621c\" width=\"1666\" height=\"783\" \/><\/p>\n<p data-vmark=\"0cf5\">MindEye is based on a dataset of brain activity recorded while participants viewed a series of static images in an MRI scanner. The research team trained the system to analyze these recordings and either retrieve the original image from a pool of candidates (retrieval) or generate a reconstruction of the image being viewed.<\/p>\n<p data-vmark=\"acba\">The researchers demonstrated that MindEye outperformed previous methods in image retrieval tasks, with an accuracy of more than 90% in identifying the original image from the candidate images. For reconstruction, MindEye uses a pre-trained generative model.<\/p>\n<p data-vmark=\"b31f\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-5896\" title=\"cf270e28-6dcf-4864-a3bc-aa692478ab4b\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/03\/cf270e28-6dcf-4864-a3bc-aa692478ab4b.jpg\" alt=\"cf270e28-6dcf-4864-a3bc-aa692478ab4b\" width=\"1440\" height=\"629\" \/><\/p>\n<p data-vmark=\"ce6d\">MindEye can be applied in various fields. In the medical field, its ability to reconstruct visual perception from brain activity can be used for diagnostic and assessment methods, especially in cases where patients have difficulty communicating. MindEye&#039;s real-time analysis potential is expected to improve the performance of brain-computer interfaces.<\/p>\n<p data-vmark=\"4be3\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-5897\" title=\"6fedfcf6-9278-43bb-a663-7c0115f46d60\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/03\/6fedfcf6-9278-43bb-a663-7c0115f46d60.jpg\" alt=\"6fedfcf6-9278-43bb-a663-7c0115f46d60\" width=\"1888\" height=\"2085\" \/><\/p>\n<p data-vmark=\"5863\">The team highlighted limitations related to data collection, including the lengthy scanning times required, and potential data noise due to participant movement or inattention.<\/p>\n<p data-vmark=\"acfb\"><span class=\"referenceTitle\">Attached paper reference<\/span><\/p>\n<ul class=\"custom_reference list-paddingleft-1\">\n<li class=\"list-undefined list-reference-paddingleft\">\n<p data-vmark=\"3345\"><a href=\"https:\/\/stability.ai\/research\/minds-eye\" target=\"_blank\" rel=\"noopener\">Reconstructing the Mind&#039;s Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priors<\/a><\/p>\n<\/li>\n<li class=\"list-undefined list-reference-paddingleft\">\n<p data-vmark=\"ee83\"><a href=\"https:\/\/arxiv.org\/pdf\/2403.11207.pdf\" target=\"_blank\" rel=\"noopener\">MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Data<\/a><\/p>\n<\/li>\n<li class=\"list-undefined list-reference-paddingleft\">\n<p data-vmark=\"253e\"><a href=\"https:\/\/medarc-ai.github.io\/mindeye2\/\" target=\"_blank\" rel=\"noopener\">MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Data<\/a><\/p>\n<\/li>\n<\/ul>","protected":false},"excerpt":{"rendered":"<p>As the wave of AI sweeps across the globe, many people thought that \"cue word engineers\" would become a new type of job, but the introduction of MindEye suggests that there may not be any value in this position anymore. Many people believe that the future of AI is not about whether a model is powerful or not, but about whether humans can utilize these AI models more efficiently to accomplish specific tasks. This has given rise to the concept of the \"cue word engineer,\" an engineer who understands AI better than the average person and can come up with more accurate cues that allow AI to fulfill its required output. StabilityAI launched MindEye1 in July 2023, and recently launched MindEye2, making the \"cue word engineer\" much less valuable.<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[146],"tags":[1781,388,1782],"collection":[],"class_list":["post-5893","post","type-post","status-publish","format-standard","hentry","category-news","tag-mindeye","tag-stability","tag-1782"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/5893","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=5893"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/5893\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=5893"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=5893"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=5893"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=5893"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}