{"id":6927,"date":"2024-04-02T09:15:05","date_gmt":"2024-04-02T01:15:05","guid":{"rendered":"https:\/\/www.1ai.net\/?p=6927"},"modified":"2024-04-02T09:15:05","modified_gmt":"2024-04-02T01:15:05","slug":"%e9%81%8f%e5%88%b6-ai-%e5%a4%b1%e6%8e%a7%ef%bc%8c%e5%be%ae%e8%bd%af%e5%8f%91%e5%b8%83%e7%b3%bb%e5%88%97%e5%b7%a5%e5%85%b7%e5%87%8f%e5%b0%91-copilot%e5%b9%bb%e8%a7%89%e6%83%85","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/6927.html","title":{"rendered":"To curb AI out of control, Microsoft released a series of tools to reduce Copilot &quot;hallucination&quot; situations"},"content":{"rendered":"<p data-vmark=\"51ea\">Behind the popularity of generative AI, security, privacy and reliability issues are becoming increasingly prominent.<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e5%be%ae%e8%bd%af\" title=\"[View articles tagged with [Microsoft]]\" target=\"_blank\" >Microsoft<\/a>In order to prevent the occurrence of Supremacy AGI (AI that claims to control the human world),<strong>A series of solutions have been launched recently to prevent generative AI from getting out of control.<\/strong><\/p>\n<p data-vmark=\"d293\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-6928\" title=\"f5aadccb-c9cb-478e-9cb7-1b5cc203e0cc\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/04\/f5aadccb-c9cb-478e-9cb7-1b5cc203e0cc.jpg\" alt=\"f5aadccb-c9cb-478e-9cb7-1b5cc203e0cc\" width=\"1024\" height=\"576\" \/><\/p>\n<p data-vmark=\"daea\">Microsoft said in an official announcement: &quot;How generative AI can effectively prevent prompt word injection attacks has become a major challenge. In this attack, malicious actors try to manipulate artificial intelligence systems to do something beyond their intended purpose, such as creating harmful content or leaking confidential data.&quot;<\/p>\n<p data-vmark=\"5a40\">Microsoft first restricted <a href=\"https:\/\/www.1ai.net\/en\/tag\/copilot\" title=\"[View articles tagged with [Copilot]]\" target=\"_blank\" >Copilot<\/a> the number of characters to mitigate serious hallucinations. In addition, Microsoft introduced the \u201cBasic Test\u201d function, designed to help users recognize text-based hallucinations\u3002<\/p>\n<p data-vmark=\"e9e3\">This feature will automatically detect \u201cungrounded material\u201d in text to support the quality of LLM output, ultimately improving quality and confidence.<\/p>\n<p data-vmark=\"885b\">The relevant tools are introduced as follows:<\/p>\n<ul class=\"list-paddingleft-2\">\n<li>\n<p data-vmark=\"d33e\">Prompt Shields: for detecting and blocking prompt injection attacks. Includes new models for identifying indirect prompt attacks before they impact your models, coming soon and now available in preview in Azure AI Content Safety.<\/p>\n<\/li>\n<li>\n<p data-vmark=\"c6f9\">Groundedness detection: Mainly used to detect &quot;hallucination&quot; situations in model output, coming soon.<\/p>\n<\/li>\n<li>\n<p data-vmark=\"f7bc\">Safety system messages: Guide your model in a safe and responsible direction.<\/p>\n<\/li>\n<li>\n<p data-vmark=\"e8be\">Safety evaluations: used to evaluate the vulnerability of applications to jailbreak attacks and generated content risks, now available in preview.<\/p>\n<\/li>\n<li>\n<p data-vmark=\"6548\">Risk and safety monitoring: Understand which model inputs, outputs, and end users trigger content filters to inform risk mitigation, coming soon and currently in preview on the Azure OpenAI service.<\/p>\n<\/li>\n<\/ul>","protected":false},"excerpt":{"rendered":"<p>The issues of safety, privacy and reliability are also becoming more prominent behind the fire of the Generating AI. Microsoft has recently launched a series of solutions to contain events such as the Supremacy AGI, which claims to control the human world, to prevent the generation of AI from losing control. In its official bulletin, Microsoft states: \u201cHow effectively the Generating AI prevents the introduction of hints into attacks has become a major challenge. In such attacks, malicious actors attempt to manipulate artificial intelligence systems to do things that exceed their intended purpose, such as the production of harmful content or the release of confidential data.\u201d Microsoft first limited the number of characters in Copilot to mitigate serious hallucinations. In addition, Microsoft introduced the Basic Test<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[146],"tags":[442,280],"collection":[],"class_list":["post-6927","post","type-post","status-publish","format-standard","hentry","category-news","tag-copilot","tag-280"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/6927","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=6927"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/6927\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=6927"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=6927"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=6927"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=6927"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}