{"id":3009,"date":"2024-01-19T10:02:00","date_gmt":"2024-01-19T02:02:00","guid":{"rendered":"https:\/\/www.1ai.net\/?p=3009"},"modified":"2024-01-19T10:02:00","modified_gmt":"2024-01-19T02:02:00","slug":"%e5%8d%a1%e5%86%85%e5%9f%ba%e5%a4%a7%e5%ad%a6%e5%bc%80%e6%ba%90tofu%e6%a1%86%e6%9e%b6%ef%bc%8c%e5%b8%ae%e5%8a%a9%e5%a4%a7%e6%a8%a1%e5%9e%8b%e9%81%97%e5%bf%98%e9%9a%90%e7%a7%81%e6%95%b0%e6%8d%ae","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/3009.html","title":{"rendered":"Carnegie University open-sources TOFU framework to help large models forget private data"},"content":{"rendered":"

The TOFU framework is a tool designed to improve the security of large models.Carnegie Mellon University<\/a>Developed by researchers. The framework includes multiple modules such as forgetting, data sets, and evaluation to help developers improve the security of large models.<\/p>\n

\"\"<\/p>\n

Paper address: https:\/\/arxiv.org\/pdf\/2401.06121.pdf<\/p>\n

The TOFU dataset is dedicated to helping developers better understand the forgetting process of large models and provides a new evaluation scheme that covers the comparison of forgetting quality and model utility. The TOFU forgetting module can help developers remove sensitive data from large language models, making them behave as if they have never learned the forgotten data.<\/p>\n

One of the core functions of the TOFU framework is the forget module, which helps developers remove sensitive data from a large language model so that it behaves as if it has never learned the forgotten data. The forget module needs to adjust the model based on the data in the forget set to achieve the forget effect.<\/p>\n

It mainly includes two methods: parameter adjustment and sample selection. Parameter adjustment modifies the parameters of the model and retrains the model to reduce its dependence on the forgetting set, thereby achieving the effect of forgetting sensitive information. Sample selection selectively uses samples from the forgetting dataset to gradually forget the sensitive information or correlation related to these samples for screening, so as to remove sensitive data more specifically.<\/p>\n

In summary, the release of the TOFU framework provides strong support for the security of large models. The datasets and evaluation schemes it contains provide developers with more tools and methods to protect user privacy data. The implementation of the forget module provides a practical solution for the secure application of large models.Open Source<\/a>It will bring new impetus and direction to the development of the entire field.<\/p>","protected":false},"excerpt":{"rendered":"

The TOFU framework is a tool designed to improve the security of large models, developed by researchers at Carnegie Mellon University. The framework contains several modules such as forgetting, datasets, and evaluation to help developers improve the security of large models. The paper address:https:\/\/arxiv.org\/pdf\/2401.06121.pdf TOFU dataset, on the other hand, is dedicated to helping developers gain a deeper understanding of the process of forgetting in big models, and provides a new evaluation scheme that covers the comparison of both forgetting quality and model utility.TOFU's forgetting module helps developers remove from big language models sensitive data from a big language model so that it behaves as if it has never learned the forgotten data. One of the core features of the TOFU framework is the forgetting module, which helps the<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[146],"tags":[957,219],"collection":[],"class_list":["post-3009","post","type-post","status-publish","format-standard","hentry","category-news","tag-957","tag-219"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/3009","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=3009"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/3009\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=3009"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=3009"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=3009"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=3009"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}