In recent years, the transparency of mainstream models in the field of artificial intelligence has become a focus. Stanford University, MIT, Princeton University and other institutions have jointly proposed the "Basic Model Transparency Index" to evaluate the transparency of the top ten mainstream AI models.AI modelsThe results show thatLlama2ndFirstly, while models such as GPT-4 have poor transparency.
Despite the growing social impact of AI models, there are still many questions about how these models are built, trained, and used, including data sources and labor treatment. However, the evaluation system has also sparked some controversy, with some developers believing that it is too naive to require companies to disclose trade secrets.
Paper address: https://arxiv.org/pdf/2310.12941.pdf
Nevertheless, transparency is crucial to the development and application of AI models, especially in the field of generative AI, because models have the potential to improve productivity and may also be used to harm others. Lack of transparency may lead to the abuse of models, so developers need to pay more attention to transparency, including the disclosure of model construction, functions, and risks, etc.
However, most major basic model developers currently fail to provide sufficient transparency, which highlights the urgent need for transparency improvement in the AI industry. At the same time, open-source basic models such as Llama2 and BLOOMZ have received high scores, but there is still room for improvement because only a very small number of developers transparently display the limitations and other key information of the model.
In the current policy debate, whether AI models should be open source has become a controversial focus, but transparency remains a key factor regardless of open source or closed source to ensure that the negative impact of AI models is controlled.