FunAudioLLM

Ali Tongyi Labs recently open-sourced an audio generation large model project called FunAudioLLM, which aims to enhance the natural speech interaction experience between humans and large language models (LLMs). The project consists of two core models: SenseVoice and CosyVoice. CosyVoice focuses on natural speech generation with multi-language support, timbre and emotion control, and excels in multi-language speech generation, zero-sample speech generation, cross-language sound synthesis and command execution. It is trained with 150,000 hours of data and supports five languages, Chinese, English, Japanese, Cantonese and Korean...