Large models of multimodal interactions

"Xunfei Open Platform" public number announced this evening that Xunfei Starfire multimodal interaction model is officially online, which is expanded from voice interaction to real-time multimodal interaction in audio and video streams, with new "multimodal, super anthropomorphic and personalized" capabilities, realizing three-in-one voice, visual, and digital human interaction, supporting one-click call. The new "multimodal, super anthropomorphic and personalized" capability realizes voice, visual and digital human interaction in one, and supports one-key call. According to reports, Xunfei Starfire multimodal interaction model debut super anthropomorphic digital human technology, digital human torso and limb movements can accurately match the voice content, and quickly generate expressions and movements, so that the AI "lifelike". Through the unification of text, speech and expression, it can achieve cross-modal semantic consistency, thus making the big...