Meta translation slayer NLLB200 makes it to Nature: translation quality improved by 44%

Meta releases No Language Left Behind (NLLB) model that supports 200 language translations with 441 TP3T of quality improvement, especially on low-resource languages; NLLB-200 adopts a sparse gated Mixed of Experts (MoE) architecture to optimize the processing performance of multi-language tasks by dynamically activating the expert network; the project uses an innovative data mining and multilingual co-training methods to improve translation performance for low-resource languages, and integrates harmful content detectors to ensure security. (AI Cambrian)

Search