Llama 4 Introduces 10M Token Context Window and MoE Architecture for Enhanced AI Performance and Capabilities
Meta has launched Llama 4, a new series of AI models, on April 5, 2025, featuring Scout, Maverick, Behemoth, and L4emoth. These models focus on multimodal capabilities and efficiency via a mixture-of-experts (MoE) architecture, which allows them to perform tasks more effectively while cutting costs. Scout has 109 billion parameters and excels in processing lengthy ...