Meta has released Llama 4 Scout and Llama 4 Maverick, now available on Hugging Face: • Llama 4 Scout: 17B active parameters, 16-expert Mixture of Experts (MoE) architecture, 10M token context window, fits on a single H100 GPU.  • Llama 4 Maverick: 17B active parameters, 128-expert MoE architecture, 1M token context window, optimized for DGX H100 systems. 
🔥 Key Features: • Native Multimodality: Seamlessly processes text and images.  • Extended Context Window: Up to 10 million tokens for handling extensive inputs. • Multilingual Support: Trained on 200 languages, with fine-tuning support for 12, including Arabic, Spanish, and German. 
🛠️ Access and Integration: • Model Checkpoints: Available under the meta-llama organization on the Hugging Face Hub. • Transformers Compatibility: Fully supported in transformers v4.51.0 for easy loading and fine-tuning. • Efficient Deployment: Supports tensor-parallelism and automatic device mapping.
These models offer developers enhanced capabilities for building sophisticated, multimodal AI applications. 
I read the 456-page AI Index report so you don't have to (kidding). The wild part? While AI gets ridiculously more accessible, the power gap is actually widening:
1️⃣ The democratization of AI capabilities is accelerating rapidly: - The gap between open and closed models is basically closed: difference in benchmarks like MMLU and HumanEval shrunk to just 1.7% in 2024 - The cost to run GPT-3.5-level performance dropped 280x in 2 years - Model size is shrinking while maintaining performance - Phi-3-mini hitting 60%+ MMLU at fraction of parameters of early models like PaLM
2️⃣ But we're seeing concerning divides deepening: - Geographic: US private investment ($109B) dwarfs everyone else - 12x China's $9.3B - Research concentration: US and China dominate highly-cited papers (50 and 34 respectively in 2023), while next closest is only 7 - Gender: Major gaps in AI skill penetration rates - US shows 2.39 vs 1.71 male/female ratio
The tech is getting more accessible but the benefits aren't being distributed evenly. Worth thinking about as these tools become more central to the economy.