Moe

Moonshot AI just dropped Kimi K2.6, and it’s not a minor refresh — it’s a full-scale assault on the open-weight AI leaderboard. At 1 trillion total parameters with 32 billion active (Mixture-of-Experts architecture with 384 experts, 8 routed plus 1 shared), Kimi K2.6 claims the open-weight crown on SWE-Bench Verified with an 80.2% score — and it ships with a mode that lets you coordinate 300 simultaneous sub-agents for coding tasks that run up to 12 hours. ...

NVIDIA just dropped something that’s going to matter for anyone building real agentic AI systems. Nemotron 3 Super is a 120-billion-parameter open-weight model — but here’s the key detail that separates it from the crowd: it only uses 12 billion active parameters at inference time thanks to a hybrid Mamba-Transformer Mixture-of-Experts (MoE) architecture. The result? Five times higher throughput than comparable-sized models, with a one-million-token context window that changes how agents can actually operate in the wild. ...