Cohere Releases North Mini Code, a 30B-Parameter MoE Model for Agentic Software Engineering
Cohere's first coding-specialized model combines sparse mixture-of-experts architecture with reinforcement learning for agent-based development tasks.
#mixture-of-experts
JetBrains Releases Mellum2, a 12B Sparse Model for Sub-Second Inference
JetBrains' new Mixture-of-Experts model achieves 2x speedup over dense peers while activating just 2.5B parameters per token.