We’re releasing Raon-1 nano, an effective 1.5B dense LLM with per-layer embeddings and 3.1B total parameters. ⚡ Our journey from PUBG Ally toward on-device LLMs continues. We pruned and distilled Raon-1 mini preview (30B-A4B) using our MoE-to-Dense approach, then further https://t.co/ydiQGrBlAd
Nov 11, 2026
Views25.1k
Comments24
Reposts78