Edge0

A 35B language model running on an iPhone using only 1–2.5 GB of peak memory. No cloud. No remote server. No desktop GPU. Today, we’re open-sourcing Edge0 — a framework for running large AI models fully on-device. https://t.co/snUQRWHNdc

Over the past two months we open-sourced a set of on-device audio models. The name is Audio8. The series can run on phones, PCs, and other hardware with limited compute and memory. You can use them for local inference right away. What’s included: ASR: 0.1B, 0.3B, 0.6B, 3B TTS: https://t.co/eWnEWmoA4H