Crusoe fastokens open-source tokenizer merged into SGLang

Crusoe@CrusoeAIMay 6, 2026

Most teams scale inference by adding more GPUs. Smart teams think about how tokens flow. 😎 Introducing fastokens — Crusoe's open-source Rust tokenizer, built with NVIDIA Dynamo, now merged into SGLang. Up to 50% faster TTFT for agentic workloads, measured on real production https://t.co/RkEYx9UO3h

Views13.2k
Comments3
Reposts3
Likes35
Launched May 6, 2026View post

More from Crusoe

1

Crusoe Edge Zones and Crusoe Spark Factory

@CrusoeAI

Today, we’re announcing Crusoe Edge Zones — powered by Crusoe Spark™ — and Crusoe Spark Factory. ⚡ More about Spark Factory: https://t.co/JOXWNEZYeZ ☁️ More about Crusoe Edge Zones: https://t.co/X5mH5oV8Gj Discover the full story: 🔗 https://t.co/jyilm4RLaR

Mar 12, 2026
Views10.0k
Comments3
Reposts5
View post

See all Crusoe launches →