Crusoe fastokens open-source tokenizer merged into SGLang

Crusoe@CrusoeAIMay 6, 2026

Most teams scale inference by adding more GPUs. Smart teams think about how tokens flow. 😎 Introducing fastokens — Crusoe's open-source Rust tokenizer, built with NVIDIA Dynamo, now merged into SGLang. Up to 50% faster TTFT for agentic workloads, measured on real production https://t.co/RkEYx9UO3h

Views13.3k
Comments3
Reposts3
Likes35
Launched May 6, 2026View post

More from Crusoe

1

Crusoe Edge Zones and Crusoe Spark Factory

@CrusoeAI

Today, we’re announcing Crusoe Edge Zones — powered by Crusoe Spark™ — and Crusoe Spark Factory. ⚡ More about Spark Factory: https://t.co/JOXWNEZYeZ ☁️ More about Crusoe Edge Zones: https://t.co/X5mH5oV8Gj Discover the full story: 🔗 https://t.co/jyilm4RLaR

Mar 12, 2026
Views10.0k
Comments3
Reposts4
View post

See all Crusoe launches →