Frontier open-weight models are increasingly available, but serving them typically assumes datacenter infrastructure. A new paper from Hugging Face presents FreeToken, an edge-native Mixture-of-Experts (MoE) serving system that treats a personal machine not as a small GPU, but as a unified, elastic inference platform.
FreeToken co-designs the full serving stack—including model layout and loading, expert residency, CPU–GPU execution, agentic state reuse, and runtime memory management—around two realities of local AI: agent workloads continuously change their execution pattern, and edge hardware exposes heterogeneous resources whose balance differs from machine to machine.
Rather than committing to a fixed offloading strategy, FreeToken continuously maps computation and model state onto the resources actually available. The system supports more than 20 MoE models and real coding and tool-using agents across hardware ranging from an 8GB laptop GPU to a single workstation GPU.
More importantly, it changes what these machines can practically serve: from a 35B model on a laptop to a 284B model on a gaming desktop and the 753B GLM-5.2 on a single workstation GPU. FreeToken turns open weights into deployable local software, making the machines users already own a practical platform for frontier-scale intelligence. The system is released at flashml.ai.