Magnitude screenshot
Code GenerationOpen_source
Magnitude logo

Magnitude

Easy local inference for agents

An Apache-2.0 inference server that profiles your hardware, recommends models that fit with estimated tokens per second, and wires them into the agent you use.

GitHub Stars 3,931
Forks 284
Founded 2025
Pricing Free
Data from: GitHubWebsiteUpdated: Sep 7, 2026

About Magnitude

Tags

devopsinfrastructuredeploymentmodel-servingopen-source