vLLM

High-throughput inference and serving engine for open-weights LLMs

The Apache-2.0 serving engine that most self-hosted LLM stacks run on, exposing any of 200+ open-weights architectures behind an OpenAI-compatible API.

GitHub Stars 90,229

Forks 21,294

Data from: GitHub • Website•Updated: Aug 27, 2026

Visit Website

Pricing

No pricing page found

No free tier

Free and Apache-2.0. There is no pricing page, no hosted tier and no paid edition; the project is funded by donations through GitHub and OpenCollective, and compute for development and testing is contributed by sponsors. Your cost is the hardware you run it on.

Checked 2026-08-28

About vLLM

Featured Tools

This section may include affiliate links

ShipFast

Launch your SaaS in days, not months

Next.js SaaS boilerplate with AI integration and auth. Authentication, Stripe payments, database included. Launch production SaaS startups 10x faster.

Paid

BetterPic

Professional AI headshots in 4K

BetterPic is an AI professional photo generation tool that creates professional headshots and profile pictures.

Paid

Pippit

Turn a link, photo or prompt into marketing videos, images and avatars

CapCut's creative agent turns a product link, photo or prompt into marketing videos, posters and talking avatars, with a genuinely free tier to test it.

Freemium

Microns

Buy and sell micro SaaS businesses

Microns is a marketplace for buying and selling micro SaaS startups and small online businesses, listed with no commission on a sale.

Freemium

ElevenLabs

Create ultra-realistic AI voices and speech

ElevenLabs generates expressive speech and voice clones across a wide range of languages, with an API for apps. Free tier, then $5 a month upward.

Freemium

Outrank

AI SEO Content Writer

Outrank analyses what already ranks for a keyword and writes long-form content built to compete with it. Plans start at $99 a month.

Paid

The SEO Agent

Runs the whole SEO pipeline, from keyword research to published article

An SEO content pipeline that researches keywords, drafts and fact-checks articles with citations, then publishes straight to your CMS. One plan at $99 a month.

Paid

Testimonial.to

Collect and display customer testimonials with AI

Testimonial.to collects written and video testimonials through a hosted page and embeds them on your own site. Free plan, then $21 a month.

Freemium

ShipFast

Launch your SaaS in days, not months

BetterPic

Professional AI headshots in 4K

Pippit

Turn a link, photo or prompt into marketing videos, images and avatars

Microns

Buy and sell micro SaaS businesses

ElevenLabs

Create ultra-realistic AI voices and speech

Outrank

AI SEO Content Writer

The SEO Agent

Runs the whole SEO pipeline, from keyword research to published article

Testimonial.to

Collect and display customer testimonials with AI

Similar Tools

Claude

AI assistant for complex refactoring and architectural decisions

Claude is Anthropic's AI assistant, strong on long context, refactoring and architectural reasoning. Free tier with limits, Pro at $20 a month.

Freemium

AnyDoc

Convert 14 document formats to clean Markdown in milliseconds

An MIT-licensed Rust library that turns Word, PowerPoint, Excel, PDF and ten more formats into consistent Markdown locally, with no model and no API call.

Open_source