vLLM 的替代软件

vLLM（vLLM Project）在 OROBO 中属于“自己动手构建”领域。以下是同一领域的 8 款替代软件，其中 5 款目标相同，排在前面。每个条目每天自动检测（来源、代码模式、许可证、维护、可访问性）；OROBO 不检测软件是否适合您的用途。

8 款替代软件一览

Hugging Face · 开源 · 信任分 100

The standard library for thousands of open models across text, vision and audio.

LangChain · 开源 · 信任分 97

Framework for chaining models, tools and data into AI applications.

Vercel · 开源 · 信任分 97

TypeScript toolkit for adding AI features to web apps — provider-agnostic.

Ollama · 开源 · 信任分 97

Run large language models locally with a single command — no cloud required.

ggml · 开源 · 信任分 91

The fast C/C++ inference engine behind many local AI apps — runs even on laptops without a GPU.

ggml · 开源 · 信任分 100

Speech recognition with OpenAI's Whisper model — local, fast, no upload.

Black Forest Labs · 付费 · 信任分 94

FLUX image and video models via pay-as-you-go API, plus open weights to self-host.

Inworld AI · 免费版 · 有限检测

Real-time voice models and LLM inference for apps and games, with very low-latency speech via API.

“自己动手构建”领域的全部软件，可按价格、离线使用和难度筛选。