llama.cpp
ggml · Open Source · Trust 91The fast C/C++ inference engine behind many local AI apps — runs even on laptops without a GPU.
Build it yourself · Alternatives
Alternatives to Ollama
Ollama by Ollama belongs to the area “Build it yourself” on OROBO. Here are 8 alternatives from the same area, first 7 with the same goals. Every entry is checked automatically every day (origin, code patterns, licence, maintenance, reachability); OROBO does not check whether software fits your purpose.
8 alternatives at a glance
Transformers
Hugging Face · Open Source · Trust 100The standard library for thousands of open models across text, vision and audio.
LangChain
LangChain · Open Source · Trust 97Framework for chaining models, tools and data into AI applications.
vLLM
vLLM Project · Open Source · Trust 97High-throughput serving engine for LLMs — for running your own AI infrastructure.
whisper.cpp
ggml · Open Source · Trust 100Speech recognition with OpenAI's Whisper model — local, fast, no upload.
AI SDK
Vercel · Open Source · Trust 97TypeScript toolkit for adding AI features to web apps — provider-agnostic.
FLUX
Black Forest Labs · Paid · Trust 94FLUX image and video models via pay-as-you-go API, plus open weights to self-host.
Inworld AI
Inworld AI · Free version · limited checksReal-time voice models and LLM inference for apps and games, with very low-latency speech via API.
Keep comparing
All software in “Build it yourself” with filters by price, offline use and difficulty.