Localai
softwareAbout
Lightweight, memory-efficient desktop app for running large language models locally without GPU using CPU-based quantized inference.
Pros
- +Completely free
- +Privacy-first inference
- +Minimal system requirements
- +Compact install
Cons
- -CPU-only limits speed
- -No model recommendations
- -Basic sorting features
This may be an affiliate link — the creator and GuruStacks may earn a commission, at no extra cost to you. Learn more
Details
Pricing
Model
free
Platforms
Community
Creator reviews
No creator reviews yetRelated
Similar tools
View alternatives →vLLM
4.7High-throughput LLM inference engine with PagedAttention for efficient memory management. The fastest open-source LLM serving solution.
Plandex
4.4Open-source, terminal-based AI coding agent designed for large projects. Features a 2M token context window, cumulative diff review sandbox, and multi-model support across 30+ languages.
ComfyUI
4.4Powerful and modular node-based visual editor for designing and executing advanced AI image and video generation pipelines using Stable Diffusion and other models.
Zep
4.4Context engineering and memory platform for AI agents that assembles relevant context from chat history, business data, and user behavior using a temporal knowledge graph with sub-200ms retrieval latency.
Hoppscotch
4.4Open-source API development ecosystem for building, testing, and documenting APIs with a lightweight, collaborative browser-based interface.
Vercel AI SDK
4.6Vercel AI SDK is an open-source TypeScript framework for building AI-powered apps with streaming, multi-model support, and automatic provider fallbacks.
Is this your tool? Claim this listing