GuruStacks
Localai

Localai

software
No review score yet

About

Lightweight, memory-efficient desktop app for running large language models locally without GPU using CPU-based quantized inference.

llm-testingopen-sourceailocal-inference

Pros

  • +Completely free
  • +Privacy-first inference
  • +Minimal system requirements
  • +Compact install

Cons

  • -CPU-only limits speed
  • -No model recommendations
  • -Basic sorting features
Visit website

This may be an affiliate link — the creator and GuruStacks may earn a commission, at no extra cost to you. Learn more

Details

Typesoftware

Pricing

Model

free

Platforms

macwindowslinux

Related

Similar tools

View alternatives →
vLLM

vLLM

4.7
llminferenceserving

High-throughput LLM inference engine with PagedAttention for efficient memory management. The fastest open-source LLM serving solution.

Plandex

Plandex

4.4
ai-coding-agentterminalopen-source

Open-source, terminal-based AI coding agent designed for large projects. Features a 2M token context window, cumulative diff review sandbox, and multi-model support across 30+ languages.

ComfyUI

ComfyUI

4.4
aistable-diffusionimage-generation

Powerful and modular node-based visual editor for designing and executing advanced AI image and video generation pipelines using Stable Diffusion and other models.

Zep

Zep

4.4
ai-memoryllmrag

Context engineering and memory platform for AI agents that assembles relevant context from chat history, business data, and user behavior using a temporal knowledge graph with sub-200ms retrieval latency.

Hoppscotch

Hoppscotch

4.4
apitestingopen-source

Open-source API development ecosystem for building, testing, and documenting APIs with a lightweight, collaborative browser-based interface.

Vercel AI SDK

Vercel AI SDK

4.6
aisdktypescript

Vercel AI SDK is an open-source TypeScript framework for building AI-powered apps with streaming, multi-model support, and automatic provider fallbacks.