Tool category
Best Local Inference Tools
Compare 3 local inference tools from the GuruStacks directory, including ratings, tags, and short descriptions.
Chat With RTX
Unrated
chattingai-modellocal-inference
NVIDIA's desktop app that lets you create a personalized ChatGPT-like AI trained on your own documents, videos, and notes.
ChattyPage
Unrated
chattingllmlocal-inference
Web interface for running small LLM models like Tiny Llama directly in your browser with low memory overhead.
Localai
Unrated
llm-testingopen-sourceai
Lightweight, memory-efficient desktop app for running large language models locally without GPU using CPU-based quantized inference.