Best inference server AI tools

LM Studio is a user-friendly desktop application for discovering, downloading, and running open-source Large Language Models (LLMs) locally on your computer. It offers a simple chat interface and a local inference server, ensuring privacy and offline access.

HyperMink provides Inferenceable, a free, open-source, and self-hostable AI inference server. Built on Node.js and llama.cpp, it allows developers and businesses to run large language models locally, ensuring complete data privacy, control, and cost-effectiveness. Your AI, Your Rules.

LocalAI is a free, open-source desktop application that allows you to run AI models privately and offline on your computer. It simplifies AI experimentation without needing a GPU, offering features like model management, integrity verification, and a local inference server.