ToolMage
Sign in

Best inference server AI tools

Discover powerful inference server AI tools, including LM Studio, LocalAI, and hypermink, and other related products.

LM Studio
Free

LM Studio

LM Studio is a user-friendly desktop application for discovering, downloading, and running open-source Large Language Models (LLMs) locally on your computer. It offers a simple chat interface and a local inference server, ensuring privacy and offline access.

Chat
Visits 17.4KFavorites 136Likes 135
hypermink
Free

hypermink

HyperMink provides Inferenceable, a free, open-source, and self-hostable AI inference server. Built on Node.js and llama.cpp, it allows developers and businesses to run large language models locally, ensuring complete data privacy, control, and cost-effectiveness. Your AI, Your Rules.

Local Llm
Visits 7.1KFavorites 137Likes 124
LocalAI
Free

LocalAI

LocalAI is a free, open-source desktop application that allows you to run AI models privately and offline on your computer. It simplifies AI experimentation without needing a GPU, offering features like model management, integrity verification, and a local inference server.

Model Deployment
Visits 9.6KFavorites 164Likes 163
Tag