ToolMage
Sign in

Best inference server AI tools

Discover powerful inference server AI tools, including LM Studio, LocalAI, and hypermink, and other related products.

LM Studio
Free

LM Studio

LM Studio is a user-friendly desktop application for discovering, downloading, and running open-source Large Language Models (LLMs) locally on your computer. It offers a simple chat interface and a local inference server, ensuring privacy and offline access.

Chat
Visits 20.6KFavorites 175Likes 171
hypermink
Free

hypermink

HyperMink provides Inferenceable, a free, open-source, and self-hostable AI inference server. Built on Node.js and llama.cpp, it allows developers and businesses to run large language models locally, ensuring complete data privacy, control, and cost-effectiveness. Your AI, Your Rules.

Local Llm
Visits 10.6KFavorites 171Likes 154
LocalAI
Free

LocalAI

LocalAI is a free, open-source desktop application that allows you to run AI models privately and offline on your computer. It simplifies AI experimentation without needing a GPU, offering features like model management, integrity verification, and a local inference server.

Model Deployment
Visits 13KFavorites 187Likes 188
Tag