Please see the newer: https://github.com/Quazmoz/openvino-windows-llm
-
Updated
May 20, 2026 - Python
#
llm-server
Here are 17 public repositories matching this topic...
A lightweight LiteLLM server boilerplate pre-configured with uv and Docker for hosting your own OpenAI- and Anthropic-compatible endpoints. Includes LibreChat as an optional web UI.
python setup boilerplate ai gemini openai webchat ai-chatbot ai-assistant llm generative-ai chatgpt llm-serving anthropic genai librechat litellm llm-server agentic-ai litellm-proxy
-
Updated
Dec 8, 2025 - Python
single-executable / library which combines llama.cpp, whisper.cpp, and stable-diffusion.cpp
-
Updated
Jun 26, 2026 - C++
Function-calling API for LLM from multiple providers
-
Updated
Aug 10, 2024 - Go
macOS GUI for managing pure mlx_lm.server on Apple Silicon in Direct Mode.
macos mlx swiftui apple-silicon local-llm llm-server agent-tools mlx-lm openai-compatible hermes-agent
-
Updated
Jun 25, 2026 - Swift
-
Updated
May 27, 2026 - TypeScript
A complete, menu-driven AI model interface for Windows that simplifies running local GGUF language models with llama.cpp. This tool automatically manages dependencies, provides multiple interaction modes, and prioritizes user privacy through fully offline operation.
gpu-acceleration language-model chat-interface ai-privacy model-inference llama-cpp local-llm gguf llm-interface llm-server llm-chat offline-ai private-ai windows-ai gguf-models model-manager openai-compatible quantized-models ai-runner llama-runner
-
Updated
Jan 30, 2026 - PowerShell
Windows-first OpenAI-compatible local LLM server powered by OpenVINO GenAI for Intel CPU/GPU/NPU, with chat UI, model conversion, and setup scripts.
-
Updated
Jun 21, 2026 - Python
API server for `llm` CLI tool
-
Updated
Aug 12, 2025 - Python
A flexible FastAPI-based framework for handling AI tasks using Large Language Models (LLMs). Supports multiple providers, extensible tasks and routers, Redis caching, and OpenAI integration. Easily scalable for various LLM-based applications.
-
Updated
Sep 3, 2024 - Python
OpenAI-compatible local inference server for Apple Silicon using MLX. FastAPI server with Chat Completions and Responses APIs, multi-turn conversations, and streaming support.
-
Updated
Mar 7, 2026 - Python
PHP Frontend for Hosting local LLM's (run via VSCode or basic php execution methods/ add to project)
-
Updated
Jul 13, 2025 - PHP
Headless CLI for managing local MLX language-model HTTP servers on Apple Silicon Macs. Supports model discovery, server lifecycle management, performance benchmarking, and provider integration with OpenCode, Claude Code, and LiteLLM.
-
Updated
Jun 26, 2026 - Python
Unified simple LLM server wrapper with intelligent routing based on model ID
python machine-learning language-model mlx fastapi huggingface apple-silicon openai-api llm llm-server
-
Updated
Jun 28, 2026 - Python
Host an LLM and make it accessible on a network via API.
-
Updated
May 12, 2026 - Python
Run local AI models in VS Code with automatic model detection, server start, and built-in MCP endpoint—no cloud or manual setup required.
chat open-source ai code mcp vscode-extension llama grammar-checker llm openmetadata code-assistant llamacpp llama-cpp ollama gguf ollama-api llm-server run-local-llm
-
Updated
Jun 29, 2026 - PHP
Improve this page
Add a description, image, and links to the llm-server topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the llm-server topic, visit your repo's landing page and select "manage topics."