Documentation

VoidLLM documentation home - guides, reference, and API docs

VoidLLM Documentation

Privacy-first LLM proxy and AI gateway. Self-hosted, single binary, sub-500us overhead.

Getting Started

• Quick Start - from docker run to first proxied request
• Configuration Reference - all YAML settings with examples

Deployment

• Binary - standalone binary, Linux/macOS/Windows
• Docker - Docker and Docker Compose
• Kubernetes - Helm chart, Istio, health probes
• Reverse Proxy - Nginx, Caddy, Traefik
• Database - SQLite, PostgreSQL, migration

Models

• Provider Setup - OpenAI, Anthropic, Azure, Ollama, vLLM, custom
• Load Balancing - strategies, failover, circuit breakers
• Aliases - logical names for models (per org/team)

MCP Gateway

• Overview - what is MCP, why a gateway
• Server Setup - register servers, access control, auth
• Code Mode - WASM-sandboxed multi-tool orchestration
• IDE Integration - Claude Code, Cursor, Windsurf

Security

• RBAC - roles, permissions, access control hierarchy
• Privacy - zero-knowledge architecture, GDPR
• Hardening - security checklist, TLS, network policies

Enterprise

• License - activation, verification, graceful degradation
• SSO / OIDC - Google, Azure AD, any OIDC provider
• Audit Logs - admin action logging
• OpenTelemetry - distributed tracing
• Pricing - Community, Pro, Enterprise, Founding Member

API

• Overview - authentication, endpoints, error codes
• OpenAPI Spec - full API specification

Resources

• Troubleshooting - common issues and solutions
• Blog - architecture deep-dives, benchmarks, guides
• FAQ - frequently asked questions
• GitHub - source code, issues, releases
• Security Policy - vulnerability reporting