VoidLLM이란?
VoidLLM is a self-hosted LLM proxy and AI gateway that routes requests across OpenAI, Anthropic, Azure, Ollama, and vLLM — with load balancing, failover, API key management, usage tracking, and rate limiting. What makes it different: zero-knowledge architecture. VoidLLM never stores or logs any prompt or response content. Not a toggle — by design. GDPR-compliant from day one. Built in Go for sub-2ms overhead. Single binary, full web UI included. Free tier with unlimited users.
스크린샷
?
아직 댓글이 없어요. 가장 먼저 남겨보세요!
VoidLLM에 대한 X의 실제 대화
X에 게시