Rondine

什麼是 Rondine？

Rondine is an open-source control plane for local LLMs. It detects RAM and VRAM, recommends models that fit, applies hardware-tuned settings, downloads weights, and starts an OpenAI-compatible server. It supports Apple Silicon, NVIDIA GPUs, and DGX Spark through llama.cpp, MLX-LM, and vLLM. Instead of creating another inference engine, Rondine coordinates proven runtimes and shows every launch plan before execution.