Mobile LLM Server
Run local LLMs with Android. llama.cpp & LiteRT-LM
什麼是 Mobile LLM Server？
AI Node brings local LLM inference to Android with llama.cpp and GGUF model support. It turns your phone into a private AI server with OpenAI-compatible API endpoints. Unlike cloud-based AI apps, all models run fully on-device for privacy and low latency.
截圖
?
還沒有評論，來搶沙發吧！
X 上關於 Mobile LLM Server 的真實討論
去 X 發文