Mobile LLM Server
Run local LLMs with Android. llama.cpp & LiteRT-LM
什么是 Mobile LLM Server？
AI Node brings local LLM inference to Android with llama.cpp and GGUF model support. It turns your phone into a private AI server with OpenAI-compatible API endpoints. Unlike cloud-based AI apps, all models run fully on-device for privacy and low latency.
截图
?
还没有评论，来抢沙发吧！
X 上关于 Mobile LLM Server 的真实讨论
去 X 发帖