Exla

An SDK to run transformer models anywhere

B2B Artificial Intelligence Edge Computing Semiconductors Computer Vision發布於 2025年2月20日

什麼是 Exla？

Exla aggressively quantizes AI models to minimize memory usage and maximize inference speed. Whether you're deploying LLMs, VLMs, VLAs, or custom models, Exla reduces memory footprint by up to 80% and accelerates inference by 3–20x - all with just a few lines of code. https://cal.com/exla-ai/schedule

還沒有評論，來搶沙發吧！