Back to GitHub AI ReposView Repository
omlx
by jundot16,230
1,384
Project Description
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Project Summary
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Primary Language Python
LicenseApache-2.0
Last GitHub Commit6/8/2026