Omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Rating: 0.0/5 | ⭐ 1044 stars
Categories: Everything