Feature/api parity roadmap#3

Merged

solderzzc merged 6 commits intomainfrom

feature/api-parity-roadmap

Mar 24, 2026

Commits on Mar 23, 2026

feat: Phase 1 API parity with mlx-lm

simba
authored and
simba
committed
feat: Phase 2 — JSON mode, VLM vision support, multipart content, extra sampling params

simba
authored and
simba
committed
feat: Phase 3 — Memory limit, /metrics, enhanced /health, graceful shutdown, stats

simba
authored and
simba
committed
feat: API key authentication (--api-key flag)

simba
authored and
simba
committed

Commits on Mar 24, 2026

feat: Prompt caching — reduce TTFT by reusing system prompt KV state

simba
authored and
simba
committed
fix: CI — install mlx.metallib from Python mlx package

simba
authored and
simba
committed