Anthropic-compatible

A Metal-only local inference engine (ds4.c) for DeepSeek V4 Flash with 1M-token context, 2-bit quantization, and disk-backed KV cache, offering OpenAI/Anthropic-compatible local APIs but with alpha-quality code and very high RAM requirements on macOS.

A practical, data-heavy guide to running Google Gemma 4 26B-A4B locally on macOS via LM Studio 0.4.0’s headless CLI, detailing MoE efficiency, hardware/memory requirements, performance metrics, and integrating Claude Code for offline coding tasks.