Hardware
Mac-Based Self-Hosting
Apple Silicon local inference from entry-level MacBook Air to Mac Studio Ultra.
AppleMacMLXMetalself-hosting
Minimal configuration
- Device: MacBook Air M3 16 GB unified memory
- Storage: 512 GB SSD
- OS: macOS Sonoma or later
- Use case: 3B–7B MLX-optimized models for local prototyping
Recommended configuration
- Device: MacBook Pro M4 Pro 36 GB or Mac Studio M2 Max 64 GB
- Storage: 1 TB SSD
- OS: macOS Sonoma or later
- Use case: 7B–13B models, MLX LoRA fine-tuning, local agent loops
Premium configuration
- Device: Mac Studio M2 Ultra 192 GB or Mac Pro M2 Ultra 192 GB
- Storage: 2 TB SSD
- OS: macOS Sonoma or later
- Use case: 30B–70B MLX models, high-throughput local inference