Skip to content

hardware, local runners, what fits in memory

Machines & local models

1 item

What it takes to run a model on hardware you own. Machines and the memory ceiling that decides which model fits, the runners that load it, the quantization that shrinks it, and the setup that makes it usable — with the price of each step, because that is the part comparisons leave out.

This section has 1 of 5 items. Until then it stays out of the menu and carries noindex, because an empty page hurts both the reader and the site.

Machines & local modelsstrong signal

Apple priced the memory, and memory is what a local model actually costs

The new Mac Studio goes to 512GB of unified memory at $5,499; the new Mac mini stops at 32GB and starts at $899. For anyone running models on their own machine, that gap is the whole product line, and Apple is now selling it that way.

Appleverified