https://vettedconsumer.com/unified-memory-explained-why-mini-pcs-can-run-70b-models-a-big-gpu-cant-and-where-they-slow-down/
Vetted Consumer
Unified Memory, Explained: Why Mini PCs Can Run 70B Models a Big GPU Can't (and Where They Slow Down)
One idea explains the whole mini PC category: unified memory lets a $2,000 box hold a 70B model no consumer GPU can fit, then decode it slowly. The roofline math, the prompt-processing catch, the NPU red herring, and the owner-measured speeds.
