Skip to content
Dustin's AI Lab|AgentCrew AgentCrew
Go back

The Resource Paradox: From Stalling Old Laptops to the Real Baseline for Local AI

Many put up with aging laptops down to 1.8 GB of storage churning through swap, while dreaming of running local LLMs on a NT$5,000 machine. A look at the resource paradox, realistic hardware baselines for modern local models, and how to weigh usable speed against machine upgrades.

On this page
  1. The Myths and Wild Fantasies of Local AI Hardware
  2. The Real Baseline for Everyday Local Models
  3. Computers Are Productivity Tools: Upgrade When It Counts
  4. Appendix

Teaching tech skills turns up a fascinating contradiction. When a machine is choking on memory and storage, a command-line interface (CLI) is hands-down the best fix—it consumes a tiny fraction of the resources a graphical interface demands. Yet in practice, the people whose computers need that relief the most are precisely the ones least likely to ever touch a terminal.

I don’t mean that disparagingly. It comes straight from seeing it over and over in the classroom: recycling bins that have never been emptied, desktops buried under a carpet of screenshots, two-year-old installers still sitting quietly in Downloads, and a hard drive clinging to its last 1.8 GB of free space. RAM is buried under swap thrashing, and the entire laptop crawls at a painful snail’s pace.

And right when system resources hit rock bottom and the OS is gasping for air in swap hell, the question people turn around and ask is almost always the same: if I want to run AI models locally on my own machine, how beefy does my hardware actually need to be?

See the 3-month 1-on-1 program →

The Myths and Wild Fantasies of Local AI Hardware

Ask what hardware you need to run local models, and the honest answer depends heavily on what you already own. Often the bar isn’t nearly as high as people assume. But browse any online forum, and you’ll find discussions immediately polarizing into two bizarre extremes.

The first extreme mistakes “it actually loaded” for “it runs well.” Over on Reddit, someone proudly shared getting DeepSeek V4 Flash to run on 16 GB of RAM, claiming the speed was pretty decent—at 33 sec/tok (watch the units closely).

An even wilder take came from a recent viral joke in Taiwan: a post claiming Google engineers should learn the “proper way” to do AI from vocational high schoolers, supposedly running local LLMs on a NT$5,000 machine. If that were remotely true, Taiwan’s stock exchange, SK Hynix, and Samsung would be cratering off a cliff next Monday.

The Real Baseline for Everyday Local Models

Jokes aside, everyday local models don’t require magic budget hacks, nor do they demand a server rack.

Right now, Qwen 3.6 27B and the 35B A3B MoE are widely regarded as some of the most cost-effective local models around. Take the 3.6 27B Q4 quantized build: an M4 Pro Mac with 48 GB of unified memory runs it comfortably at around 20 to 30 tok/s.

The open-weight ecosystem is moving fast, too. Just the other day, the Qwen team announced their next wave of open weights on social media, as shown in their post:

Qwen official account on X announcing Qwen3.8-Max open weights, with the sentence "We will release the open weights of Qwen3.8-Max next week, and Qwen3.8-27B will also be released to meet everyone" highlighted, listing selling points below like autonomous coding, long-horizon mastery, native multimodal, along with pricing at $2.0 input and $6.0 output per million tokens.

That upcoming 27B release is particularly exciting. Once those open weights land, hopefully the community quickly puts together quantized versions, and ideally we’ll see compact MoE variants follow soon after.

Computers Are Productivity Tools: Upgrade When It Counts

That brings us to the underlying question everyone ultimately faces: should you actually buy or upgrade a machine just to run local models?

As for buying a machine specifically for this—hardware is only getting pricier. An M4 Pro Mac mini with 48 GB of RAM was going for around NT$50,000 back in May; check today, and prices have shot closer to NT$90,000. Turns out that line about computers holding their value wasn’t lying.

The real test is simpler: a computer is a productivity tool meant to get work done. If the machine on your desk is already a choked-up potato with an overflowing trash bin and 1.8 GB of free disk space, it’s already failing you in day-to-day work, let alone running local AI. If you want a machine that won’t choke on your daily work—and can actually run models locally—just buy the upgrade when you need it.

Appendix

Here is a summary of the model speeds and hardware specifications mentioned above:


Free Prep: Get Your First AI Result

Step-by-step setup for Claude Code with zero coding required.

Join Free Prep

Ready for AI to finish a real task for you? Explore L1 Not sure where to start? Book a free 15-min chat

Share this post on:
Previous Post
Why I Built My Own Newsletter
Next Post
Installing Gemini CLI With Beginners Cures Most Claude Code Ailments