akj.io

Infrastructure battles, hardware economics, and four futures for AI that all have trade-offs

Published
Reading
5 min

In Part 1, I wrote about how AI amplifies existing engineering weaknesses: sloppy review processes, missing security checks, governance vacuums. Those are tool problems, and tool problems have solutions. Enforce code review. Test before you merge. Run security scans.

This part is about the problem that doesn't have a clean solution: who owns the models, who can afford to run them, and what happens when the money runs out.

The Ownership Question

LLMs are trained on our collective knowledge: Stack Overflow answers, GitHub repositories, technical documentation, blog posts. We all contributed. But the resulting models belong to Anthropic, OpenAI, Google, and Meta, the companies that can afford the training infrastructure.

And right now, none of them are profitable. They're running on subsidized pricing, venture capital, and the promise of future returns. At some point, that changes. When the real, unsubsidized costs hit, the dynamics shift in ways we should be thinking about now.

Four Futures

Corporate Feudalism

The most likely near-term outcome: a few AI companies own the intelligence layer. You pay their prices or fall behind. Free tiers exist, but with inferior models. Those who can't afford premium access get left behind in capability. A two-tier system where intelligence becomes a subscription service.

The pattern is already established. GitHub Copilot went from free preview to $10/month to $19/month in three years. Claude Pro, ChatGPT Plus, these prices are introductory. Once the venture money dries up and the compute bills come due, we'll see what the real prices look like. I wouldn't be surprised if the serious professional tiers land somewhere around $100-200/month within a few years, and at that point your employer picks who gets access and who doesn't.

Government Infrastructure

What if AI became public infrastructure, like roads or electricity? Governments host models for citizens. Democratic access, not profit-driven. But this comes with surveillance concerns, censorship risks, and political capture. Who decides what questions the public AI can answer? And given how most government IT projects go, I'm not optimistic about the execution.

Local and Distributed Models

Open source models you can run on consumer hardware. Yours to keep. Small models can already run locally; Llama 3.1, Mistral, and others prove the concept. But they're less capable than frontier models, and the hardware to close that gap is moving in the wrong direction (more on that below).

The Plateau

Consider the possibility that AI doesn't get much better. Maybe we're already near the ceiling of what current architectures can do. The improvements slow. The hype deflates. Frontier models plateau at "useful but not transformative."

In that case, the massive infrastructure investments become stranded assets. Corporate AI companies can't justify their valuations when improvements are incremental. Governments won't fund it as critical infrastructure. And local models might be good enough for most real-world tasks. The infrastructure battle becomes pointless if there's no intelligence monopoly worth fighting over. But the billions already spent are gone, and the companies that over-invested are stuck with the bill.

I'd like this to be the outcome, honestly. A world where local models are good enough for 90% of tasks and the corporate lock-in never fully materializes. But the investment momentum points elsewhere, and I don't think the big labs are going to plateau quietly.

The Hardware Reality Check

Even with open models, there's an infrastructure problem most people aren't talking about. "Open source" doesn't mean "accessible" if you can't afford to run it.

I watched the Corsair DDR5 kit I bought for 1,500 DKK hit 4,300 DKK on PriceRunner in under a year. That's a 187% increase on a 32GB kit. And it's not just Danish pricing weirdness. G.SKILL Flare X5 DDR5 32GB went from $87 to $399 in the US. Crucial Pro DDR5-6000 32GB jumped from $120 to $410.

The reason is straightforward: memory manufacturers reallocated more than 3x their wafer capacity to produce High Bandwidth Memory for AI workloads. Samsung and Micron halted most DDR4 production. SK Hynix reduced DDR4 output to just 20%. The AI training pipeline is literally cannibalizing consumer hardware supply, and memory shortages are expected to last until at least Q4 2027.

GPUs tell a similar story. The RTX 4090 launched at $1,599 in October 2022. By early 2026, used units sell for $2,200 on eBay. NVIDIA halted production in October 2024 to focus on the RTX 50 series, and stock shortages made MSRP pricing nearly impossible throughout 2025. Datacenter GPU rental prices have dropped (H100s went from $7.50-11/GPU-hour in mid-2023 to $1.50-3.00 by late 2025), but purchase prices remain at $25,000-40,000 per unit. That's accessible to companies, not individuals.

The trajectory is clear: hardware for running AI models is getting more expensive and less accessible for individuals, even as the "open source" models themselves get better. And the environmental costs compound it further. The International Energy Agency predicts data center electricity demand will more than double by 2030. Ed Zitron called it "an unsustainable, unreliable, unprofitable, and environmentally-destructive boondoggle." The power bills alone make scaling prohibitive for most players.

RAM Price Crisis: 32GB DDR5 Kits

400% increase from May 2025 to January 2026

Jul 25Oct 25Jan 260100200300400500Price (USD)

Sources: Accio, Original Pricing

GPU Pricing: RTX 4090

MSRP vs. Actual Market Prices

Jan 23Jan 24Jan 25Jan 261,6001,8002,0002,200Price (USD)

Sources: BestValueGPU, Tom's Hardware

The Bubble That Won't Pop

AI might be overhyped. The bubble might burst. But the technology isn't going away, even if valuations crash. The infrastructure problem, the ownership question, the rising hardware costs, all of those persist regardless of what happens to stock prices.

We're in the middle of an infrastructure battle that will define software development for the next decade. Every Chief Risk Officer should have this on their radar, but so should every developer and every average citizen. If your company has AI subscriptions for employees and those prices go up 10x when subsidies end, that's not a line item adjustment. That's a major operational risk.

I don't have clean answers. But I know that the people building their entire workflow around $20/month AI access are making a bet on pricing that has no historical precedent for holding. And the people ignoring the ownership question because "open source will save us" are underestimating how much the hardware economics work against that narrative.

The conversation we should be having isn't about whether AI-generated code has bugs. It's about who controls the infrastructure, what happens when the subsidies end, and whether we're building dependencies we can't walk back from.


Have thoughts on who should control AI infrastructure, or whether we're already at the plateau? Reach out on LinkedIn or email.