jp@jpowers.io
THINGS I CAPTURE THROUGHOUT MY DAY

NOTES_

What just happened to TheNumbers.com should worry us all

It sucks — and it especially sucks for sites like The Numbers, run as basically passion projects by solo developers — but it's inevitable. Any site with valuable data is going to be farmed by AI, so its architecture has to be built for that. At the same time, every LLM and agent that farms that data depends on the site still existing; scrape it into the ground and there's nothing left to scrape. The stable outcome is a Nash equilibrium where sites serve bots efficiently and bots take what they need without killing the host, because neither side gains by doing otherwise. We're clearly not there yet, which is why stories like this one exist.

Let’s look beyond the specifics for a moment and consider what happened here. A beloved, useful, free website, run carefully by a competent, honest person for nearly thirty years, was crushed between two features of the new AI economy. Unsustainable machine traffic hammered it from above, and in all likelihood a financially motivated intruder, operating in a world where breaking into websites has never been easier, took it down.

Like this post? It's one of many. Check out the rest back on my Notes page.