This Is How Search Gets Commoditized

John Battelle
4 min readMay 5, 2023
The first Google logo, when the project was called BackRub and focused on Internet “backlinks.” Lore has it the hand is co-founder Larry Page’s.

(original post at Searchblog)

Once upon a time when search was new, Google came along and put the whole darn Internet in RAM. This was an astonishing (and expensive) feat of engineering at the time — one that gave Google a significant competitive moat. Twenty years ago, very few companies had the know how or the resources to keep an up-to-date copy of the entire web in expensive, super fast silicon. Google’s ability to do so allowed it unprecedented flexibility and speed in its product, and that product won the search crown, building a trillion-dollar market cap along the way.

Since then compute, storage, and engineering costs have declined in a kind of reverse version of Moore’s Law. Pretty much anyone with a bit of funding and some basic Internet crawling skills can stand up a web index — but there’s been no reason to do so. For 15 or so years one of the biggest clichés in venture circles was “no one will ever fund another search engine.” (A second cliché? “No one’s ever said “Just Bing it.”)

Google had won, and that was that.

All of this came back to me when reading an eye-opening leaked memo over on Dylan Patel’s SemiAnalysis newsletter. Titled “We Have No Moat, and Neither Does OpenAI” and written by a senior researcher at Google, the memo is a devastating critique of Google’s approach to competing…

--

--

John Battelle

A Founder of The Recount, NewCo, Federated Media, sovrn Holdings, Web 2 Summit, Wired, Industry Standard; writer on Media, Technology, Culture, Business