Tuesday, August 12, 2025

LLMs have hit a plateau & we'll probably meander around on it for the forseeable future

From further down in the tweet: “What comes next is not the next spectacular demo but the quiet absorption of today’s tools into the 80 percent of the economy that still runs on Excel and email.... “

Before that: “For [super-intelligence] we need either an architectural miracle (unforecastable by definition) or a civil-engineering miracle (a decade-long sprint to build nuclear plants and 2-nanometer fabs).” Even the civil-engineering miracle won’t get us there. As for the architectural miracle, we don’t need a miracle. We need inventive research on new technologies, like the neuro-symbolic technology that Gary Marcus is also talking about, but also something like the “associative drift engine” ChatGPT mentioned in a recent conversation: From Mirror Recognition to Low-Bandwidth Memory.

No comments:

Post a Comment