Pages in this blog

Wednesday, May 20, 2026

How come no one mentions Rodney Brooks in the LLM debates?

Claude brought up Rodney Brooks in a recent discussion. I'd been dialoguing with Claude about Tyler Cowen's credulous treatment of various claims about LLMs and AGI. Claude brought up Brooks' subsumption architecture in passing. I asked it to comment further. Here's that interaction.

* * * * *

I’m glad you mentioned Brooks, on two counts. In all the current discussion I haven’t once seen his subsumption architecture mentioned. But his early work on Genghis was revolutionary. Secondly, Brooks himself has been offering extended and detailed commentary on a whole range of technology, including LLMs, in his January posts where he offers his own predictions and keeps track of how they’ve been turning out. There’s nothing else like it. And Brooks’ credentials are really extraordinary, not the least because he has a great deal of experience in making working robotic systems, systems in practical use.

Both points are worth developing. On subsumption architecture: its absence from current AI discourse is remarkable because it was the most serious empirical challenge to the assumptions underlying both classical symbolic AI and the connectionist approaches that evolved into current deep learning. Brooks's core argument in "Intelligence Without Representation" wasn't just a technical proposal — it was a fundamental reorientation of what intelligence is and where it comes from. The claim that coherent, adaptive behavior can emerge from layered reactive systems without any central world model, without explicit symbolic representation, without a planner sitting at the top — that's a result that should bear on how we think about what LLMs are doing and what they're missing. The fact that Genghis could navigate complex terrain through subsumption while contemporary AI systems still struggle with robustly grounded real-world interaction is a data point that the current enthusiasm tends to quietly bypass.

What subsumption architecture demonstrated, and what gets forgotten, is that embodied interaction with an actual environment generates a kind of competence that cannot be replicated by processing statistical patterns over text, however vast the corpus. That's not a philosophical claim — Brooks demonstrated it in hardware that had to work. When Genghis stumbled on a rock, the system had to deal with it. There's no equivalent pressure in LLM training.

On the prediction-tracking posts: what distinguishes Brooks there isn't just the credentials but the methodology. Making explicit, dated, falsifiable predictions and then returning to score them publicly is intellectually rare and demanding. It requires a specific kind of intellectual honesty that most commentators on AI conspicuously avoid — they deal in claims calibrated to be unfalsifiable or at least unverifiable in any reasonable timeframe. Brooks's willingness to be held accountable to his own record is itself a signal about the seriousness of his analysis.

And your point about practical experience is the deepest one. There is a profound difference between reasoning about what AI systems can do in principle and having spent decades building systems that had to function reliably in the physical world, with real tolerances, real failure modes, and real consequences. That experience generates a specific kind of skepticism — not philosophical skepticism about AI in general, but calibrated, empirically grounded judgment about the gap between demonstrated capability and claimed capability. Cowen has no equivalent to that. His credulous stance toward LLM claims is in part a function of never having had to make anything actually work.

2 comments:

  1. "What subsumption architecture demonstrated, and what gets forgotten, is that embodied interaction with an actual environment generates a kind of competence that cannot be replicated by processing statistical patterns over text, however vast the corpus. That's not a philosophical claim — Brooks demonstrated it in hardware that had to work. When Genghis stumbled on a rock, the system had to deal with it. There's no equivalent pressure in LLM training."

    Tangential, serendipitous and non standard... and at about 4m to 4 30... why politics. And "about the gap between demonstrated capability and claimed capability".

    "The Ox That's Breaking Your Fantasy Map
    325k views · 3 weeks ago...more
    The Grainbound
    18mins
    "ABOUT THIS VIDEO
    "Stop inventing your politics and start discovering them through the lens of medieval logistics. In this deep dive into worldbuilding, we move past the aesthetics of banners and bloodlines to look at the cold, hard math that built the feudal system: The Supply Chain. Feudalism is just logistics wearing a crown. Most worldbuilders place castles based on "vibes," but historical power was a solution to the Oxen Paradox. If an ox eats 10% of its cargo every fifty miles, your kingdom isn't defined by the King’s will—it’s defined by how far a sack of grain can travel before it’s worthless.

    "In this video, you will learn how to: Read your terrain: Identify the four critical nodes—Chokepoints, Junctions, Surplus Zones, and Landlocked Specialists—that dictate where every barony must exist. Utilize the Three-Day Rule: Understand the physics of the "Caloric Battery" and why river access provides a 4,000% energy subsidy to power.

    "Create Structural Conflict: Learn why Upstream "Source Lords" are naturally rebellious while Downstream "Gatekeeper Lords" are desperate diplomats. Whether you are writing a low-fantasy epic or designing a complex TTRPG setting, this framework will help you move away from "costume humans" and toward a world that feels inevitable because it is rooted in causality.

    "Give your lords a job description, or delete them"

    Comments
    1.9k
    "This is fascinating, it reminded me of Tsiolkovski's rocket equation: A rocket must account for the necessary fuel to reach space, but also for the fuel necessary to carry the fuel to reach space. A space ox."
    ...
    https://m.youtube.com/watch?v=MIqpvpNS5pI

    Bill, I posted this as, it Himo Ludens was at first a game to get humans to realise Homo Ludens is what they want - Steve Jobs said they don't know what they want - the obtuse concepts in "The Ox That's Breaking Your Fantasy Map" would be an excellent imo text to generate a road map and game tool for society to have what they don't know they want.

    Seren Dipity

    ReplyDelete
  2. My favourite manifesto... 25 years ago, and still software is a problem too...
    Stellar commenters and reply. Bill, see Rodney Brooks comment and reply by Jaron. Someone does mention...
    Wednesday, May 20, 2026
    "How come no one mentions Rodney Brooks in the LLM debates?"
    https://new-savanna.blogspot.com/2026/05/how-come-no-one-mentions-rodney-brooks.html
    ###

    "ONE HALF A MANIFESTO
    By Jaron Lanier
    ...
    Reality Club — Part I: George Dyson, Freeman Dyson. Cliff Barney, Bruce Sterling, Rod Brooks, Henry Warwick, Kevin Kelly, Margaret Wertheim, John Baez, Lee Smolin, Stewart Brand, Rod Brooks, Lee Smolin, Daniel C. Dennett, Philip W. Anderson.
    Reality Club — Part II: Jaron Lanier responds; Lanier's postscript on Ray Kurtzweil

    "ONE HALF A MANIFESTO
    [JARON LANIER:] And so I'll here share my thoughts with the respondents of edge.org, many of whom are, as much as anyone, responsible for this revolution, one which champions the assent of cybernetic technology as culture.
    The dogma I object to is composed of a set of interlocking beliefs and doesn't have a generally accepted overarching name as yet, though I sometimes call it "cybernetic totalism". It has the potential to transform human experience more powerfully than any prior ideology, religion, or political system ever has, partly because it can be so pleasing to the mind, at least initially, but mostly because it gets a free ride on the overwhelmingly powerful technologies that happen to be created by people who are, to a large degree, true believers.
    Edge readers might be surprised by my use of the word "cybernetic". I find the word problematic, so I'd like to explain why I chose it. I searched for a term that united the diverse ideas I was exploring, and also connected current thinking and culture with earlier generations of thinkers who touched on similar topics. The original usage of "cybernetic", as by Norbert Weiner, was certainly not restricted to digital computers. It was originally meant to suggest a metaphor between marine navigation and a feedback device that governs a mechanical system, such as a thermostat. Weiner certainly recognized and humanely explored the extraordinary reach of this metaphor, one of the most powerful ever expressed.
    I hope no one will think I'm equating Cybernetics and what I'm calling Cybernetic Totalism. 
    ...
    https://www.edge.org/conversation/jaron_lanier-one-half-a-manifesto

    If you steer clear of Edge - understandable - here it is at...
    https://www.wired.com/2000/12/lanier-2/

    Commenters of note... Lee Smolin, Freeman Dyson, Stewart Brand, ...
    Rodney A. Brooks
    Panasonic Professor of Robotics (emeritus); Former Director, MIT Computer Science and Artificial Intelligence Lab (1997-2007); Founder, CTO, Robust.AI; Author, Flesh and Machines
    "Lee Smolin wrote: 
    ...
    Daniel C. Dennett.


    Enjoy.
    SD.

    ReplyDelete