What LLMs can and can't do

He also builds his own ideas, which feature minor original inventions. Like this "jeep" which has a spare tire on the back -- not something he saw in any official set. Lego is the best toy ever by the way pic.twitter.com/MtBAZbYy5M

— François Chollet (@fchollet) June 22, 2024

There is no AI system today that can invent and assemble its own Lego car after having seen only a handful of Lego sets in total.

And that's why it makes no sense to me when people say that LLMs have "the intelligence of a high-schooler".

When it comes to knowledge, a LLM has…

— François Chollet (@fchollet) June 22, 2024