We will see a completely new type of computer, says AI pioneer Geoff Hinton https://t.co/4TffDqbQyZ via @ZDNET & @TiernanRayTech
— Bill Benzon, BAM! Bootstrapping Artificial Minds (@bbenzon) December 27, 2022
From the article:
Future computer systems, said Hinton, will be take a different approach: they will be "neuromorphic," and they will be "mortal," meaning that every computer will be a close bond of the software that represents neural nets with hardware that is messy, in the sense of having analog rather than digital elements, which can incorporate elements of uncertainty and can develop over time.
"Now, the alternative to that, which computer scientists really don't like because it's attacking one of their foundational principles, is to say we're going to give up on the separation of hardware and software," explained Hinton.
"We're going to do what I call mortal computation, where the knowledge that the system has learned and the hardware, are inseparable."
These mortal computers could be "grown," he said, getting rid of expensive chip fabrication plants.
"If we do that, we can use very low power analog computation, you can have trillion way parallelism using things like memristors for the weights," he said, referring to a decades-old kind of experimental chip that is based on non-linear circuit elements.
"And also you could grow hardware without knowing the precise quality of the exact behavior of different bits of the hardware."
The new mortal computers won't replace traditional digital computers, Hilton told the NeurIPS crowd. "It won't be the computer that is in charge of your bank account and knows exactly how much money you've got," said Hinton.
"It'll be used for putting something else: It'll be used for putting something like GPT-3 in your toaster for one dollar, so running on a few watts, you can have a conversation with your toaster."*
I have a number of posts that speak to this, for example, The structured physical system hypothesis (SPSH), Polyviscous connectivity [The brain as a physical system], one of the various posts tagged with the label "polyviscous".
*Umm, err...You're kidding, right? Who'd want to chat with their toaster? Now, your wristwatch, that's something else.
No comments:
Post a Comment