Discussion about this post

User's avatar
Carsten Agger's avatar

I was going to comment on this, but then saw that you addressed it in your closing paragraph.

Still, a small observation, just because I like discussing this:

"It’s funny, too, because Chomsky’s detractors were proven largely right: his search for Universal Grammar has been discredited. The way LLMs handle language is through pure statistics and brute forcing massive amounts of data. So the paranoid Pentagon bureaucrats had backed the wrong horse with Chomsky. But it didn’t matter. Chomsky was still very useful. He helped push the larger field of psychology in the right direction: towards studying minds as computers."

Chomsky's Universal Grammar was _not_ discredited by LLMs working differently. It was, rather, discredited because there is no experimental evidence at all for the existence of Chomsky's "language module" in the brain, and because his theory's predictions regarding the behaviour of the world's languages is not what is observed. _And_ because people working in current neuroscience and biology don't believe that the brain behaves _at all_ like a computer, and certainly not like a digital one (as Chris Knight also points out).

LLMs couldn't discredit Chomsky's theories, because they also don't work at all like the human brain - given that they do inference from humongous amounts of data, while humans learn languages from rather limited amounts of input. Also, LLMs don't have anything at all of what we usually call "insight" or "understanding".

And, of course, studying minds as computers was never the "right" direction for psychology for anybody except the Pentagon people and technocrats, but that's also what you write at the end. Treating the mind as a computer is convenient if you want to simulate it on one, but this metaphor gives no real understanding of what's actually going on in people's messy, non-digital, relational minds.

The parallel to Silicon Valley's much-lauded concept of "disembodied mind" is striking, though: Silicon Valley stars from Stewart Brand to John Perry Barlow used to rant on about the possibility of "disembodied mind", or even "uploading your conscience". But what we understand as "mind" or "consciousness" can probably only ever be embodied.

Which is a nice philosophical discussion for another day :-)

Kevan Hudson's avatar

I can categorically state that I have no ties to Epstein or Maxwell.

Thank you for your attention to this matter.

Excellent article.

19 more comments...

No posts

Ready for more?