I knew that Noam Chomsky was very old and he had largely retired from public life, but I wondered if he had something to say on the recent progress in LLM.

Yes, he did, and you can easily find it yourself.