LLMs by themselves are not going to lead to AGI, agreed. However, there's solid reasons to believe that LLMs as orchestrators of other models could get us there. LLMs have the potential to be very good at turning natural language problems into "games" that a model like MuZero can learn to solve in a superhuman way.