This is sort of a misguided take IMO - as if LiDAR and other sensor streams are somehow not large scale data while video is
The bitter lesson isn’t fundamentally even about data. the key ingredient is computation (which does scale with data in modern deep learning). There’s even a whole theme on search outperforming learning - until learning methods changed to leverage computation!
I think in a lot of applications, richer data yields better scaling performance. So the bet for self driving is that the complexity of multiple sensor fusion gives a much better constant factor or exponent in the power law scaling of performance with data and compute
This was literally 2 months ago, so miss me with the "you're wrong, the latest FSD solved it all this time bro, for real, trust me (the 100th time I've heard this)".
Will we be able mid-term to rely on LLMs not hallucinating and causing crashes? Even if the probability is low, the thought that the AI might do something crazy because it's hallucinating is terrifying, so that might be a barrier for adoption. For the same reason, will a (fully) LLM driven car ever be allowed on Western streets? I have serious doubts regarding Europe, at least.
The bitter lesson isn’t fundamentally even about data. the key ingredient is computation (which does scale with data in modern deep learning). There’s even a whole theme on search outperforming learning - until learning methods changed to leverage computation!
I think in a lot of applications, richer data yields better scaling performance. So the bet for self driving is that the complexity of multiple sensor fusion gives a much better constant factor or exponent in the power law scaling of performance with data and compute