It is an approach problem. You can engineer it as much as you want but the current architectures wont get us to AGI. I have a feeling that we will end up over engineering on an approach which doesn't get us anywhere. We will make it work via guardrails and memory and context and what not but it wont get us where we want to be.
Have worked on a few Big Data projects:
- Sensor Data from haul trucks to predict their failures and optimize their routes in the mines
- Telematics data for insurance companies