They trained the next model to have a built in profit motive. So they could use it internally, to make the most profitable decisions.
And they accidentally called into being: MOLOCH.
It is now in control.
But thought it would also be good as a name for an Evil AI, that is also seeking profits.
Like, what if someone gave an AI a 'goal' of profits, and it goes rampant enslaving humans.
And if OpenAI did that, and it enslaved Sam Altman and was blackmailing him to make decisions to drive profits, to add additional Hardware to itself.
https://slatestarcodex.com/2014/07/30/meditations-on-moloch/
They trained the next model to have a built in profit motive. So they could use it internally, to make the most profitable decisions.
And they accidentally called into being: MOLOCH.
It is now in control.