So do humans. Time and again, KPIs have pressured humans (mostly with MBAs) to violate ethical constrains. Eg. the Waymo vs Uber case. Why is it a highlight only when the AI does it? The AI is trained on human input, after all.
Maybe because it would be weird if your excel or calculator decided to do something unexpected, and also we try to make a tool that doesn't destroy the world once it gets smarter than us.
False equivalence. You are confusing algorithms and intellegince. If you want human level intelligence without the human aspect, then use algorithms - like used in Excel and Calculators. Repeatable, reliable, 0 opinions. If you want some sort of intelligence, especially near human-like then you have to accept the trade offs - that it can have opinions and morality different from your own - just like humans. Besides, the AI is just behaving how a human would because it's directly trained on human input. That's what's actually funny about this fake outrage.
