It depends on society's tolerance for death honestly. You're not going to be VTOLing a 737s worth of people so you're probably talking about the number of fatalities in a mid size SUV. People would care a lot less if the routes didn't take them over dense urban areas and the chance of one coming down on their head is super low.
It really depends on what it falls on or smashes into and if the VTOL has experienced lithium battery fire or not. If you use it to move between cities it could probably work just fine.
