Maybe not this specific risk, but a few real risks IMO jump top-of-mind: early movers use "safety" to build a regulatory moat; the inevitable blurring between private and public data, and information ownership; further extreme polarization by feeding acceptable, authoritative-sounding misinformation to <everybody>