I'm experimenting with mmWave RADAR to get depth mapping without the idiosyncrasies of stereo RGB cameras. Especially in wildly varying environments I think that's the way to go over traditional camera-based SLAM.
But if it turns out to be unfeasible, nothing's stopping us from adding more tracking cameras and doing it that way.
No depth mapping yet, so it'll only be in the background, but first things first.