I've lived off of each main release of the Pi and a few other SBCs. I've stuck to running 32bit releases for the time being because of bad experiences with 64bit issues.

Things are much more livable currently with SBCs largely adopting faster USB, PCIE or EMMC storage.

Even as an ARM enthusiast we are still years away from the average person being happy with the experience so tailor your expectations accordingly.