Ditto, the only reason to use gloves is if you want to completely avoid fingerprints and/or finger oils on things, but 99.9% of electronics work involves touching delicate parts on edge (where the oils won't cause any issue) or using tools like pliers, spudgers, tweezers, etc.
If you're rubbing your oily fingers all over chip surfaces and connectors, that's on you :D