Yeah, I speak a little Japanese, so I was able to ask one of the people working at the museum.
It really depends on the shrine. Some explicitly allow lifting and some have stones that you're not allowed to touch. So it's best to ask in just about every case.
I would have thought stone lifting etiquette would have prevented stones in shrines, and can see them being the biggest attacked by this hobby.