This is pretty common, but yes, it is annoying. Try going to the "About" page on Quora while logged in without accidentally following random users or topics: http://www.quora.com/

A fixed footer could solve this issue.