Just a guess, but I would assume the term factory reset referred to clearing user settings before devices commonly had firmware update capabilities. So the legacy name should not be used to imply how the function should work in relation to firmware downgrade.
I think if it doesn't revert to the firmware it had when shipped by the factory, it shouldn't be considered a factory reset.