My point of them being orthogonal is that both ends of the seesaw can come down together. The logical conclusion is that they can come up together. In other words, it is not a seesaw.
Counter example - the usage of a password manager so that you have strong passwords on every service. It is extremely convenient (I don't have to remember passwords anymore, just the one for the password manager). It is also inherently more secure, as I can now use a different strong password for every service.
If the password manager is cloud backed, you're at risk of a LastPass-style data breach. If it's local only, you're at risk of someone confiscating your device also removing your access to all your online tools.
(I think I'm edging towards "measuring secureness is really hard", which isn't where either of us came in).
Counter example - the usage of a password manager so that you have strong passwords on every service. It is extremely convenient (I don't have to remember passwords anymore, just the one for the password manager). It is also inherently more secure, as I can now use a different strong password for every service.