I agree with you 100%, this is the primary reason why we haven't deployed caddy for at least internal services where I work. I don't want to have to upgrade "everything and caddy" every time the update window rolls up.