My family would say that sentence “with a wry smile”, a useful literary phrase for that particular variant of humor.