The fat from the milk will slow down the metabolism, "leveling out" the release of sugar.

Also lactose takes time to break down...