Having gone through both without (high school) and with (college) calculus physics, yeah, it's actually easier with. I think I agree with a sibling comment though, building the two together but taking up the time of two classes (learning the physics by learning the calculus to do it) makes more sense IMO.