I would just try and do it slowly at this stage. There is no rush to drop the DF at this age, but as you said your lo is getting more than enough through the day.
I would try and cut it down slowly, and then see how your DS takes it.
Good luke, keep us posted on how you get on.