Hi Debbie,
Yes, IMO it's a good time to stop the feed. It's up to you whether you want to try dropping it 'cold turkey' or gradually, but it sounds like you've already had a go at doing it gradually. IMO there is a chance he could be stirring habitually at around the normal DF time.
There was an info box in the BWSAYP that said if a DF happened after 11pm it might disrupt night sleep - one of those mysterious things that Tracy just seemed to know from experience. However, in any case you'll need to bring it forward at the same time as reducing the quantity. That way, I guess your baby, physically and psychologically, doesn't still 'expect' it at the same time every night - or put another way, it kind of gently weans him off that expectation, IYKWIM? That also might help put a stop to the potential for the wake-up to become habitual.
Cheers
Nikki