If you have the courage to only offer water tomorrow do that. Maybe offer water but take 1oz of milk up with you as a back up plan - that's the sort of thing I do because I just don't like upsetting him!
Is the water in a bottle or sippy cup? I used a bottle for a while before switching. It doesn't matter which, I'm just curious.