I would leave it at 4 bottles for a few more weeks, it's usually around 9/10 months that FF babies drop to 3 bottles. He is taking a good amount at the moment, so stick with it and see how he does If he starts to refuse his mid morning or mid afternoon bottle or they drop to below 4/5oz that's the time to drop to 3.
HTH!
Laura