I think this might be another case of everyone is in another part of the world so everyone does something different. I have purchased "safe" bottled water and used it when traveling. I knew I where I could buy it so I felt okay about it. Plus, I had some with me in case of emergency. Where I live, some hotels use water softener and such so the taste could be different then what my kids were used to.
My lo was at a stage where I had to be very careful about germs so just consider how you are going to wash your bottles. Might not be a huge deal for you at all. I brought a small basin, dish soap, and papertowels. Used the papertowels to dry what needed to be dried and used to line counters in order to keep things super clean.
Sorry, didn't check how old your LO is!!