When you heat the bottle the milk goes up the middle part. Laws of nature
so I did the same thing - I took them off completely when I heated them. I give her cold milk now, though.
I'm not going to use these again if I have any more kids. Pain in the you-know-what to clean and the leaks do not endear them to me either.