hi, she is probably get lots of water from her milk (bottle or breast) so doesn't need a lot. As long as she is happy to play with it, and unless it's really hot or she doesn't have many wet nappies I wouldn't worry. I think as long as it's fun for her, you are setting up good habits for the future.
I would let her regulate herself, she will know when she's thirsty!