Dunno about the difference between pure vanilla extract and vanilla extract, but there certainly is a difference between vanilla extract and vanilla essence, which is not a natural ingredient - I think you're fine with the extract, even with some alcohol in, it'll be such a tiny amount I can't imagine it being a problem.
What age is your lo?
Ax