How much formula are they having now? If there are no issues with dairy then yes, transition them to cow's milk. If they are having too much milk that will cut their appetite for solids which is more likely to have an impact than not enough milk. That said, toddlers very rarely wake from hunger, it's more likely to be routine related.
Laura