If yogurt didn't work out, I'd skip dairy entirely for a good couple months. The only exception I can think of is ghee, clarified butter, which has the milk proteins pretty much removed.
When you go back, may want to consider a challenge with goats' milk first, although it's a LOT more expensive than cows' milk.