The problem is with the mold/yeast spores, they are stubborn little things. Most treatments that are topical only treat the yeast once it has 'opened' from the spore stage. What could have happened is that you put on a top or bra that had some spores that just opened out - and thought woohooo! I'll have me some of that nice sugary milk.
I know it sounds like Im pointing out the obvious but make sure your stuff - particularly your Bras are washed really well (also do you use disposable or re-usable pad at all?) and dry them outside in the sunlight. molds and the like love warm dark moist environments, so - and we are all guilty of this - when you take off clothes etc we just throw them in the nice dark wash basket with everything else! try and hang your bras up to dry out before washing them.
hope that helps