As you have him out more often awake, I suspect he'll adjust a little bit. He's probably freaked out wondering where he woke up, poor guy!
Meanwhile, can you take a favorite blanket with him, or at least cover part of his stroller/carrier/whatever so he has time to acclimate?