Is it really an issue for you? If he's fine with your DH when you're not there, I don't really see the problem
More of a reason to go out
TBH, I'm a big fan of the path of least resistance when it comes to this stuff because L is so spirited and gets so worked up. DH was settling and L screamed for 3hr straight and DH eventually caved. I cave pretty fast because I don't really see an issue with a few extra cuddles - there will come a time when I am begging for cuddles and waking him at 11am so he's up and dressed before midday... so I may not be the best person to listen to about this one, but then again if you're thinking of doing it 'because you should' or 'because no-one else has these issues', maybe its ok to just know that there are others out there
FWIW, we all eat dinner together then DH does the shower/bath (while I BW), reads some stories, then I do some more stories (what can I say, L's a story-fiend and it actually is a calming activity now), a BF, then DH kiss goodnight, big hugs from me and into bed, so DH isn't completely uninvolved.