The main thing to watch is with him is when he tries to lean back when I'm coming down the stairs - hold tight!
Also watch for head bopping when walking through doorways, and also hard armrests when you're sitting in a chair/recliner/etc.
We have a recliner with some wood on the armrest, I keep a folded up fleece blankie on the armrest to help "cushion" her head if she happens to suddenly flop back that way.
She likes to play a "peekaboo" type game when I'm holding her upright. DH would stand behind me, moving around left/right in/out of her sight. So DD would peek around my head/shoulder to the right, then left, then right, then left... if we're walking while doing this (not intentonally, like when I'm walking her down the hallway to her room for a diaper change & DH happens to follow behind me), I have to make sure she doesn't bop her head in the doorway, LOL.