I would definitely put him to sleep earlier than 10pm, whether it be a nap or part of night sleep, either way when you feed him next just feed him no activity time. I'm not sure what age your lo is, but if he is under 3mo, sometimes it is hard to have a set bedtime, so just work with his sleep cues for a week or 2 & make sure he isn't too overtired & then you can kind of "manipulate" his bedtime to suit your ideal time.