(HUGS) Laura. It is so easy for others to judge. They are not the ones sleeping over, dealing with NWs, EWs, etc. If you think he is doing well without the nap, then go for it.
We are having naps most days. M is so tired now that he plays for a bit during his quiet time and then crawls into his bed. I normally let him sleep for about 30 minutes. We always have bedtime resistance, so it is hard to tell. I think that M gets a 2nd wind at dinner time and that no matter how tired he is, it is a fight to get him down.