TBH, I don't think the bottle is your problem, rather the pacifier! We had one night feed (breast, so a bit different I know) until just over 1yo. If he was sleeping well other than that one bottle would you be so concerned with it?
Does he know how to replug himself? Have you tried teaching him during the day? My ds never took to a paci but I've read on the boards about moms putting a dozen pacis in the crib so that there's always one within reach for lo to replug, or sewing some onto a muslin or lovey to keep in the crib to easily grab and replug. Or would you want to wean the paci entirely?