Not sure why you focused on the "what are you having" part of it since that was the only one that made sense since not knowing the gender and "figuring it out" when the child is born isn't really weird at all. Saying it's annoying instead of exciting seems like a bigger deal to me.

Also it would definitely not have been weird or awkward to just say you misheard and you do infact not have a kid on the way.