...But the term infantry literally does mean a group of infants.

‟Infant” meaning someone inexperienced, of low rank and young.

So it is less a joke, and more a fun fact, in that a group of babies is called an infantry :S