Unfortunately just gluing these is always going to respond with an issue like this as the walls and wood are always expanding and contracting slightly with heat/cold and moisture in the house and atmosphere. These types of trim pieces require some pin nailing to remain secure. As someone else mentioned above, once nailed, you can use a wood putty and light sanding, and thin layer of paint and you’ll never see the holes.