Why can’t both your grandparents and he celebrate the same achievement on different occasions? Alone time and time with different friend and family groups outside of a romantic relationship is definitely healthy. You two should explore why this bothers him and establish some boundaries.