I watched The Muppet Show as often as I could and have all of in reruns. Not every guest star interacted with the Muppets. Quite a few were very obviously talking to Frank Oz or Jim Henson (the puppeteers) and not directly to Kermit or Miss Piggy. I remember distinctly that Julie Andrews had great chemistry with the characters.