Output impedance is one possibility. It becomes a problem when it is either frequency dependent, or if the headset's impedance is frequency dependent, as it adds an extra resistance that lowers the voltage seen by the headset in the parts of the frequency response where its own impedance is also low. Good gear has roughly 1 ohm output impedance or less, where it is considered no longer to matter.