I think, usually the criterion is mutual understandability, but there are exceptions like chinese, where some linguists argue, the dialects should be considered different languages, because people from different provinces can't understand each other, but they are still considered dialects because of the political implications.

Why do some countries still have strong diglossia patterns and why did some (like chinese) never develope a phonetic skript to replace the old scripture?