Yeah, usually... But the default fallback mechanism for "I can't connect via TLS/the certificate doesn't match/is expired/something is wrong" is either to ignore the invalid certificate or fall back to plain text.

It's better that directly sending plaintext but only marginally.