some people use words like that as turns of phrase and are not religious.

You will find atheists uttering phrases like "God fucking damn it" and "Jesus Christ" as expletives because it's common parlance.

Much like 'pray' being synonymous with 'hope'

Same with using Yiddish expressions without being Jewish.