> In the context of an expert though, where do you draw the line on confidence?

I say: at drawing conclusions (upgrading propositions to facts). It is not necessary to categorize something as a fact before taking action, it is only a cultural norm. The world runs mostly on mere belief, it just doesn't appear that way.