ID3 classically builds a tree by maximizing entropy gains in leaves, thus removing some irrelevant variables.

You may also be interested in energy-based models.