I think training for big models is meaningless. Now, we even don't know how to interpret many behaviors of deep neural networks. We cannot determine if deep learning implies the causal-effect mechanism.