Submitted by init__27 t3_10dggxc in MachineLearning
JustOneAvailableName t1_j4my6kp wrote
Reply to comment by timdettmers in [D] Tim Dettmers' GPU advice blog updated for 4000 series by init__27
Great article!
You say this about sparsity:
> It does not seem so. Since the granularity of the sparse matrix needs to have 2 zero-valued elements, every 4 elements, the sparse matrices need to be quite structured.
Wouldn't a more slightly more structured dropout be a perfect fit?
Viewing a single comment thread. View all comments