I am still shocked as to how densenets are not the standart in the industry, also with a cross stage partial design you split the gradient flow and allow for much much easier training process. Is it the complexity of implementation thats holding them back I wonder?
Furrealpony t1_itdbrky wrote
Reply to comment by seba07 in [D] What things did you learn in ML theory that are, in practice, different? by 4bedoe
I am still shocked as to how densenets are not the standart in the industry, also with a cross stage partial design you split the gradient flow and allow for much much easier training process. Is it the complexity of implementation thats holding them back I wonder?