Viewing a single comment thread. View all comments

literum t1_iy9spar wrote

Reply to comment by crude2refined in [r] The Singular Value Decompositions of Transformer Weight Matrices are Highly Interpretable - LessWrong by visarga

Could you give a reference for "V1 features"? I couldn't find anything googling.

4

beezlebub33 t1_iy9tozq wrote

V1 refers the the mammalian primary visual cortex. http://www.scholarpedia.org/article/Area_V1

Cells in V1 respond to simple features such as lines of various orientations, certain simple frequencies, colors, etc. the article discusses it more.

The first layer of a CNN does something similar.

25

SlayahhEUW t1_iya6l1f wrote

Roughly it's the base mammalian feature extractors. This can also be found by performing principal component analysis of the data, the first layer of a CNN will after training have the same representation as the PCA of the data.

4