acertainmoment
acertainmoment t1_ivaloxt wrote
Reply to [D] Has anyone tried coding latent diffusion from scratch? or tried other conditioning information aside from image classes and text? by yamakeeen
Most likely you won’t need to code everything from scratch. You’ll probably just need to add an nn.Linear or a 1x1 conv to convert whatever dimension your brain activity data is into the dimension of the tensor that it is currently conditioned on (I think it’s 1024 or 2048 dim embeddings currently not exactly sure)
acertainmoment t1_iv1ddh0 wrote
Reply to comment by carlthome in [D] What are the major general advances in techniques? by windoze
yup, same thoughts. BatchNorm was the OG norm. The cousins came later
acertainmoment t1_jcm22en wrote
Reply to [R] RWKV 14B ctx8192 is a zero-shot instruction-follower without finetuning, 23 token/s on 3090 after latest optimization (16G VRAM is enough, and you can stream layers to save more VRAM) by bo_peng
tried a small modification to one of the examples on huggingface :)
https://ibb.co/zNS3H1J