spring_m
spring_m t1_irq31mn wrote
Reply to [D] What kind of mental framework/thought process the researchers have when working on solving/proving the math of the new algorithms? by aviisu
Another important skill is being able to understand what is truly crucial to a solution versus what is nice to have. For example you mention VAEs which are used to encode the images in latent space for stable diffusion etc. Based on some experiments I've done you don't actually need a VAE - a vanilla convolutional auto-encoder is good enough since you don't actually sample from the latents - the diffusion takes care of that.
spring_m t1_is4biri wrote
Reply to [D] Are GAN(s) still relevant as a research topic? or is there any idea regarding research on generative modeling? by aozorahime
Diffusion models are the new cool kid on the block which means a lot of research interest but also a lot of low hanging fruit. I don’t think the ideas of GANs will be completely obsolete though. For example the VAE in stable diffusion is trained using an adversarial loss - without it the decoded images would be much more blurry.