Viewing a single comment thread. View all comments

filipposML t1_jaooo3f wrote

Reply to comment by avialex in [D] Are Genetic Algorithms Dead? by TobusFire

Hey, this is it actually! We are optimizing a discrete variational autoencoder with no gumbel-softmax trick.

1

filipposML t1_jaop5vw wrote

Of course we require no encoding model, so the notion of a latent space only holds up until closer inspection.

2

avialex t1_jap04wq wrote

I was kinda excited, I had hoped to find an evolutionary algorithm to find things in a latent space, I've been having a hell of a time trying to optimize text encodings for diffusion models.

1

filipposML t1_jaq6tpq wrote

You just need a notion of a fitness function and then you can apply permutations to the tokens.

1