r/deeplearning • • Jul 07 '24

GANs

Post image
276 Upvotes

18 comments sorted by

28

u/I_will_delete_myself Jul 07 '24

GAN is something you want to do when you want to just punish yourself or make something hard to replicate as a research paper.

8

u/DaSpaceman245 Jul 08 '24

Oh boy you’re totally right lmao. I did my graduate studies thesis on implementing and improving GANs in medical space and 90% of the time I was swearing that it wasn’t converging after weeks of training

7

u/I_will_delete_myself Jul 08 '24

Oh boy. Nothing like the Nash equilibrium screwing over or modal collapse.

4

u/Competitive-Store974 Jul 08 '24

Yeah my PhD involved GANs in medical imaging. My conclusions? Never use GANs in medical imaging.

2

u/DaSpaceman245 Jul 08 '24

Lmao I reached the same conclusion and I don’t know why anybody might want to use them in real life. I kinda wanted to write this down at the end of my thesis….

13

u/[deleted] Jul 07 '24

Gan is nothing but data augmentation with extra steps . Prove me wrong

8

u/deepneuralnetwork Jul 07 '24

i don’t know if i entirely agree . Prove me wrong

1

u/[deleted] Jul 07 '24

You agree but you don't know. Proved wrong

1

u/deepneuralnetwork Jul 07 '24

what is augmentation’s outsized role in a vanilla GAN? are you suggesting GANs only work well when the data is augmented to the extreme?

-1

u/[deleted] Jul 07 '24

Gans are not doing anything more than what your typical data augmentation does. But good packaging though, with all the cool mathematics!

2

u/deepneuralnetwork Jul 07 '24 edited Jul 08 '24

i mean doesn’t even sound remotely close to correct, but cool?

0

u/I_will_delete_myself Jul 07 '24

RLAIF

1

u/[deleted] Jul 07 '24

Gan ≠ rlaif

0

u/I_will_delete_myself Jul 07 '24

Generator gets feedback from the AI to classify the quality of its output.

0

u/[deleted] Jul 08 '24

[deleted]

1

u/I_will_delete_myself Jul 08 '24

It was inspired by game theory of two competing models with a goal of reaching even win rates. The hope is that the by product of reaching that will lead to the generator creating realistic outputs. Managing vague game theory is much harder than just a simple metric like diffusion which is why most people prefer that method.

Issues like the Nash equilibrium is a pain in the but to deal with in GANs and not easy to be specific on.

2

u/One_eyed_warrior Jul 08 '24

They're fascinating tho, that's why I get obsessed with them time to time

1

u/prayformornings Jul 08 '24 edited Oct 01 '24

station long cow start panicky dull agonizing childlike public poor

This post was mass deleted and anonymized with Redact