paulgavrikov
paulgavrikov t1_jdgzmlj wrote
Reply to [D] "Sparks of Artificial General Intelligence: Early experiments with GPT-4" contained unredacted comments by QQII
This a good reminder for everyone to delete comments from tex files before uploading to arxiv ... especially, if they were not meant to be public.
paulgavrikov t1_jdgzg5o wrote
Reply to comment by elegantrium in [D] ICML 2023 Reviewer-Author Discussion by zy415
Depends on the quality of the reviews. In theory, the AC could completely ignore all reviews. However, 7&8 are very good and you definitely have a high chance. Be proud of your work!
paulgavrikov t1_jdgz9be wrote
Reply to comment by sleeplessinseattle00 in [D] ICML 2023 Reviewer-Author Discussion by zy415
Adress this! Ask them why they did not increase their score if all concerns were addressed.
paulgavrikov t1_jdguvmk wrote
Reply to [D] ICML 2023 Reviewer-Author Discussion by zy415
Same here, 3 out of 4 reviewers didn’t respond. And with all due respect, there is no excuse for that. If you agree to serve as reviewer, you also agree to do it faithfully. Unfortunately, the last part is often missed.
paulgavrikov t1_jd3k9l9 wrote
Reply to [D]: Vanishing Gradients and Resnets by Blutorangensaft
Have you tried NFNets https://arxiv.org/abs/2102.06171
paulgavrikov t1_jd3jf74 wrote
Currently there are no good methods to do this. There’s discussion of existing methods and many insights into the problem in this paper https://arxiv.org/abs/2206.14486
TL;DR: which images you should remove depends on the ratio between samples / parameters, no current method works anywhere near ideal, but you may see improvements if you choose the most expensive methods
paulgavrikov t1_jc4gnml wrote
I ditched lightning after a while because I spent more too much time fixing it than doing productive stuff. But I regularly use wandb to track experiments and it’s mostly great!
paulgavrikov t1_jdlld62 wrote
Reply to comment by elegantrium in [D] ICML 2023 Reviewer-Author Discussion by zy415
Awesome! I’m still being ghosted :(