Submitted by von_oldmann t3_z1dc1g in MachineLearning
AISTATS 2023 reviews are out, creating a thread for discussion!
Comments
Slight_Lawfulness_41 t1_ixakxc5 wrote
2 out of 5 reviewers miss. Will that be possible to add new reviews?
no_user_pro_user t1_ixaq919 wrote
New to this, no idea what it means when a reviewer misses to review - any guidance ?
Simping4Kaiming t1_ixar1qh wrote
Chances with 4,5,6,7,8 ?
von_oldmann OP t1_ixawhsd wrote
The email said that more reviews might be added before Nov 23rd, so you might still get them.
no_user_pro_user t1_ixawljv wrote
Ahh thanks !
von_oldmann OP t1_ixax12x wrote
2 might be an outlier considering your other scores! Not really sure how this could happen. But I hope it pans out for you
lameheavy t1_ixaz4r9 wrote
I'm in a very similar situation myself. I'm not very hopeful that I can change their mind with a rebuttal. Gonna try and hope the meta-reviewer realizes how much that reviewer missed the mark. I hope AISTATS is still small enough for that much attention to detail (I know it's not just let me cope).
liujiashuo t1_ixb0o5k wrote
Got 6 reviewers ...how to reply in only a 1-page pdf...
Purple-Obligation-70 t1_ixb1at4 wrote
Got only two reviews. Been checking cmt every hour since there won't be any notification of the added review. :\
__pringles__ t1_ixbd4tb wrote
64673
7 has confidence 2, rest all are of confidence 4.
The reviews are really well thought out, and recommend some good experiments, also highlight some weaknesses. Some also praise the cleverness and intuitiveness of the idea, and already thorough experiments!
I guess the new experiments will take some time to finish and update (one even asked for a user study!), so not sure whether I will be able to put new results in the rebuttal. But I suppose, the suggestions could make it a stronger submission next time! Does providing new supporting results really help during the rebuttal?
Trying-to-buildpc t1_ixbh3ow wrote
4 7 6 3 9 with confidence 2 3 3 2 4.
Holy this is the reviews with largest range and variance that I got. A nice rebuttal might save my ass.
veejarAmrev t1_ixbowi1 wrote
Well, your two lowest scores also come with the lowest confidence. I think you've nothing to worry about.
No-Connection4924 t1_ixbz047 wrote
We got 6,6,6,6,6,4,7, any chance?
veejarAmrev t1_ixbzta2 wrote
and they say there is a shortage of reviewers
No-Connection4924 t1_ixc5vti wrote
This is Indeed strange. How does sisters decide how many reviews for one paper?
maybelator t1_ixc8f5q wrote
100% depends on your rebuttal. Show that you understood the low reviews and improved your paper in consequence. Or if a bad review is nonsensical make it clear with line ref and citations.
maybelator t1_ixc8iei wrote
I think a meta reviewer fucked up. Maybe to eager on emergency reviews?
Bot-69912020 t1_ixc9soc wrote
9 and 3, both confidence of 4 lol fortunately, the other reviewers are also more positive
Simping4Kaiming t1_ixchk1c wrote
Thanks, how is the usual average ?
von_oldmann OP t1_ixcnndc wrote
The reviewers decide the confidence themselves
pointguard0 t1_ixcqk21 wrote
got 64686, what are the chances?
TraditionalAd7283 t1_ixctbjc wrote
I want to congratulate you...
reviewer with score 4 would increase the value from the sound rebuttal process.
TraditionalAd7283 t1_ixctdsr wrote
Got 77655 with confidence 33444...
Coin toss?
maybelator t1_ixcyhrp wrote
Papers are not selected based on their average, but wether or bot there is a consensus towards acceptance. Show the meta reviewers that you can meaningfully address the reservations of the 4 and 5, or show that they are not valid (be very careful with this route).
Based on the scores, the scale tips in your favor. But the rebuttal will be critical.
machinesyall t1_ixcyk4y wrote
A lot of the reviews posted here seem pretty good (mean around 6, which is toward acceptance on the scale), why are these papers considered borderline? Based on how noisy the process is it seems unlikely for a paper to get all accepts across the board...
no_user_pro_user t1_ixcz656 wrote
Any chance with 4 5 6 7 7 ?
ResponseVisual341 t1_ixczf3a wrote
5 5 4 5 4 (confidence: 3 2 5 4 4). Any chance of acceptance if we address the concerns (mainly more experiments)?
__pringles__ t1_ixd4aok wrote
Any guide on the norms of writing a rebuttal? This is my first time writing one, so sample rebuttals will be really appreciated!
KindlyExplanation647 t1_ixd7k9w wrote
i think you still have a chance
desecrated666 t1_ixduscb wrote
55546(44434) here…I am personally pessimistic already : (
Swimming-Pool397 t1_ixe2j4f wrote
Tim rockatchsel ucl shared a really good guide on twitter!
the_universe_is_vast t1_ixeb66h wrote
- All confidence 4. The 5 has a very short review and seems to have misunderstood the paper.
Pitiful_Highlight200 t1_ixg7vpq wrote
ok so if I assume that the replies here are a random sample, then basically a high percentage of people get contradictory reviews (Some very high and some very low).
I got 77744 with confidence 23344. What on earth is happening? I don’t know what my chances are but how is it possible for papers to get so different ratings?
brucebay t1_ixgi1yn wrote
Thank you for the explanation.
PenJumpy5757 t1_ixgq7bg wrote
what is the chance for 67676
Lopsided-Giraffe-671 t1_ixh41km wrote
As a reviewer, when can you see the reviews from other reviewers in CMT for AISTATS? If I remember correctly from last time, it was the same time as they were released to the authors.
lameheavy t1_ixirprt wrote
Please update when you do:)
cookiemonster1020 t1_ixqqh2l wrote
Are there instructions for format/length of rebuttal?
​
edit: nevermind, found the template at the bottom of the FAQ
lameheavy t1_ixsyiic wrote
You’re good. Address the comments on the 5 and it’s 100%…honestly even with out that you’re fine
Obvious_Swordfish172 t1_iyajtec wrote
2 6 6 7 with confidence scores,
5 4 2 4
Reviewer 1 also clearly misunderstood the paper.
What are my chances?
Outside-Fun-4954 t1_ixaeo4j wrote
76825
Got 2 I think I have no chance :(