r/MachineLearning • u/Gravitist • 8d ago
Discussion ICML 2027 Changes [D]
Just read the ICML 2027 CFP and it looks like they’re trying to tackle the submission explosion in a reasonable way. Under the new two-stage process, the area chair decides whether a paper goes to full review, and any proposed first-stage rejection has to be confirmed by a senior area chair. Authors get a short justification by Feb 23. On top of that, nobody can be on more than 20 submissions, every paper has to name a reciprocal reviewer from its author list (max 6 papers per reviewer), and anyone with 3 or more submissions has to serve on the program committee. Papers that don’t comply may be desk rejected.
But I think the biggest change is that each author can be on at most one paper with no eligible reciprocal reviewer among its authors. So if you keep putting your name on papers with coauthors who can’t review (undergrads, interns, people outside the field), you run out of free passes after one.
Honestly, it sounds like a pretty reasonable fix. Reviewer load has been out of control for years, and tying authorship volume to reviewing duty seems fair. My only worry is the first-stage cut, since a quick AC read could miss a good paper, though the SAC check helps. What do you all think? Does this sound like a good solution, or will it just push the problem somewhere else?
25
u/like_a_tensor 8d ago
wHy arE You gAtekeEpIng sCIenCe /s
Good changes imo
5
u/RobbinDeBank 8d ago
They are gatekeeping me from doing over 20 sciences a year!!!!!
9
u/MattAlex99 8d ago
Just split your papers across ICML, ICLR, NEURIPS, and AAAI ;) That way you can do at least 80 sciences per year!
2
2
u/MeyerLouis 8d ago
The only thing that stops a bad guy with a science is a good guy with a science. You can pry my science from my cold dead hands. My right to do science SHALL NOT BE INFRINGED!!!
1
u/Exotic_Zucchini9311 7d ago
They are also gatekeeping high scoolers from 'contributing' to ICML more than once! So shocking and cruel!
14
u/kindnesd99 8d ago
Everyone whines about AI conferences but in fact it is the best of worst situations. Yes you have a submission explosion and review noise- but it is somewhat fairer than other fields where you have to belong in a cartel before you can even be considered, due to their single blind system that favours the old boys. I think this system is as good as it can get. Before you whine and say 20 is too many, consider large labs with a PI and students who need to graduate. What we need is a system that flushes out poor submissions from people trying to game it, rather than one that punishes these groups.
And calling it here first: the desk rejection that people have advocated so fondly will be a shitshow. See, for example, CHI (hci conference). It caused a lot of upset remarks from the same people who were barking for things to be done.
5
u/AX-BY-CZ 7d ago
I'm not shedding any tears over multimillion dollar labs/centers with an army of students and postdocs. Those PI's already have hundreds of publications and tenure.
2
u/Holiday-Ant4283 7d ago
submission fees? this reminds me of planned economy with ration quotas vs market economy. maybe instead trying to shape the borders of what is allowed, it would be better to align incentives?
3
u/illustrious_trees 7d ago
would kill submissions in countries where conversion rates to usd are higher than purchasing parity
1
u/Holiday-Ant4283 7d ago
how many of those? could give exceptions for certain countries or provide grants.
0
u/Pseudomanifold Professor 7d ago
But those PIs could also—hear me out, that's quite a crazy idea—not be on papers they did not contribute to. What? How quaint! Giving credit to their students...
2
u/kindnesd99 7d ago
There are institutional requirements that require PIs to be on the author list. Moreover it is common at least in engineering for the last name to be the PI of the project.
1
u/Pseudomanifold Professor 7d ago
I am aware that it's common but it often runs counter to all authorship guidelines (of the ACM, for example). I also know of no institution that requires this. Are you saying uni state that professors need to be on papers? Never heard of that TBH.
2
u/kindnesd99 7d ago
Some universities have to be accountable for the papers that have ther institution listed on it. Students therefore have to coauthor with a senior author. A PhD student publishing without his supervisor is also strange
1
u/Pseudomanifold Professor 7d ago
Totally get that but if it's only about accountability, they can just check it. Authorship confers certain privileges and responsibilities IMO.
(And publishing without one's own PI is quite common in mathematics for example.)
6
u/InterestingCarrot997 8d ago
tying pc duty to 3+ submissions is fair, but i'd watch whether the reciprocal reviewer just becomes the most junior author on the list. that doesn't cut load if those reviews are thin.
3
u/Zywoo_fan 8d ago
This seems reasonable. Hope the ACs do a good job in weeding out the slop in the first stage.
2
u/Old_Stable_7686 8d ago
> each author can be on at most one paper with no eligible reciprocal reviewer among its authors
Still wondering how this helps the explosion? Are there people who just want to be in as many papers as possible with undergrads or something? I can think of the case of big labs, where a PI has many PhD students. Other than that... I don't know.
1
u/tariban Professor 7d ago
We're currently experiencing huge problems where undergrads with no research experience vibeauthor 20 submissions to a conference/workshop.
The motivation seems to be to build up a CV for PhD applications. If anything, these people are just ensuring they never get an offer. It's just a signal that they have no idea what actually constitutes good research, and that they are lacking in ethics.
1
u/Old_Stable_7686 7d ago
It's just crazy that they can convince a senior researcher to be on the paper with them :(
1
u/Vegetable-Formal-753 Researcher 8d ago
In my openion it helps! I went to top rated conferences this year and I've seen undergrads didn't even read their work and just have script for the presentation... One guy was even a monster! he opened chatgpt on his phone and typed questions asked to him and read the answer in the presentation! Some people do this to get scholarships and so on... aaaaaand they're supported by their professors like raising young spies (if you know you know 🥸)... I really see this is a very reasonable way to eliminate this nonsense
1
u/Old_Stable_7686 8d ago
That makes a lot of sense for the scholarship issue (also the internships xD). My blacklist has grown significantly this year, also thanks to this trend. That's why I was wondering why some senior researchers are willing to take such a risk for these sloppy papers.
2
u/isthataprogenjii 5d ago
99.9% of the papers are AI generated slop. Just end the conference at this point. No use pretending.
3
u/Holiday-Ant4283 7d ago
introduce submission fees! (around 100$) which could be used as salary for editors who do the first stage review and early rejects (the system that works in journals). and some of the fees could be used to reimburse part of the conference attendance fee for accepted papers.
it would naturally limit the 20+ half-baked LLM generated submissions.
1
1
u/nobodylsk1 5d ago
I also really appreciate that they adopted the NeurIPS contribution type system. It definitely helped in NeurIPS 2026 match us with better aligned reviewers - unlike ICLR this year, where our theory paper ended up with empirically minded reviewers who just asked for endless experiments during the rebuttal.
1
1
u/Low-Transition-2751 2d ago
submissions per author should be capped at max 5 and solo author papers should be capped at 1.
1
u/AppropriateCry404 2d ago
I think this was also applied in ICLR because I saw one paper in my batch got desk rejected by PC due to its inferior quality.
-1
u/didimoney 7d ago
This recipeocal review thing is not great imo. You end up with people that got a lucky accept once that have to review work they are completely unqualified to judge. That's how the acceptance becomes even more random.
It's been like this for a few years now though, so we can just hope the big three explode soon.
75
u/juliankeynes 8d ago
20 submissions is ridiculously high still.