publication crAIsis
In the September issue of the IMS Bulletin, Po-Ling Loh discusses the urgency to act in the face of the AI disruption to mathematical research and in particular to the publication modus vivendi in academia—that indeed seems to have hit the wall—. This of course intersects with similar concerns and fears in the community, from departmental to international society meetings on a course of action towards a seismic change for the profession.
“Rather than accepting a new reality where researchers are disincentivized to share their work publicly through an arXiv posting or research talk prior to publication, we could purposely excise speed and competition from the research pipeline, thereby stemming the cutthroat competition that threatens to engulf our field. In such an alternative reality, I believe mathematical joy, depth, and beauty could continue to flourish (…) Looking ahead, even if the mathematical abilities of an LLM may soon surpass those of an individual mathematician, we can hold onto hope that the collective skills of a community of mathematicians, collaborating together and assisted by LLMs, might achieve mathematical advances beyond what one human-directed AI system could discover (…) [My proposal is to] only consider papers that are a collaboration of enough experts in a sub-area [and] only submit a paper after agreeing that it contained a truly new, important result”
Po-Ling Loh’s idea is to incentivize collective work and forget about the competitiveness in the profession that is now exacerbated by LLMs, by only considering collaborative works. There is something nice about it, as I always enjoyed the fun and excitement of thinking and working together during small workshops with brainstorming periods, if it rarely concludes with a major discovery. However, I completely fail to see how this would stem the flood of individual submissions to journals and preprint servers—as exemplified by the Polsongate—. Or how a collective (not a von Mises Kollektiv!) would better resists the call of the AI. And how junior, isolated, off-the-grid, researchers would not suffer from this new publication pattern…
Obviously, I am as clueless as most on how to reAIct. For instance, hard bars on publication volumes per individual seem impossible to implement (and will likely create further publications outlets, most likely predatory ones). Using LLMs to check LLM papers is just feeding the beast plus contributing to the glut of papers no one will ever read or check. But it is clear that our journals are now under massive strain that cannot persist for long…
Leave a Reply