ArXiv, comments, and “quality control”

Those of you who browsed the arXiv recently may have seen a link to a user survey on top of the page (as of now, apparently no longer online) (update: still available here, until April 26). I ignored it a few times, until a friend brought this particular bit to my attention.

arxiv

Sure enough, I took the survey. As it turned out, the arXiv was also asking for feedback on what it calls “quality control”: actions such as rejecting “papers that don’t have much scientific value,” flagging papers that have “too much text re-use from an author’s earlier papers” (self-plagiarism) or from papers by other authors (plagiarism), or moderating pingbacks (such as links from blogs or articles) before they appear on the arXiv.

Internet comment sections are in decline everywhere you look. They are mocked, ridiculed, despised. Many websites have closed them already; others have seen their comments become a racist, sexist bog of eternal stench from which any reasonable person is best advised to stay away. I’ve talked about it here at length, with examples and links, and it’s very easy to google up more if you wish.

I’m often told that if a comment section is restricted to “registered” mathematicians posting under their real names, the conversations will be polite and civil, with the rare instances of abuse identified as such and condemned by the community. If that’s what you think, consider that much of what passes for “normal” interactions between mathematicians is viewed as passive-aggressive, if not downright abusive, just about everywhere else. We all know what referee reports can look like, or grant proposal reviews, or MathSciNet blurbs. If you believe that non-anonymity will solve the problem, I could give you many examples of questions from the audience in seminars and conference talks that were at least as problematic as any referee reports I’ve seen.

Women, in particular, get far too many comments questioning our competence, implying that we might not know the basic literature, that we might not really understand our own results, that said results might turn out to be false or trivial if only someone qualified had a look, or some such. We’re also subject to gendered standards of “professionalism” that do not allow us to respond in kind and give as good as we get. But if you tell me that men, too, can get inane, confused, or malicious comments–why, yes, I agree. More reason to refrain from making the arXiv more like YouTube. There’s enough abusive behaviour in mathematics already, on all sides. We should not mandate a form of discourse that has been shown empirically to promote and escalate it. Nor should we mandate having it attached in perpetuity to our formal publication records.

As for “quality control”: there have been well publicized cases where the arXiv moderators might have overstepped in rejecting papers and blacklisting authors. I’m not a fan of flagging papers for “substantial overlap,” either. We often write several consecutive papers in the same area, introducing the same notation each time, stating the same conjectures or prior results for reference, and so on. We might even reuse parts of the same TeX file for such purposes. None of this amounts to plagiarism or self-plagiarism, nor should it trigger red flags.

Now, here’s what all this might mean for the future of the arXiv. Allow me a little bit of speculation here.

The arXiv has become the universally accepted default repository for mathematicians, not only because it provides a service we need, but also because, in not attempting to do more than that, it gives us no reason to not use it. We don’t have to worry that the paper might not “qualify,” that it’s too long or too short, or too expository, or not sufficiently tailored for the “right” audience. We simply post what we think is right. We expect and welcome feedback (I often post papers on the arXiv prior to journal submission, specifically for that purpose), but the site does not allow public abuse or internet flame wars, so no need to worry about that. The bare-bones structure is not a bug, it’s a feature that has been essential for the arXiv’s success.

Currently, the arXiv has little competition. It works well enough for most of us and we have no reasons to look elsewhere. That might change. Discontent breeds business opportunities. The competing site viXra, started by physicists who were dissatisfied with the arXiv’s moderation practices, failed to gain much ground; but if the arXiv were to amp up its “quality control” in ways that test our tolerance, and especially if it were to implement comments and ratings, there just might be a critical mass of scientists willing to try such alternatives. I know I would be looking for them, and I’ve heard from others (including well known mathematicians, and not only women) who feel the same way.

It would be more than ironic if, say, Elsevier or Springer were to set up a competing open access repository where, for a small fee around $100, authors could post their papers on a site guaranteed to be free of comments and ratings. That would obviously discriminate against those unable to pay $100, but there’s nothing stopping anyone from setting up such a site if there is demand, as I assume there would be. Grant holders in many countries are now subject to open access policies that practically mandate the posting of papers on repositories; should we no longer wish to post on the arXiv, we’ll need an alternative. I can’t promise that I wouldn’t switch to a Springer or Elsevier site, in such circumstances. It would be even better if non-profit organizations, such as the AWM for example, were to set up their own preprint archives where the terms of service would reflect the preferences of the membership.

If comments or ratings are allowed retroactively, on papers already posted to the arXiv, then it’s far from clear to me that the arXiv would be able to hold on to such papers. My contract with the arXiv is, essentially, that the arXiv has my permission to distribute my articles on its website and its mirror sites. It does not have my permission to cross-post them on Reddit and Hacker News. By the same token, it does not have my permission to post them on a future site that might continue to use the arxiv.org URL, but would function in substantially different ways. That would have to be renegotiated. Individual mathematicians may have little power in that regard, but if major publishers become involved as per the above, and if they decide to encourage researchers to move their past publications to their servers, then I could think of some interesting ways in which this could develop.

My crystal ball here may well be less than perfect, but I think that some version of this would have to happen. If the arXiv wishes to remain the universal default repository for scientists in the covered areas, the plain vanilla model is the only one that will do that. Quality control is better left to journals, and for those authors who wish to have public discussions about their papers, a wide range of blogs and social media is available. Any changes that alienate a substantial group of users will inevitably lead to the rise of competition, and so within a few years we might well see a variety of arXiv-type sites with different functionalities and user bases.

And that would essentially end the arXiv as we know it.

Update, July 8, 2016: for those coming late to it, I’m also quoted in this Wired article by Sarah Scoles.

Discrete Analysis

You may have seen Tim Gowers’s announcement last week, but if not, here’s the news: we are launching a new arXiv overlay journal called Discrete Analysis. The editorial board consists of Tim Gowers (who will be the managing editor) and Ernie Croot, Ben Green, Gil Kalai, Nets Katz, Bryna Kra, myself, Tom Sanders, Jozsef Solymosi, Terence Tao, Julia Wolf, and Tamar Ziegler. As should be clear from this list of names, the journal will focus on additive combinatorics and related areas such as harmonic analysis, number theory, geometric measure theory, combinatorics, ergodic theory. The temporary journal website is open now, in fact we have already received the first submissions.

“ArXiv overlay” means that we will not be “publishing” papers in the traditional sense. Most of us already typeset our own papers and use the arXiv for quick, reliable, stable worldwide dissemination of our results. It is not clear that mathematical journals can improve much on that; if anything, publication in established journals is currently more likely to impede the dissemination of science through paywalls or embargos than to facilitate it. What we can provide is a refereeing and certification service where we manage the peer review and, when the outcome of the review is positive, attest through publishing the link on the journal website that the paper has been judged to be of suitable quality for publication in Discrete Analysis. Tim’s post has much more information on both the scope of the journal and the technical details of how we expect it to work. If you are finishing an article in one of the covered areas of research, I hope that you will consider Discrete Analysis as a possible publication venue. I’m proud to be on its board.

A few more inside-baseball comments under the cut.
Continue reading “Discrete Analysis”

More on commenting and the publishing reform

Ingrid Daubechies asks on Math 2.0:


Suppose most mathematical research papers were freely accessible online.

Suppose a well-organized platform existed where responsible users could write comments on any paper […]

Would this be, or evolve into, a useful tool for mathematical research? What features would be necessary, useful, or to-be-avoided-at-all-costs?

This is not a rhetorical question: a committee of the National Research Council is looking into what could be built on top of a World Digital Math Library, to make it even more useful to the mathematical community than having all the materials available. This study is being funded by the Sloan Foundation.

There’s good stuff in the comments, especially here and here. I’ve said before that having comments on papers is not my highest priority, and I can think of other improvements on a comparable scale (significant, but without overhauling the whole system) that would add more value. So, in case anyone is interested and for future reference, here’s my take on a few specific issues that seem to come up again and again. In this post, I’ll stick to relatively small stuff, generally of the kind that could be set up initially by, say, NRC without much help from the community, as per the question I started with. There are of course bigger fish to fry, from the creation of new journals to rethinking funding mechanisms for science. But that’s for another time.

Continue reading “More on commenting and the publishing reform”

On commenting, conversations, and epijournals

Earlier this week, I closed the comments on this blog. I was reading this post, by another blogger who shut down the comments at his place, and realized that I had wanted to do the same for some time. I really encourage you to read the entire post. This is not a matter of not keeping with the times (quite the opposite – I’ll get to it shortly), or of not having the right technical fixes for specific trolling problems. It’s about what conversations we want to have, when, where, and with whom – and when we’d rather walk out and do something else that’s more valuable.

In my own blogging experience, the feedback I get by email and in person has long been infinitely more valuable and insightful than most of the public comments I was getting here. There have been exceptions, and I’m grateful to those commenters, but there have also been entries where I deleted more comments than I approved. Instead of an attractive feature, it became a chore. And ultimately, this blog is not a community service that I am obliged to provide. I will not do it if I cannot enjoy it, and so changes had to be made.

The more I think about it, the more I agree with Dan Conover that open commenting for everyone might be on its way out as the default mode on the internet. Continue reading “On commenting, conversations, and epijournals”

Analysis and PDE

I’m happy to announce the launch of a new journal called Analysis and PDE, based at UC Berkeley and published by Mathematical Sciences Publishers. I’m on the editorial board of the journal.

From the Analysis and PDE web page:

Analysis & PDE publishes high-quality original research in all areas of mathematical analysis and partial differential equations. The field is interpreted broadly and, and for example, includes topics such as harmonic analysis, operator algebras, index theory, and analytic aspects of mathematical physics.

The journal aims to be the leading specialized scholarly publication in mathematical analysis. The policies of Analysis & PDE are set by the editorial board – a group of working mathematicians – rather than by a profit-oriented company, so they will remain friendly to mathematicians’s interests. I n particular, they will promote broad dissemination, easy electronic access, and permissive use of content to the greatest extent compatible with survival of the journal.

Submissions are welcome!