1 Citation: A. Hocquet (2020) Open Science in Times of Coronavirus: Introducing the Concept of "Real-Time" Publication. Substantia 4(1) Suppl. 1: 937. DOI: 10.13128/Substantia-937 Received: May 11, 2020 Revised: May 21, 2020 Just Accepted Online: May 22, 2020 Published: May 22, 2020 Copyright: This article is republished from The Conversation under a Creative Common licence. Read the original article. Copyright © 2020 by Alexander Hocquet. Translated and republished with permission of the author Alexander Hocquet. Data Availability Statement: All rel- evant data are within the paper and its Supporting Information files. Competing Interests: The Author(s) declare(s) no conflict of interest. Firenze University Press www.fupress.com/substantia Feature Article Open Science in Times of Coronavirus: Introducing the Concept of "Real-Time" Publication Alexandre Hocquet Archives Poincaré, Université de Lorraine, & CNRS, Nancy, France Email: alexandre.hocquet@univ-lorraine.fr Keywords. Open Science, PubPeer, Peer-Review, Post-Publication Peer-Review Who doesn't have an opinion about hydroxychloroquine? The recent developments of the latest research in Marseilles on the potential of this antimalarial drug to reduce the viral load of SARS-CoV-2 have been heating up.1 Obviously, the current pandemic is a sudden and unprecedented health crisis. Unexpectedness and scale are turning the outbreak into widespread panic: science is summoned to find solutions as soon as possible. In a sense, the worldwide situation is a way of asking how fast can science go. The famed publication from Didier Raoult's group2 allows us to highlight an evolution in peer review practices, and this trend allows us to question what it means to be "open" in science. Drug development studies take years, even decades. The publication process that follows usually takes months or even years. It is increasingly difficult for scientific journals to find reviewers and to get the reviewers comments in time. The task of reviewing is burdensome. It usually is anonymous and voluntary, yet it is a liability since the reviewers’ comments are supposed to certify the validity of the publication. The volume of manuscripts submitted has been increasing exponentially. Finding adequate reviewers and getting comments reported back in time has become a dauntless task for many journal editors.3 Yet, in times of urgent crisis, with means and relations, a preliminary study can be done in a fortnight and published very quickly. After having submitted a manuscript to a journal on March 18, Raoult's famous paper got its reviews back for publication... on March 20! In exceptional circumstances, exceptional publication times are key. The two reviewers therefore analyzed the publication and delivered their comments in less than two days. Indeed, science seems to be able to speed up its process when emergency calls. What's new is that the critique of science can itself go very fast. In times of global panic, publications that deal with potential treatments for coronavirus are actually read, and even scrutinized by an attentive and numerous readership. Substantia. An International Journal of the History of Chemistry 4(1) Suppl. 1: 937, 2020 ISSN 2532-3997 (online) | DOI: 10.13128/Substantia-937 https://theconversation.com/ https://theconversation.com/science-ouverte-en-temps-de-coronavirus-publication-en-temps-reel-136397 https://theconversation.com/science-ouverte-en-temps-de-coronavirus-publication-en-temps-reel-136397 http://www.fupress.com/substantia Alexandre Hocquet 2 Among them are colleagues, competitors, doctors, pharmacists, microbiologists, statisticians, bio- informaticians, mere curious readers, some enthusiastic, others malicious. A myriad of potential reviewers from a diversity of backgrounds, in sharp contrast with the officially appointed reviewers, who are seldom thematically far away from the authors. For scientific journals, peer review has been playing the role of certification (does the article deserve to be published?) but it also takes the role of evaluation (is the article good enough for such or such journal?).4 Consequently, an article is considered cutting-edge science or not depending primarily on the prestige of the journal in which it appears, to the detriment of the evaluation of its content itself. Journals prestige is key in defining a tiered system of publication. "Publish or perish" has become "impact or perish".5 In contrast, PubPeer is a grassroots web platform launched in 2012, whose purpose is to potentially open a discussion forum about any scientific article. It was designed by its creators as the online version of a journal club (a sort of lab meeting where publications are critiqued) and was imagined out of the frustration that stems from the virtual impossibility to critique articles within the journals themselves. PubPeer is a form of post-publication peer- review. It is radical in the sense that anyone can comment, and can even comment anonymously. This "anyone can edit" principle is similar to Wikipedia's principles, where a contribution can indeed be criticized or reverted by anyone, the difference being that in PubPeer, articles are commented but not edited. Not unlike in Wikipedia, the most affected articles are those that shine under the media spotlight.6 Comments from people from different backgrounds entail multifaceted critique. In the PubPeer thread dedicated to Raoult's article in our example,7 one can find a flurry of comments about such themes as the publication process, the compliance with the state of the art, medical ethics, statistical methodology, statistical processing... among many others. What's new is that it includes reanalyses, i.e. analyses that the commentator has inferred from the data provided by the authors, rather that from the publication text. Reanalyses are carried out with the aim to design new calculations, new graphs, new interpretations, in order to put the "results and discussions" of the paper to the test.8 They can actually achieve this goal only if the data is provided by the authors, which is still far from systematic. The publication is thus becoming a sort of "live" paper, instead of being set in stone, just as a Wikipedia article follows, by definition, a never-ending dynamics. In this regard, PubPeer looks like a social network. Critics, reanalyses, and potential answers from the authors to their critics are discussed, debated. The article review itself is becoming a live process. In times of crisis, it may even turn into a bursting of interactions. The publication from Didier Raoult's group has been dissected in less time than it took to publish it: a hundred or so comments on PubPeer between mid and late March made the article look like a "real-time" publication. PubPeer is criticized among scientists for its anonymity and (sometimes rightly) for its denunciatory atmosphere... just as anonymity in Wikipedia is criticized.9 In both cases, anonymity is seen by the community as a condition to enhance participation (since it allows to escape from the pressure of hierarchy or competition). On the other hand, it is viewed as cowardice by people who fear that anonymity may lead to the promotion of abuse. As Michel Dubois and Catherine Guaspare point out, the tension lies in what constitutes a "peer".10 How can a platform warrant potential commentators to feel free enough to contribute in a hierarchical and competitive scientific world, while at the same time protecting from malicious attacks? As in Wikipedia, PubPeer possesses rules to ensure that attention is focused on content rather than on individuals, but as in Wikipedia, malicious attacks do exist. Amusingly enough, the exact same tensions and debates emerged when referees were becoming anonymous in mid-XIXth century.11 Another criticism of PubPeer (and Wikipedia) is the pervasive obsession of contributors about technical details (such as image editing) rather than the substance of the articles.12 Pubpeer founders respond that no faking of data is benign enough to be delegitimized as irrelevant.13 What happens on PubPeer is also performative: contributors play the role of moral entrepreneurs by defining through commentary what is acceptable or deviant.14 In a way, the thematic diversity of comments about Didier Raoult's publication does PubPeer justice to its "journal club" credentials. Commentators from a wide range of backgrounds suddenly take an interest in hydroxychloroquine. What is key here is a situation of global emergency combined with the inclusiveness of access to critique. The situation allows for the emergence of a globalized, real-time journal club. It would be naive to see PubPeer as the enchanted world of "self-correcting" science progressing through Disputatio. Conversely, it would be equally naive to think that the publication system as it exists readily lends itself to constructive criticism. The vast majority of journal articles cannot be commented upon. The function of a publication is more about recording antecedence than to engage in debate, which the conservative structure of scientific journals discourages.15 As a matter of fact, PubPeer receives bad press in the quarters of scientific institutions. Those institutions entice researchers into publishing their papers in "open access" and to make their data available, yet they criticize those open initiatives that they fail to control.16 Everybody wants open science, but the scientific community finds it difficult to realize that encouraging open data (in the name of transparency requirements) results in the possible reuse of these data, and thus, among other things, in the availability Open Science in Times of Coronavirus: Introducing the Concept of "Real-Time" Publication 3 of those data for post-publication critique, a critique that has been almost non-existent until now. Some scientific journals are trying to change peer reviewing rules. Several ideas are devised to separate evaluation from certification: reviews can be made before or after publication, they can be confidential or transparent, they can be spontaneous or invited, anonymous or identified. Some new editorial practices transform a "version of record" into a record of versions, according to Bianca Kramer's phrasing.17 Unfortunately, the most prestigious journals, those that make or break careers, are often maintaining the statu quo. The scientific landscape of journals is diverse, though. The situation of journals in the humanities, for example, is far from this depiction. Pubpeer is actually most active in the field of life sciences where the likes of Cell and Nature concentrate the criticism from the scientific community. In this sense, the PubPeer platform not only undermines the conservatism of scientific journals. By questioning the peer review process, it questions the very utility of the concept of publication and scientific journals. Even without going as far as extreme cases of retraction, the risk for the publication is to be contested in its role as a reference document, and the scientific journal its role as a gatekeeper contested too. Alternative viewpoints about openness put inclusiveness at the centre of their concerns. It poses problems (such as the question of legitimacy) while trying to solve others, but it has the merit of raising awareness that some ways of being open are more complex and challenge more things than we imagine... like Wikipedia does.18 ACKNOWLEDGMENTS The author wishes to thank Jean Claude Guédon, Marianne Noël, Konrad Hinsen, Christelle Rabier and Christophe Pouzat for their insightful comments. REFERENCES (1) Evelyn, K. Trump Stops Hyping Hydroxychloroquine after Study Shows No Benefit. The Guardian. April 22, 2020. (2) Gautret, P.; Lagier, J.-C.; Parola, P.; Hoang, V. T.; Meddeb, L.; Mailhe, M.; Doudier, B.; Courjon, J.; Giordanengo, V.; Vieira, V. E.; Dupont, H. T.; Honoré, S.; Colson, P.; Chabrière, E.; La Scola, B.; Rolain, J.-M.; Brouqui, P.; Raoult, D. Hydroxychloroquine and Azithromycin as a Treatment of COVID-19: Results of an Open-Label Non-Randomized Clinical Trial. International Journal of Antimicrobial Agents 2020, 105949. https://doi.org/10.1016/j.ijantimicag.2020.105949. (3) Halffman, W.; Horbach, S. P. J. M. What Are Innovations in Peer Review and Editorial Assessment For? Genome Biology 2020, 21 (1), 87. https://doi.org/10.1186/s13059-020-02004-4. (4) Guédon, J.-C. Future of Scholarly Publishing and Scholarly Communication: Report of the Expert Group to the European Commission; 2019. (5) Gaming the Metrics: Misconduct and Manipulation in Academic Research; Biagioli, M., Lippman, A., Eds.; The MIT Press, 2020. https://doi.org/10.7551/mitpress/11087.001.0001. (6) Hocquet, A. Wikipédia en tant que forum: une analyse de réseaux sociaux pour l’ethnographie de la production d’articles. In Wikipédia, objet scientifique non identifié; Barbe, L., Merzeau, L., Schafer, V., Eds.; Sciences humaines et sociales; Presses universitaires de Paris Ouest: Nanterre, 2015; pp 165–176. (7) Pubpeer forum. Hydroxychloroquine and Azithromycin as a Treatment of COVID-19: Preliminary Results of an Open-Label Non-Randomized Clinical Trial, 2020. (8) Hulme, O. J.; Wagenmakers, E.-J.; Damkier, P.; Madelung, C. F.; Siebner, H. R.; Helweg-Larsen, J.; Gronau, Q.; Benfield, T. L.; Madsen, K. H. A Bayesian Reanalysis of the Effects of Hydroxychloroquine and Azithromycin on Viral Carriage in Patients with COVID-19. medRxiv 2020, 2020.03.31.20048777. https://doi.org/10.1101/2020.03.31.20048777. (9) Larousserie, D. PubPeer, le site par qui le scandale de «l’inconduite scientifique» arrive. Le Monde.fr. October 23, 2018. (10) Dubois, M.; Guaspare, C. « Is someone out to get me?» : la biologie moléculaire à l’épreuve du Post- Publication Peer Review. Zilsel 2019, N° 6 (2), 164–192. (11) Csiszar, A. Peer Review: Troubled from the Start. Nature News 2016, 532 (7599), 306. https://doi.org/10.1038/532306a. (12) Blatt, M. R. Vigilante Science. Plant Physiology 2015, 169 (2), 907–909. https://doi.org/10.1104/pp.15.01443. (13) Pubpeer blog. Vigilant Scientists, 2015. (14) Larregue, J.; Saint-Martin, A. Troubles dans l’ethos scientifique. Zilsel 2019, N° 6 (2), 149–163. (15) Ross-Hellauer, T. What Is Open Peer Review? A Systematic Review. F1000Res 2017, 6, 588. https://doi.org/10.12688/f1000research.11369.2. (16) Larousserie, D. Le plan du CNRS pour lutter contre les tricheurs. Le Monde.fr. November 20, 2018. (17) Sondervan, J. OPEN SCIENCE AND OPEN MEDIA STUDIES — Questions on a culture in transition by Jeroen Sondervan. Open Media Studies. (18) Hocquet, A. Enseigner Wikipédia Par Les Anecdotes. The Conversation. March 13, 2017. https://doi.org/10.1016/j.ijantimicag.2020.105949 https://doi.org/10.1186/s13059-020-02004-4 https://doi.org/10.7551/mitpress/11087.001.0001 https://doi.org/10.1101/2020.03.31.20048777 https://doi.org/10.1038/532306a https://doi.org/10.1104/pp.15.01443 https://doi.org/10.12688/f1000research.11369.2