Flagging incorrect nucleotide sequence reagents in biomedical papers: To what extent does the leading publication format impede automatic error detection? - Recherche d’Information et Synthèse d’Information Accéder directement au contenu
Article Dans Une Revue Scientometrics Année : 2020

Flagging incorrect nucleotide sequence reagents in biomedical papers: To what extent does the leading publication format impede automatic error detection?

Résumé

In an idealised vision of science the scientific literature is error-free. Errors reported during peer review are supposed to be corrected prior to publication, as further research establishes new knowledge based on the body of literature. It happens, however, that errors pass through peer review, and a minority of cases errata and retractions follow. Automated screening software can be applied to detect errors in manuscripts and publications. The contribution of this paper is twofold. First, we designed the erroneous reagent checking (ERC) benchmark to assess the accuracy of fact-checkers screening biomedical publications for dubious mentions of nucleotide sequence reagents. It comes with a test collection comprised of 1679 nucleotide sequence reagents that were curated by biomedical experts. Second, we benchmarked our own screening software called Seek&Blastn with three input formats to assess the extent of performance loss when operating on various publication formats. Our findings stress the superiority of markup formats (a 79% detection rate on XML and HTML) over the prominent PDF format (a 69% detection rate at most) regarding an error flagging task. This is the first published baseline on error detection involving reagents reported in biomedical scientific publications. The ERC benchmark is designed to facilitate the development and validation of software bricks to enhance the reliability of the peer review process.
Fichier principal
Vignette du fichier
LabbeEtAl2020.pdf (2.08 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-02911605 , version 1 (04-08-2020)

Licence

Paternité - Partage selon les Conditions Initiales

Identifiants

Citer

Cyril Labbé, Guillaume Cabanac, Rachael A West, Thierry Gautier, Bertrand Favier, et al.. Flagging incorrect nucleotide sequence reagents in biomedical papers: To what extent does the leading publication format impede automatic error detection?. Scientometrics, 2020, 124 (2), pp.1139-1156. ⟨10.1007/s11192-020-03463-z⟩. ⟨hal-02911605⟩
351 Consultations
70 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More