Large-scale benchmarking of circRNA detection tools reveals large differences in sensitivity but not in precision Journal Article


Authors: Vromman, M.; Anckaert, J.; Bortoluzzi, S.; Buratin, A.; Chen, C. Y.; Chu, Q.; Chuang, T. J.; Dehghannasiri, R.; Dieterich, C.; Dong, X.; Flicek, P.; Gaffo, E.; Gu, W.; He, C.; Hoffmann, S.; Izuogu, O.; Jackson, M. S.; Jakobi, T.; Lai, E. C.; Nuytens, J.; Salzman, J.; Santibanez-Koref, M.; Stadler, P.; Thas, O.; Vanden Eynde, E.; Verniers, K.; Wen, G.; Westholm, J.; Yang, L.; Ye, C. Y.; Yigit, N.; Yuan, G. H.; Zhang, J.; Zhao, F.; Vandesompele, J.; Volders, P. J.
Article Title: Large-scale benchmarking of circRNA detection tools reveals large differences in sensitivity but not in precision
Abstract: The detection of circular RNA molecules (circRNAs) is typically based on short-read RNA sequencing data processed using computational tools. Numerous such tools have been developed, but a systematic comparison with orthogonal validation is missing. Here, we set up a circRNA detection tool benchmarking study, in which 16 tools detected more than 315,000 unique circRNAs in three deeply sequenced human cell types. Next, 1,516 predicted circRNAs were validated using three orthogonal methods. Generally, tool-specific precision is high and similar (median of 98.8%, 96.3% and 95.5% for qPCR, RNase R and amplicon sequencing, respectively) whereas the sensitivity and number of predicted circRNAs (ranging from 1,372 to 58,032) are the most significant differentiators. Of note, precision values are lower when evaluating low-abundance circRNAs. We also show that the tools can be used complementarily to increase detection sensitivity. Finally, we offer recommendations for future circRNA detection and validation. © 2023, The Author(s), under exclusive licence to Springer Nature America, Inc.
Keywords: genetics; metabolism; rna; benchmarking; sequence analysis, rna; procedures; humans; human; rna sequencing; rna, circular; circular ribonucleic acid
Journal Title: Nature Methods
Volume: 20
Issue: 8
ISSN: 1548-7091
Publisher: Nature Publishing Group  
Date Published: 2023-08-01
Start Page: 1159
End Page: 1169
Language: English
DOI: 10.1038/s41592-023-01944-6
PUBMED: 37443337
PROVIDER: scopus
PMCID: PMC10870000
DOI/URL:
Notes: The MSK Cancer Center Support Grant (P30 CA008748) is acknowledged in the PDF -- Erratum issued, see DOI: 10.1038/s41592-024-02569-z -- Source: Scopus
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Eric C Lai
    159 Lai