Repeatability and reproducibility in proteomic identifications by liquid chromatography-tandem mass spectrometry Journal Article


Authors: Tabb, D. L.; Vega-Montoto, L.; Rudnick, P. A.; Variyath, A. M.; Ham, A. J. L.; Bunk, D. M.; Kilpatrick, L. E.; Billheimer, D. D.; Blackman, R. K.; Cardasis, H. L.; Carr, S. A.; Clauser, K. R.; Jaffe, J. D.; Kowalski, K. A.; Neubert, T. A.; Regnier, F. E.; Schilling, B.; Tegeler, T. J.; Wang, M.; Wang, P.; Whiteaker, J. R.; Zimmerman, L. J.; Fisher, S. J.; Gibson, B. W.; Kinsinger, C. R.; Mesri, M.; Rodriguez, H.; Stein, S. E.; Tempst, P.; Paulovich, A. G.; Liebler, D. C.; Spiegelman, C.
Article Title: Repeatability and reproducibility in proteomic identifications by liquid chromatography-tandem mass spectrometry
Abstract: The complexity of proteomic instrumentation for LC-MS/MS introduces many possible sources of variability. Data-dependent sampling of peptides constitutes a stochastic element at the heart of discovery proteomics. Although this variation impacts the identification of peptides, proteomic identifications are far from completely random. In this study, we analyzed interlaboratory data sets from the NCI Clinical Proteomic Technology Assessment for Cancer to examine repeatability and reproducibility in peptide and protein identifications. Included data spanned 144 LC-MS/MS experiments on four Thermo LTQ and four Orbitrap instruments. Samples included yeast lysate, the NCI-20 defined dynamic range protein mix, and the Sigma UPS 1 defined equimolar protein mix. Some of our findings reinforced conventional wisdom, such as repeatability and reproducibility being higher for proteins than for peptides. Most lessons from the data, however, were more subtle. Orbitraps proved capable of higher repeatability and reproducibility, but aberrant performance occasionally erased these gains. Even the simplest protein digestions yielded more peptide ions than LC-MS/MS could identify during a single experiment. We observed that peptide lists from pairs of technical replicates overlapped by 35-60%, giving a range for peptide-level repeatability in these experiments. Sample complexity did not appear to affect peptide identification repeatability, even as numbers of identified spectra changed by an order of magnitude. Statistical analysis of protein spectral counts revealed greater stability across technical replicates for Orbitraps, making them superior to LTQ instruments for biomarker candidate discovery. The most repeatable peptides were those corresponding to conventional tryptic cleavage sites, those that produced intense MS signals, and those that resulted from proteins generating many distinct peptides. Reproducibility among different instruments of the same type lagged behind repeatability of technical replicates on a single instrument by several percent. These findings reinforce the importance of evaluating repeatability as a fundamental characteristic of analytical technologies. © 2010 American Chemical Society.
Keywords: comparative study; reproducibility; biomarkers; protein analysis; proteome; reproducibility of results; protein degradation; analytic method; protein stability; peptide; proteomics; tandem mass spectrometry; yeast; chromatography, liquid; liquid chromatography; protein variant; cell lysate; sampling; trypsin; keratin; peptide analysis; complexity; repeatability; instrument
Journal Title: Journal of Proteome Research
Volume: 9
Issue: 2
ISSN: 1535-3893
Publisher: American Chemical Society  
Date Published: 2010-02-05
Start Page: 761
End Page: 776
Language: English
DOI: 10.1021/pr9006365
PUBMED: 19921851
PROVIDER: scopus
PMCID: PMC2818771
DOI/URL:
Notes: --- - "Cited By (since 1996): 22" - "Export Date: 20 April 2011" - "CODEN: JPROB" - "Source: Scopus"
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Paul J Tempst
    324 Tempst