Rxivist logo

Benchmarking predictions of MHC class I restricted T cell epitopes

By Sinu Paul, Nathan P. Croft, Anthony W. Purcell, David C Tscharke, Alessandro Sette, Morten Nielsen, Bjoern Peters

Posted 08 Jul 2019
bioRxiv DOI: 10.1101/694539

T cell epitope candidates are commonly identified using computational prediction tools in order to enable applications such as vaccine design, cancer neoantigen identification, development of diagnostics and removal of unwanted immune responses against protein therapeutics. Most T cell epitope prediction tools are based on machine learning algorithms trained on MHC binding or naturally processed MHC ligand elution data. The ability of currently available tools to predict T cell epitopes has not been comprehensively evaluated. In this study, we used a recently published dataset that systematically defined T cell epitopes recognized in vaccinia virus (VACV) infected mice, considering both peptides predicted to bind MHC or experimentally eluted from infected cells, making this the most comprehensive dataset of T cell epitopes mapped in a complex pathogen. We evaluated the performance of all currently publicly available computational T cell epitope prediction tools to identify these major epitopes from all peptides encoded in the VACV proteome. We found that all methods were able to improve epitope identification above random, with the best performance achieved by neural network-based predictions trained on both MHC binding and MHC ligand elution data (NetMHCPan-4.0 and MHCFlurry). Impressively, these methods were able to capture more than half of the major epitopes in the top 0.04% (N = 277) of peptides in the VACV proteome (N = 767,788). These performance metrics provide guidance for immunologists as to which prediction methods to use. In addition, this benchmark was implemented in an open and easy to reproduce format, providing developers with a framework for future comparisons against new tools.

Download data

  • Downloaded 710 times
  • Download rankings, all-time:
    • Site-wide: 35,409
    • In immunology: 1,023
  • Year to date:
    • Site-wide: 65,810
  • Since beginning of last month:
    • Site-wide: 103,719

Altmetric data

Downloads over time

Distribution of downloads per paper, site-wide