Outcomes of the 2019 EMDataResource model challenge: validation of cryo-EM models at near-atomic resolution
Catherine L. Lawson,
Paul D. Adams,
Pavel V. Afonine,
Matthew L. Baker,
Benjamin A. Barad,
Ken A Dill,
Daniel P. Farrell,
James S Fraser,
Mark A. Herzik,
Soon Wen Hoh,
Agnel Praveen Joseph,
Colin M. Palmer,
Peter B. Rosenthal,
Luisa U. Schäfer,
Michael F. Schmid,
Gunnar F. Schröder,
Thomas C. Terwilliger,
Stephanie A. Wankowicz,
Helen M. Berman,
Posted 15 Jun 2020
bioRxiv DOI: 10.1101/2020.06.12.147033
Posted 15 Jun 2020
This paper describes outcomes of the 2019 Cryo-EM Map-based Model Metrics Challenge sponsored by EMDataResource (www.emdataresource.org). The goals of this challenge were (1) to assess the quality of models that can be produced using current modeling software, (2) to check the reproducibility of modeling results from different software developers and users, and (3) compare the performance of current metrics used for evaluation of models. The focus was on near-atomic resolution maps with an innovative twist: three of four target maps formed a resolution series (1.8 to 3.1 Angstrom) from the same specimen and imaging experiment. Tools developed in previous challenges were expanded for managing, visualizing and analyzing the 63 submitted coordinate models, and several novel metrics were introduced. The results permit specific recommendations to be made about validating near-atomic cryo-EM structures both in the context of individual laboratory experiments and holdings of structure data archives such as the Protein Data Bank. Our findings demonstrate the relatively high accuracy and reproducibility of cryo-EM models derived from these benchmark maps by 13 participating teams, representing both widely used and novel modeling approaches. We also evaluate the pros and cons of the commonly used metrics to assess model quality and recommend the adoption of multiple scoring parameters to provide full and objective annotation and assessment of the model, reflective of the observed density in the cryo-EM map. ### Competing Interest Statement The authors have declared no competing interest.
- Downloaded 663 times
- Download rankings, all-time:
- Site-wide: 30,716 out of 119,012
- In biochemistry: 748 out of 3,596
- Year to date:
- Site-wide: 9,913 out of 119,012
- Since beginning of last month:
- Site-wide: 6,032 out of 119,012
Downloads over time
Distribution of downloads per paper, site-wide
- 27 Nov 2020: The website and API now include results pulled from medRxiv as well as bioRxiv.
- 18 Dec 2019: We're pleased to announce PanLingua, a new tool that enables you to search for machine-translated bioRxiv preprints using more than 100 different languages.
- 21 May 2019: PLOS Biology has published a community page about Rxivist.org and its design.
- 10 May 2019: The paper analyzing the Rxivist dataset has been published at eLife.
- 1 Mar 2019: We now have summary statistics about bioRxiv downloads and submissions.
- 8 Feb 2019: Data from Altmetric is now available on the Rxivist details page for every preprint. Look for the "donut" under the download metrics.
- 30 Jan 2019: preLights has featured the Rxivist preprint and written about our findings.
- 22 Jan 2019: Nature just published an article about Rxivist and our data.
- 13 Jan 2019: The Rxivist preprint is live!