The impact of data reduction and lossy image formats on electron microscope images
Edward T. Eng,
Carl J Negro,
William J. Rice,
Kelsey D. Jordan,
Clinton S. Potter
Posted 24 Oct 2018
bioRxiv DOI: 10.1101/451427
Posted 24 Oct 2018
Recent advances in instrumentation and software for cryoEM have increased the applicability and utility of this method. Coupled with the adoption of automated pipelines, significant infrastructure support is required to sustain high throughput workflows. In particular, data generation rates may outpace the ability to deploy data storage and archival solutions. We have investigated what effects data compression and conversion to different file formats have on the ability to obtain high resolution cryoEM reconstructions. Standard lossless data compression strategies have a high impact on reducing the size of direct detector electron counting movie stacks, but provide more modest gains for aligned summed images. We show that EM images can be compressed using standard lossy methods to reduce file storage to 5-10% of the size of the original aligned sum or movie stack file and yet still retain enough information such that modern image processing pipelines will provide sub-2Å reconstructions from the compressed data.
- Downloaded 1,263 times
- Download rankings, all-time:
- Site-wide: 15,482
- In biophysics: 382
- Year to date:
- Site-wide: 20,975
- Since beginning of last month:
- Site-wide: 19,210
Downloads over time
Distribution of downloads per paper, site-wide
- 27 Nov 2020: The website and API now include results pulled from medRxiv as well as bioRxiv.
- 18 Dec 2019: We're pleased to announce PanLingua, a new tool that enables you to search for machine-translated bioRxiv preprints using more than 100 different languages.
- 21 May 2019: PLOS Biology has published a community page about Rxivist.org and its design.
- 10 May 2019: The paper analyzing the Rxivist dataset has been published at eLife.
- 1 Mar 2019: We now have summary statistics about bioRxiv downloads and submissions.
- 8 Feb 2019: Data from Altmetric is now available on the Rxivist details page for every preprint. Look for the "donut" under the download metrics.
- 30 Jan 2019: preLights has featured the Rxivist preprint and written about our findings.
- 22 Jan 2019: Nature just published an article about Rxivist and our data.
- 13 Jan 2019: The Rxivist preprint is live!