BigNeuron: A resource to benchmark and predict best-performing algorithms for automated reconstruction of neuronal morphology
By
Linus Manubens-Gil,
Zhi Zhou,
Hanbo Chen,
Arvind Ramanathan,
Xiaoxiao Liu,
Yufeng Liu,
Alessandro Bria,
Todd Gillette,
Zongcai Ruan,
Jian Yang,
Miroslav Radojević,
Ting Zhao,
Li Cheng,
Lei Qu,
Siqi Liu,
Kristofer E Bouchard,
Lin Gu,
Weidong Cai,
Shuiwang Ji,
Badrinath Roysam,
Ching-Wei Wang,
Hongchuan Yu,
Amos Sironi,
Daniel Maxim Iascone,
Jie Zhou,
Erhan Bas,
Eduardo Conde-Sousa,
Paulo Aguiar,
Xiang Li,
Yujie Li,
Sumit Nanda,
Yuan Wang,
Leila Muresan,
Pascal Fua,
Bing Ye,
Hai-yan He,
Jochen F Staiger,
Manuel Peter,
Daniel N Cox,
Michel Simonneau,
Marcel Oberlaender,
Gregory Jefferis,
Kei Ito,
Paloma Gonzalez-Bellido,
Jinhyun Kim,
Edwin Rubel,
Hollis T. Cline,
Hongkui Zeng,
Aljoscha Nern,
Ann-Shyn Chiang,
Jianhua Yao,
Jane Roskams,
Rick Livesey,
Janine Stevens,
Tianming Liu,
Chinh Dang,
Yike Guo,
Ning Zhong,
Georgia Tourassi,
Sean Hill,
Michael Hawrylycz,
Christof Koch,
Erik Meijering,
Giorgio A Ascoli,
Hanchuan Peng
Posted 11 May 2022
bioRxiv DOI: 10.1101/2022.05.10.491406
BigNeuron is an open community bench-testing platform combining the expertise of neuroscientists and computer scientists toward the goal of setting open standards for accurate and fast automatic neuron reconstruction. The project gathered a diverse set of image volumes across several species representative of the data obtained in most neuroscience laboratories interested in neuron reconstruction. Here we report generated gold standard manual annotations for a selected subset of the available imaging datasets and quantified reconstruction quality for 35 automatic reconstruction algorithms. Together with image quality features, the data were pooled in an interactive web application that allows users and developers to perform principal component analysis t-distributed stochastic neighbor embedding, correlation and clustering, visualization of imaging and reconstruction data, and benchmarking of automatic reconstruction algorithms in user-defined data subsets. Our results show that image quality metrics explain most of the variance in the data, followed by neuromorphological features related to neuron size. By benchmarking automatic reconstruction algorithms, we observed that diverse algorithms can provide complementary information toward obtaining accurate results and developed a novel algorithm to iteratively combine methods and generate consensus reconstructions. The consensus trees obtained provide estimates of the neuron structure ground truth that typically outperform single algorithms. Finally, to aid users in predicting the most accurate automatic reconstruction results without manual annotations for comparison, we used support vector machine regression to predict reconstruction quality given an image volume and a set of automatic reconstructions.
Download data
- Downloaded 191 times
- Download rankings, all-time:
- Site-wide: 169,254
- In bioinformatics: None
- Year to date:
- Site-wide: 21,486
- Since beginning of last month:
- Site-wide: 3,178
Altmetric data
Downloads over time
Distribution of downloads per paper, site-wide
PanLingua
News
- 27 Nov 2020: The website and API now include results pulled from medRxiv as well as bioRxiv.
- 18 Dec 2019: We're pleased to announce PanLingua, a new tool that enables you to search for machine-translated bioRxiv preprints using more than 100 different languages.
- 21 May 2019: PLOS Biology has published a community page about Rxivist.org and its design.
- 10 May 2019: The paper analyzing the Rxivist dataset has been published at eLife.
- 1 Mar 2019: We now have summary statistics about bioRxiv downloads and submissions.
- 8 Feb 2019: Data from Altmetric is now available on the Rxivist details page for every preprint. Look for the "donut" under the download metrics.
- 30 Jan 2019: preLights has featured the Rxivist preprint and written about our findings.
- 22 Jan 2019: Nature just published an article about Rxivist and our data.
- 13 Jan 2019: The Rxivist preprint is live!