Multi-model evaluation of phenology prediction for wheat in Australia
Kurt Christian Kersebaum,
Jørgen Eivind Olesen,
Johannes Wilhelmus Maria Pullens,
Amit Kumar Srivastava,
Tobias K.D. Weber,
Allard de Wit,
Sabine J Seidel
Posted 06 Jun 2020
bioRxiv DOI: 10.1101/2020.06.06.133504
Posted 06 Jun 2020
Predicting wheat phenology is important for cultivar selection, for effective crop management and provides a baseline for evaluating the effects of global change. Evaluating how well crop phenology can be predicted is therefore of major interest. Twenty-eight wheat modeling groups participated in this evaluation. Model predictions depend not only on model structure but also on the parameter values. This study is thus an evaluation of modeling groups, which choose the structure and fix or estimate the parameters, rather than an evaluation just of model structures. Our target population was wheat fields in the major wheat growing regions of Australia under current climatic conditions and with current local management practices. The environments used for calibration and for evaluation were both sampled from this same target population. The calibration and evaluation environments had neither sites nor years in common, so this is a rigorous evaluation of the ability of modeling groups to predict phenology for new sites and weather conditions. Mean absolute error (MAE) for the evaluation environments, averaged over predictions of three phenological stages and over modeling groups, was 9 days, with a range from 6 to 20 days. Predictions using the multi-modeling group mean and median had prediction errors nearly as small as the best modeling group. For a given modeling group, MAE for the evaluation environments was significantly correlated with MAE for the calibration environments, which suggests that it would be of interest to test ensemble predictors that weight individual modeling groups based on performance for the calibration data. About two thirds of the modeling groups performed better than a simple but relevant benchmark, which predicts phenology by assuming a constant temperature sum for each development stage. The added complexity of crop models beyond just the effect of temperature was thus justified in most cases. Finally, there was substantial variability between modeling groups using the same model structure, which implies that model improvement could be achieved not only by improving model structure, but also by improving parameter values, and in particular by improving calibration techniques.
- Downloaded 647 times
- Download rankings, all-time:
- Site-wide: 55,346
- In plant biology: 1,237
- Year to date:
- Site-wide: 114,391
- Since beginning of last month:
- Site-wide: 74,376
Downloads over time
Distribution of downloads per paper, site-wide
- 27 Nov 2020: The website and API now include results pulled from medRxiv as well as bioRxiv.
- 18 Dec 2019: We're pleased to announce PanLingua, a new tool that enables you to search for machine-translated bioRxiv preprints using more than 100 different languages.
- 21 May 2019: PLOS Biology has published a community page about Rxivist.org and its design.
- 10 May 2019: The paper analyzing the Rxivist dataset has been published at eLife.
- 1 Mar 2019: We now have summary statistics about bioRxiv downloads and submissions.
- 8 Feb 2019: Data from Altmetric is now available on the Rxivist details page for every preprint. Look for the "donut" under the download metrics.
- 30 Jan 2019: preLights has featured the Rxivist preprint and written about our findings.
- 22 Jan 2019: Nature just published an article about Rxivist and our data.
- 13 Jan 2019: The Rxivist preprint is live!