the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Robust handling of extremes in quantile mapping – "Murder your darlings"
Abstract. Quantile mapping is a method often used for bias adjustment of climate model data toward a reference, i.e. to construct a transformation of the model’s distribution to that of the reference. The main moments of the distributions are typically well transformed by quantile mapping, but statistical uncertainty increases towards the extreme tails, making robust transformations challenging. Because of the limited data at the extreme tails, also an empirical quantile mapping needs to make some estimation or fit a parameterized function for data beyond the calibration data range. The MIdAS bias adjustment platform is here employed to explore different methods for handling the extreme tail, which are evaluated using an indicator for extreme precipitation - the maximum daily precipitation amount per year. Different methodologies are evaluated for a large ensemble of regional climate model projections over Scandinavia. The sensitivity of the empirical quantile mapping for the tails of the distribution is demonstrated, and it is found that the behaviour is significantly different within and without the calibration period, causing severe issues with the temporal consistency of the timeseries. The sensitivity is identified to be due to differences in the activated features of the bias adjustment, within the calibration period where the empirical transfer function is applied, and outside that period, where the extrapolation method is likely applied. This means that the bias adjustment method is in a sense different between different time periods. Currently MIdAS uses separate calibrations for each day of the year, as opposed to e.g. for each calendar month, further aggravates this issue. Further, finding a robust parametrisation for the tail is not straightforward. We identify a two-step solution which works well for this problem: (i) "murder your darlings" by excluding data from the tail data in the calibration period, the extrapolation feature is activated for all time periods, even the calibration period, and (ii) applying an outlier insensitive method for linear regression works well for finding an extrapolation parametrisation for the tail.
- Preprint
(2522 KB) - Metadata XML
- BibTeX
- EndNote
Status: open (until 14 Aug 2024)
-
CEC1: 'Comment on gmd-2024-98', Juan Antonio Añel, 20 Jun 2024
reply
Dear authors,
Unfortunately, after checking your manuscript, it has come to our attention that it does not comply with our "Code and Data Policy".
https://www.geoscientific-model-development.net/policies/code_and_data_policy.html
You have archived your code on a git repository which is on a server not suitable for scientific publication. Also, you have to publish and share openly all the data used in your study, not only the data to recreate the plots. This includes the SMHIGridClim and Euro-CORDEX CMIP5 data used. We understand that some files used in your study are large (e.g., full output from models). In such cases, instead of storing the complete files, you should at least keep the variables or final fields computed and used in your work.Also, you must include in a potentially reviewed version of your manuscript the modified 'Code and Data Availability' section, DOIs and links for the new code and data repositories.
Please, reply as soon as possible to this comment with the link and DOIs for it so that it is available for the peer-review process, as it should be.
Please, be aware that failing to comply promptly with this request could result in rejecting your manuscript for publication.Juan A. Añel
Geosci. Model Dev. Executive EditorCitation: https://doi.org/10.5194/gmd-2024-98-CEC1 -
AC1: 'Reply on CEC1', Peter Berg, 28 Jun 2024
reply
Dear Juan A. Añel,
thanks for the clarifications of the requirements of the journal, and please accept our sincere apologies for not fulfilling them in the submitted manuscript. We have now updated the repository of the paper, and where we formerly only had the information necessary to reproduce the final analysis and figures of the paper, we have now complemented will all the raw timeseries needed to reproduce the experiments, a zip-file containing the published MIdAS souce code, as well as instructions for how to perform the experiments. Thus, we are now confident that we fulfil the requirements, and the manuscript would only need to be updated with a new doi-link for the Zenodo repository https://zenodo.org/records/12570891 as follows:
@techreport{Berg2024zenodo,
author = {Peter Berg and Johan Södling},
title = {MIdAS bias adjustment of extremes using Theil-Sen extrapolation: Data and plotting scripts for GMD-publication},
institution = {Zenodo},
year = {2024},
doi = {https://doi.org/10.5281/zenodo.12570891}
}We hope that the review process will not suffer from this, and that the link will be forwarded to the reviewers.
With best regards,
Peter Berg and co-authors
Citation: https://doi.org/10.5194/gmd-2024-98-AC1
-
AC1: 'Reply on CEC1', Peter Berg, 28 Jun 2024
reply
-
RC1: 'Comment on gmd-2024-98', Anonymous Referee #1, 24 Jun 2024
reply
Review of gmd-2024-98 manuscript ‘Robust handling of extremes in quantile mapping - “Murder your darlings”’ by Berg et al.
General comments:
The paper gives an interesting insight into the special problems of extreme-value extrapolations/bias corrections. The paper identifies a real problem in the MIdAS method which is also important for efforts not based on that specific software. A series of tests were performed and new approaches are suggested.
Important paper that should be published just to help users of MIdAS. The ideas in the paper will also provide food for thought for general practitioners in the field of climate-change projection; especially at the extremes end of the distributions.
Specific comments:
The paper is set in a language attuned to people who use MIdAS, which is fine for that community, as well as accessible for people in the relevant areas.
I’d like to see a sentence or two more on the subject in Line 71 ‘conservatively remapped’ - how?
Technical corrections:
Line 22: ‘a reference data’ -> perhaps just ‘reference data’
Line 23: ‘in worst case’ -> ‘in the worst case’
Line 31: ‘will act differently’ - ‘will’? - perhaps true. Seems a strong statement.
Line 81: ‘main figures’ -> ‘main Figures’
Figure 1 caption: ‘absolute values’? Do you mean numerical absolute, or a more general phrase relating to ‘levels’ (as opposed to anomalies)?
Line 87: ‘due to the ensemble mean’ … elaborate that thought, perhaps?
Figure 2 legend in both panels, but especially the lower panel, obscures the graphs.
Line 103: ‘forces the’ -> ‘force the’, as ‘experiments’ is plural.
Line 108 was hard for this reviewer to parse.-
AC2: 'Reply on RC1', Peter Berg, 28 Jun 2024
reply
Thank you very much for the positive review,
we would like to clarify that the presented issue is not specific for the MIdAS implementation of quantile mapping, but is inherent to all empirical quantile mapping methods and is a fundamental issue that needs to be dealt with. It is, however, not easily discovered due to the large noise levels, which is why we used a large ensemble of models and averages over a larger domain to visualize the issue.
The conservative remapping was performed using the CDO function 'remapcon' that follows the SCRIP convention. We will provide more details on this in a revised manuscript, along with your technical corrections which are much appreciated.
With best regards,
Peter Berg and co-authors
Citation: https://doi.org/10.5194/gmd-2024-98-AC2
-
AC2: 'Reply on RC1', Peter Berg, 28 Jun 2024
reply
Viewed
HTML | XML | Total | BibTeX | EndNote | |
---|---|---|---|---|---|
121 | 31 | 10 | 162 | 3 | 2 |
- HTML: 121
- PDF: 31
- XML: 10
- Total: 162
- BibTeX: 3
- EndNote: 2
Viewed (geographical distribution)
Country | # | Views | % |
---|
Total: | 0 |
HTML: | 0 |
PDF: | 0 |
XML: | 0 |
- 1