Preprints
https://doi.org/10.5194/gmd-2022-77
https://doi.org/10.5194/gmd-2022-77
Submitted as: development and technical paper
04 May 2022
Submitted as: development and technical paper | 04 May 2022
Status: this preprint is currently under review for the journal GMD.

CIOFC1.0: a Common Parallel Input/Output Framework Based on C-Coupler2.0

Xinzhu Yu1, Li Liu1,2, Chao Sun1, Qingu Jiang1,3, Biao Zhao4,1, Zhiyuan Zhang5, Hao Yu1, and Bin Wang1,2,6 Xinzhu Yu et al.
  • 1Ministry of Education Key Laboratory for Earth System Modeling, Department of Earth System Science, Tsinghua University, Beijing, China
  • 2Southern Marine Science and Engineering Guangdong Laboratory (Zhuhai), China
  • 3CMA Earth System Modeling and Prediction Centre (CEMC), China
  • 4First Institute of Oceanography, and Key Laboratory of Marine Science and Numerical Modeling, Ministry of Natural Resources, Qingdao, China
  • 5Unit No. 91001 of PLA, Beijing, China
  • 6State Key Laboratory of Numerical Modeling for Atmospheric Sciences and Geophysical Fluid Dynamics (LASG), Institute of Atmospheric Physics, Chinese Academy of Sciences, Beijing, China

Abstract. As Earth system modeling develops ever finer grid resolutions, the inputting and outputting (I/O) of the increasingly large data fields becomes a processing bottleneck. Many models developed in China, as well as the Community Coupler (C-Coupler), do not fully benefit from existing parallel I/O supports. This paper reports the design and implementation of a Common parallel Input/Output Framework based on C-Coupler2.0 (CIOFC1.0). Parallelization by CIOFC1.0 can accelerate the I/O of large data fields. The framework also allows convenient specification by users of the I/O settings; e.g., the data fields for I/O, the time series of the data files for I/O, and the data grids in the files. The framework can also adaptively input data fields from a time-series dataset during model integration, automatically interpolate data when necessary, and output fields either periodically or irregularly. CIOFC1.0 demonstrates the cooperative development of an I/O framework and coupler, and thus enables convenient and simultaneous use of a coupler and an I/O framework.

Xinzhu Yu et al.

Status: open (until 29 Jun 2022)

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse

Xinzhu Yu et al.

Xinzhu Yu et al.

Viewed

Total article views: 176 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
145 26 5 176 2 1
  • HTML: 145
  • PDF: 26
  • XML: 5
  • Total: 176
  • BibTeX: 2
  • EndNote: 1
Views and downloads (calculated since 04 May 2022)
Cumulative views and downloads (calculated since 04 May 2022)

Viewed (geographical distribution)

Total article views: 169 (including HTML, PDF, and XML) Thereof 169 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 20 May 2022
Download
Short summary
In this paper, we propose a new common, flexible and efficient parallel I/O framework for Earth system modeling based on C-Coupler2.0. CIOFC1.0 can handle data I/O in parallel, and provides a configuration file format that enables users to conveniently change the I/O configurations. It can automatically make grid and time interpolation, output data with an aperiodical time series and accelerate data I/O when the field size is large.