Articles | Volume 18, issue 13
https://doi.org/10.5194/gmd-18-4119-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-18-4119-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
An effective communication topology for performance optimization: a case study of the finite-volume wave modeling (FVWAM)
Renbo Pang
CORRESPONDING AUTHOR
National Marine Environmental Forecasting Center, 8 Dahuisi Road, Beijing 100081, China
State Key Laboratory of Satellite Ocean Environment Dynamics, National Marine Environmental Forecasting Center, 8 Dahuisi Road, Beijing 100081, China
Key Laboratory of Research on Marine Hazard Forecasting, Ministry of Natural Resources of China, 8 Dahuisi Road, Beijing 100081, China
Fujiang Yu
CORRESPONDING AUTHOR
National Marine Environmental Forecasting Center, 8 Dahuisi Road, Beijing 100081, China
State Key Laboratory of Satellite Ocean Environment Dynamics, National Marine Environmental Forecasting Center, 8 Dahuisi Road, Beijing 100081, China
Key Laboratory of Research on Marine Hazard Forecasting, Ministry of Natural Resources of China, 8 Dahuisi Road, Beijing 100081, China
National Marine Environmental Forecasting Center, 8 Dahuisi Road, Beijing 100081, China
National Marine Environmental Forecasting Center, 8 Dahuisi Road, Beijing 100081, China
State Key Laboratory of Satellite Ocean Environment Dynamics, National Marine Environmental Forecasting Center, 8 Dahuisi Road, Beijing 100081, China
Key Laboratory of Research on Marine Hazard Forecasting, Ministry of Natural Resources of China, 8 Dahuisi Road, Beijing 100081, China
Liang Yuan
Institute of Computing Technology, Chinese Academy of Sciences, 6 Kexueyuan Nanlu, Zhongguancun, Haidian, Beijing 100190, China
Zhiyi Gao
National Marine Environmental Forecasting Center, 8 Dahuisi Road, Beijing 100081, China
Related authors
Ye Yuan, Fujiang Yu, Zhi Chen, Xueding Li, Fang Hou, Yuanyong Gao, Zhiyi Gao, and Renbo Pang
Geosci. Model Dev., 17, 6123–6136, https://doi.org/10.5194/gmd-17-6123-2024, https://doi.org/10.5194/gmd-17-6123-2024, 2024
Short summary
Short summary
Accurate and timely forecasting of ocean waves is of great importance to the safety of marine transportation and offshore engineering. In this study, GPU-accelerated computing is introduced in WAve Modeling Cycle 6 (WAM6). With this effort, global high-resolution wave simulations can now run on GPUs up to tens of times faster than the currently available models can on a CPU node with results that are just as accurate.
Ye Yuan, Fujiang Yu, Zhi Chen, Xueding Li, Fang Hou, Yuanyong Gao, Zhiyi Gao, and Renbo Pang
Geosci. Model Dev., 17, 6123–6136, https://doi.org/10.5194/gmd-17-6123-2024, https://doi.org/10.5194/gmd-17-6123-2024, 2024
Short summary
Short summary
Accurate and timely forecasting of ocean waves is of great importance to the safety of marine transportation and offshore engineering. In this study, GPU-accelerated computing is introduced in WAve Modeling Cycle 6 (WAM6). With this effort, global high-resolution wave simulations can now run on GPUs up to tens of times faster than the currently available models can on a CPU node with results that are just as accurate.
Ye Yuan, Huaiwei Yang, Fujiang Yu, Yi Gao, Benxia Li, and Chuang Xing
Nat. Hazards Earth Syst. Sci., 23, 3487–3507, https://doi.org/10.5194/nhess-23-3487-2023, https://doi.org/10.5194/nhess-23-3487-2023, 2023
Short summary
Short summary
Rip currents are narrow jets of offshore-directed flow that originated in the surf zone, which can take swimmers of all ability levels into deeper water unawares. In this study, a 1 m fine-resolution wave-resolving model was configured to study rip current variability and the optimal swimmer escape strategies. Multiple factors contribute to the survival of swimmers. However, for weak-to-moderate rip and longshore currents, swimming onshore consistently seems to be the most successful strategy.
Cited articles
Abdolali, A., Roland, A., Van Der Westhuysen, A., Meixner, J., Chawla, A., Hesser, T. J., Smith, J. M., and Sikiric, M. D.: Large-scale hurricane modeling using domain decomposition parallelization and implicit scheme implemented in WAVEWATCH III wave model, Coast. Eng., 157, 1–23, https://doi.org/10.1016/j.coastaleng.2020.103656, 2020. a
Alizadeh, O.: Advances and challenges in climate modeling, Climatic Change, 170, 1–26, https://doi.org/10.1007/s10584-021-03298-4, 2022. a
Atchley, S., Zimmer, C., Lange, J., Bernholdt, D., Melesse Vergara, V., Beck, T., Brim, M., Budiardja, R., Chandrasekaran, S., Eisenbach, M., Evans, T., Ezell, M., Frontiere, N., Georgiadou, A., Glenski, J., Grete, P., Hamilton, S., Holmen, J., Huebl, A., Jacobson, D., Joubert, W., McMahon, K., Merzari, E., Moore, S. G., Myers, A., Nichols, S., Oral, S., Papatheodore, T., Perez, D., Rogers, D. M., Schneider, E., Vay, J.-L., and Yeung, P.: Frontier: exploring exascale, in: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 52, 1–16, https://doi.org/10.1145/3581784.3607089, 2023. a
Biswas, M. K., Carson, L., Newman, K., Stark, D., Kalina, E., Grell, E., and Frimel, J.: Community HWRF users' guide v4.0a, NCAR: Boulder, CO, USA, pp. 1–163, 2018. a
Booij, N., Ris, R. C., and Holthuijsen, L. H.: A third-generation wave model for coastal regions: 1. Model description and validation, J. Geophys. Res.-Oceans, 104, 7649–7666, https://doi.org/10.1029/98JC02622, 1999. a
Chassignet, E. P. and Xu, X.: Impact of horizontal resolution (1/12 to 1/50) on Gulf Stream separation, penetration, and variability, J. Phys. Oceanogr., 47, 1999–2021, https://doi.org/10.1175/JPO-D-17-0031.1, 2017. a
Cowles, G. W.: Parallelization of the FVCOM coastal ocean model, The International Journal of High Performance Computing Applications, 22, 177–193, https://doi.org/10.1177/1094342007083804, 2008. a
Ghosh, S., Halappanavar, M., Kalyanaraman, A., Khan, A., and Gebremedhin, A. H.: Exploring MPI communication models for graph applications using graph matching as a case study, in: 2019 IEEE International Parallel and Distributed Processing Symposium (IPDPS), 761–770, IEEE, https://doi.org/10.1109/IPDPS.2019.00085, 2019. a
Group, T. W.: The WAM model – A third generation ocean wave prediction model, J. Phys. Oceanogr., 18, 1775–1810, https://doi.org/10.1175/1520-0485(1988)018<1775:TWMTGO>2.0.CO;2, 1988. a, b
Gu, J., Feng, J., Hao, X., Fang, T., Zhao, C., An, H., Chen, J., Xu, M., Li, J., Han, W., Yang, C., Li, F., and Chen, D.: Establishing a non-hydrostatic global atmospheric modeling system at 3-km horizontal resolution with aerosol feedbacks on the Sunway supercomputer of China, Sci. Bull., 67, 1170–1181, https://doi.org/10.1016/j.scib.2022.03.009, 2022. a
Heinzeller, D., Duda, M. G., and Kunstmann, H.: Towards convection-resolving, global atmospheric simulations with the Model for Prediction Across Scales (MPAS) v3.1: an extreme scaling experiment, Geosci. Model Dev., 9, 77–110, https://doi.org/10.5194/gmd-9-77-2016, 2016. a
Hoefler, T., Rabenseifner, R., Ritzdorf, H., de Supinski, B. R., Thakur, R., and Träff, J. L.: The scalable process topology interface of MPI 2.2, Concurr. Comp.-Pract. E., 23, 293–310, https://doi.org/10.1002/cpe.1643, 2011. a, b, c
Huang, X., Tang, Q., Tseng, Y., Hu, Y., Baker, A. H., Bryan, F. O., Dennis, J., Fu, H., and Yang, G.: P-CSI v1.0, an accelerated barotropic solver for the high-resolution ocean model component in the Community Earth System Model v2.0, Geosci. Model Dev., 9, 4209–4225, https://doi.org/10.5194/gmd-9-4209-2016, 2016. a
Irrmann, G., Masson, S., Maisonnave, É., Guibert, D., and Raffin, E.: Improving ocean modeling software NEMO 4.0 benchmarking and communication efficiency, Geosci. Model Dev., 15, 1567–1582, https://doi.org/10.5194/gmd-15-1567-2022, 2022. a
Karypis, G. and Kumar, V.: METIS: A software package for partitioning unstructured graphs, partitioning meshes, and computing fill-reducing orderings of sparse matrices, 1–33, Computer Science & Engineering (CS&E), Technical Reports, University of Minnesota, https://hdl.handle.net/11299/215346 (last access: 4 July 2025), 1997. a
Katsafados, P., Papadopoulos, A., Korres, G., and Varlas, G.: A fully coupled atmosphere–ocean wave modeling system for the Mediterranean Sea: interactions and sensitivity to the resolved scales and mechanisms, Geosci. Model Dev., 9, 161–173, https://doi.org/10.5194/gmd-9-161-2016, 2016. a
Koldunov, N. V., Aizinger, V., Rakowsky, N., Scholz, P., Sidorenko, D., Danilov, S., and Jung, T.: Scalability and some optimization of the Finite-volumE Sea ice–Ocean Model, Version 2.0 (FESOM2), Geosci. Model Dev., 12, 3991–4012, https://doi.org/10.5194/gmd-12-3991-2019, 2019. a, b, c
Liu, J., Chandrasekaran, B., Wu, J., Jiang, W., Kini, S., Yu, W., Buntinas, D., Wyckoff, P., and Panda, D. K.: Performance comparison of MPI implementations over InfiniBand, Myrinet and Quadrics, in: Proceedings of the 2003 ACM/IEEE conference on Supercomputing, 58–72, https://doi.org/10.1145/1048935.1050208, 2003. a
Mirsadeghi, S. H., Traff, J. L., Balaji, P., and Afsahi, A.: Exploiting common neighborhoods to optimize MPI neighborhood collectives, in: 2017 IEEE 24th international conference on high performance computing (HiPC), 348–357, IEEE, https://doi.org/10.1109/HiPC.2017.00047, 2017. a, b
Monbaliu, J., Padilla-Hernandez, R., Hargreaves, J. C., Albiach, J. C. C., Luo, W., Sclavo, M., and Guenther, H.: The spectral wave model, WAM, adapted for applications with high spatial resolution, Coast. Eng., 41, 41–62, https://doi.org/10.1016/S0378-3839(00)00026-0, 2000. a
Mozdzynski, G., Hamrud, M., and Wedi, N.: A partitioned global address space implementation of the European centre for medium range weather forecasts integrated forecasting system, Int. J. High Perform. C., 29, 261–273, https://doi.org/10.1177/1094342015576773, 2015. a, b
Ovcharenko, A., Ibanez, D., Delalondre, F., Sahni, O., Jansen, K. E., Carothers, C. D., and Shephard, M. S.: Neighborhood communication paradigm to increase scalability in large-scale dynamic scientific applications, Parallel Comput., 38, 140–156, https://doi.org/10.1016/j.parco.2011.10.013, 2012. a
Palmer, T.: Stochastic weather and climate models, Nat. Rev. Phys., 1, 463–471, https://doi.org/10.1038/s42254-019-0062-2, 2019. a
Pang, R., Yu, F., Gao, Y., Yuan, Y., Yuan, L., and Gao, Z.: The Finite Volume WAve Model, Zenodo [code], https://doi.org/10.5281/zenodo.15800790, 2024a. a
Pang, R., Yu, F., Gao, Y., Yuan, Y., Yuan, L., and Gao, Z.: The Finite Volume WAve Model, Zenodo [data set], https://doi.org/10.5281/zenodo.13325957, 2024b. a
Rashti, M. J.: Improving Message-Passing Performance and Scalability in High-Performance Clusters, PhD thesis, Queen's University, https://library-archives.canada.ca/eng/services/services-libraries/theses/Pages/item.aspx?idNumber=1019466946 (last access: 4 July 2025), 2010. a
Sinkovits, R. S. and Duda, M. G.: Optimization and parallel load balancing of the MPAS Atmosphere Weather and Climate Code, in: Proceedings of the XSEDE16 Conference on Diversity, Big Data, and Science at Scale, 5, 1–6, https://doi.org/10.1145/2949550.2949575, 2016. a
Su, Z., Wang, J., Klein, P., Thompson, A. F., and Menemenlis, D.: Ocean submesoscales as a key component of the global heat budget, Nat. Commun., 9, 775–782, https://doi.org/10.1038/s41467-018-02983-w, 2018. a
Tolman, H. L.: User manual and system documentation of WAVEWATCH III TM version 3.14, Technical note, MMAB contribution, 276, 1–220, https://doi.org/10.1016/j.future.2017.02.008, 2009. a
Traff, J. L.: Implementing the MPI process topology mechanism, in: SC'02: Proceedings of the 2002 ACM/IEEE Conference on Supercomputing, 28–28, IEEE, https://doi.org/10.1109/SC.2002.10045, 2002. a
Walker, D. W. and Dongarra, J. J.: MPI: a standard message passing interface, Supercomputer, 12, 56–68, 1996. a
Wang, Y., Jiang, J., Zhang, H., Dong, X., Wang, L., Ranjan, R., and Zomaya, A. Y.: A scalable parallel algorithm for atmospheric general circulation models on a multi-core cluster, Future Gener. Comp. Sy., 72, 1–10, https://doi.org/10.1016/j.future.2017.02.008, 2017. a
Wedi, N. P., Polichtchouk, I., Dueben, P., Anantharaj, V. G., Bauer, P., Boussetta, S., Browne, P., Deconinck, W., Gaudin, W., Hadade, I., Hatfield, S., Iffrig, O., Lopez, P., Maciel, P., Mueller, A., Saarinen, S., Sandu, I., Quintino, T., and Vitart, F.: A baseline for global weather and climate simulations at 1 km resolution, J. Adv. Model. Earth Sy., 12, 1–17, https://doi.org/10.1029/2020MS002192, 2020. a
Wolters, L.: Atmosphere and Ocean Circulation Simulation on Massively Parallel Computers, in: Proc of the Seventh International Workshop on the Use of Supercomputers in Theoretical Science, 1–14, http://liacs.leidenuniv.nl/assets/PDF/TechRep/tr92-15.pdf (last access: 4 July 2025), 1992. a
Yuan, Y., Yu, F., Chen, Z., Li, X., Hou, F., Gao, Y., Gao, Z., and Pang, R.: Towards a real-time modeling of global ocean waves by the fully GPU-accelerated spectral wave model WAM6-GPU v1.0, Geosci. Model Dev., 17, 6123–6136, https://doi.org/10.5194/gmd-17-6123-2024, 2024. a
Zhang, S., Xu, S., Fu, H., Wu, L., Liu, Z., Gao, Y., Zhao, C., Wan, W., Wan, L., Lu, H., Li, C., Liu, Y., Lv, X., Xie, J., Yu, Y., Gu, J., Wang, X., Zhang, Y., Ning, C., Fei, Y., Guo, X., Wang, Z., Wang, X., Wang, Z., Qu, B., Li, M., Zhao, H., Jiang, Y., Yang, G., Lu, L., Wang, H., An, H., Zhang, X., Zhang, Y., Ma, W., Yu, F., Xu, J., Lin, X., and Shen, X.: Toward Earth system modeling with resolved clouds and ocean submesoscales on heterogeneous many-core HPCs, Natl. Sci. Rev. 10, 1–15, https://doi.org/10.1093/nsr/nwad069, 2023. a
Short summary
The application of distributed graph communication topology in Earth models has rarely been studied. We tested and compared this topology with the traditional point-to-point communication method using a wave model. We found that this topology with the Intel MPI (message-passing interface) library is more efficient. Additionally, using this topology can greatly improve the performance of the wave model and could help improve the performance of other Earth models.
The application of distributed graph communication topology in Earth models has rarely been...
Altmetrics
Final-revised paper
Preprint