Articles | Volume 14, issue 11
https://doi.org/10.5194/gmd-14-6977-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-14-6977-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
ENSO-ASC 1.0.0: ENSO deep learning forecast model with a multivariate air–sea coupler
Bin Mu
School of Software engineering, Tongji University, Shanghai, 201804,
China
School of Software engineering, Tongji University, Shanghai, 201804,
China
Shijin Yuan
CORRESPONDING AUTHOR
School of Software engineering, Tongji University, Shanghai, 201804,
China
Related authors
Shijin Yuan, Tianyu Shen, Bin Mu, Zhen Wei, Bo Qin, and Guokun Dai
EGUsphere, https://doi.org/10.48550/arXiv.2610.35095, https://doi.org/10.48550/arXiv.2610.35095, 2026
This preprint is open for discussion and under review for Geoscientific Model Development (GMD).
Short summary
Short summary
Many weather models rely on decades-old Fortran code that is hard to maintain and makes gradients difficult to compute. We rewrote a widely used regional weather model in Python so that gradients can be computed automatically, providing a framework for gradient-based weather research. In 27 ten-day forecasts across nine regions, it was as accurate as the original model, and a single graphics card ran it at least as fast as the original on 128 processors.
Bin Mu, Xiaodan Luo, Shijin Yuan, and Xi Liang
Geosci. Model Dev., 16, 4677–4697, https://doi.org/10.5194/gmd-16-4677-2023, https://doi.org/10.5194/gmd-16-4677-2023, 2023
Short summary
Short summary
To improve the long-term forecast skill for sea ice extent (SIE), we introduce IceTFT, which directly predicts 12 months of averaged Arctic SIE. The results show that IceTFT has higher forecasting skill. We conducted a sensitivity analysis of the variables in the IceTFT model. These sensitivities can help researchers study the mechanisms of sea ice development, and they also provide useful references for the selection of variables in data assimilation or the input of deep learning models.
Bin Mu, Yuehan Cui, Shijin Yuan, and Bo Qin
Geosci. Model Dev., 15, 4105–4127, https://doi.org/10.5194/gmd-15-4105-2022, https://doi.org/10.5194/gmd-15-4105-2022, 2022
Short summary
Short summary
An ENSO deep learning forecast model (ENSO-MC) is built to simulate the spatial evolution of sea surface temperature, analyse the precursor and identify the sensitive area. The results reveal the pronounced subsurface features before different types of events and indicate that oceanic thermal anomaly in the central and western Pacific provides a key long-term memory for predictions, demonstrating the potential usage of the ENSO-MC model in simulation, understanding and observations of ENSO.
Shijin Yuan, Tianyu Shen, Bin Mu, Zhen Wei, Bo Qin, and Guokun Dai
EGUsphere, https://doi.org/10.48550/arXiv.2610.35095, https://doi.org/10.48550/arXiv.2610.35095, 2026
This preprint is open for discussion and under review for Geoscientific Model Development (GMD).
Short summary
Short summary
Many weather models rely on decades-old Fortran code that is hard to maintain and makes gradients difficult to compute. We rewrote a widely used regional weather model in Python so that gradients can be computed automatically, providing a framework for gradient-based weather research. In 27 ten-day forecasts across nine regions, it was as accurate as the original model, and a single graphics card ran it at least as fast as the original on 128 processors.
Bin Mu, Xiaodan Luo, Shijin Yuan, and Xi Liang
Geosci. Model Dev., 16, 4677–4697, https://doi.org/10.5194/gmd-16-4677-2023, https://doi.org/10.5194/gmd-16-4677-2023, 2023
Short summary
Short summary
To improve the long-term forecast skill for sea ice extent (SIE), we introduce IceTFT, which directly predicts 12 months of averaged Arctic SIE. The results show that IceTFT has higher forecasting skill. We conducted a sensitivity analysis of the variables in the IceTFT model. These sensitivities can help researchers study the mechanisms of sea ice development, and they also provide useful references for the selection of variables in data assimilation or the input of deep learning models.
Bin Mu, Yuehan Cui, Shijin Yuan, and Bo Qin
Geosci. Model Dev., 15, 4105–4127, https://doi.org/10.5194/gmd-15-4105-2022, https://doi.org/10.5194/gmd-15-4105-2022, 2022
Short summary
Short summary
An ENSO deep learning forecast model (ENSO-MC) is built to simulate the spatial evolution of sea surface temperature, analyse the precursor and identify the sensitive area. The results reveal the pronounced subsurface features before different types of events and indicate that oceanic thermal anomaly in the central and western Pacific provides a key long-term memory for predictions, demonstrating the potential usage of the ENSO-MC model in simulation, understanding and observations of ENSO.
Cited articles
Balmaseda, M. A., Davey, M. K., and Anderson, D. L.: Decadal and seasonal
dependence of ENSO prediction skill, J. Climate, 8, 2705–2715,
1995.
Barnston, A. G., Tippett, M. K., L'Heureux, M. L., Li, S., and DeWitt, D.
G.: Skill of real-time seasonal ENSO model predictions during 2002–11: Is
our capability increasing?, B. Am. Meteorol. Soc.,
93, 631–651, 2012.
Bayr, T., Dommenget, D., and Latif, M.: Walker circulation controls ENSO
atmospheric feedbacks in uncoupled and coupled climate model simulations,
Clim. Dynam., 54, 2831–2846, https://doi.org/10.1007/s00382-020-05152-2, 2020.
Behringer, D. W. and Xue, Y.: Evaluation of the global ocean data assimilation system at NCEP: The Pacific Ocean, in: Proc. Eighth Symp. on Integrated Observing and Assimilation Systems for Atmosphere, Oceans, and Land Surface, 2004.
Bellenger, H., Guilyardi, É., Leloup, J., Lengaigne, M., and Vialard,
J.: ENSO representation in climate models: From CMIP3 to CMIP5, Clim.
Dynam., 42, 1999–2018, 2014.
Bjerknes, J.: Atmospheric teleconnections from the equatorial Pacific,
Mon. Weather Rev., 97, 163–172, 1969.
Broni-Bedaiko, C., Katsriku, F. A., Unemi, T., Atsumi, M., Abdulai, J.-D.,
Shinomiya, N., and Owusu, E.: El Niño-Southern Oscillation forecasting
using complex networks analysis of LSTM neural networks, Artificial Life and
Robotics, 24, 445–451, 2019.
Bruna, J., Zaremba, W., Szlam, A., and LeCun, Y.: Spectral networks and
locally connected networks on graphs, arXiv [preprint], arXiv:1312.6203, 2013.
Chen, F., Pan, S., Jiang, J., Huo, H., and Long, G.: DAGCN: dual attention graph convolutional networks, in: 2019 International Joint Conference on Neural Networks (IJCNN), IEEE, 1–8, 2019.
Cheng, L., Trenberth, K. E., Fasullo, J. T., Mayer, M., Balmaseda, M., and
Zhu, J.: Evolution of ocean heat content related to ENSO, J.
Climate, 32, 3529–3556, 2019.
Chevillon, G.: Direct multi-step estimation and forecasting, J.
Econ. Surv., 21, 746–785, 2007.
Compo, G. P., Whitaker, J. S., Sardeshmukh, P. D., Allan, R. J., McColl, C., Yin, X., Giese, B. S., Vose, R. S., Matsui, N., Ashcroft, L., Auchmann, R., Benoy, M., Bessemoulin, P., Brandsma, T., Brohan, P., Brunet, M., Comeaux, J., Cram, T., Crouthamel, R., Groisman, P. Y., Hersbach, H., Jones, P. D., Jonsson, T., Jourdain, S., Kelly, G., Knapp, K. R., Kruger, A., Kubota, H., Lentini, G., Lorrey, A., Lott, N., Lubker, S. J., Luterbacher, J., Marshall, G. J., Maugeri, M., Mock, C. J., Mok, H. Y., Nordli, O., Przybylak, R., Rodwell, M. J., Ross, T. F., Schuster, D., Srnec, L., Valente, M. A., Vizi, Z., Wang, X. L., Westcott, N., Woollen, J. S., and Worley, S. J.: NOAA/CIRES Twentieth Century Global Reanalysis Version 2c, Research Data Archive at the National Center for Atmospheric Research, Computational and Information Systems Laboratory [data set], https://doi.org/10.5065/D6N877TW, 2015.
Defferrard, M., Bresson, X., and Vandergheynst, P.: Convolutional neural
networks on graphs with fast localized spectral filtering, arXiv [preprint], arXiv:1606.09375, 2016.
Dommenget, D., Semenov, V., and Latif, M.: Impacts of the tropical Indian
and Atlantic Oceans on ENSO, Geophys. Res. Lett., 33, L11701, https://doi.org/10.1029/2006GL025871, 2006.
Exarchou, E., Ortega, P., Rodríguez-Fonseca, B., Losada, T., Polo, I.,
and Prodhomme, C.: Impact of equatorial Atlantic variability on ENSO
predictive skill, Nat. Commun., 12, 1–8, 2021.
Gao, C. and Zhang, R.-H.: The roles of atmospheric wind and entrained water
temperature (T e) in the second-year cooling of the 2010–12 La Niña
event, Clim. Dynam., 48, 597–617, 2017.
Ham, Y.-G., Kim, J.-H., and Luo, J.-J.: Deep learning for multi-year ENSO
forecasts, Nature, 573, 568–572, 2019.
Hammond, D. K., Vandergheynst, P., and Gribonval, R.:Wavelets on graphs via
spectral graph theory, Appl. Comput. Harmon. A., 30,
129–150, 2011.
He, D., Lin, P., Liu, H., Ding, L., and Jiang, J.: Dlenso: A deep learning
enso forecasting model, in: Pacific Rim International Conference on
Artificial Intelligence, Springer, 12–23, 2019.
He, K., Zhang, X., Ren, S., and Sun, J.: Deep residual learning for image
recognition, in: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 770–778, https://doi.org/10.1109/CVPR.2016.90, 2016.
Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K. Q.: Densely
connected convolutional networks, in: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)
4700–4708, https://doi.org/10.1109/CVPR.2017.243, 2017.
Jin, F.-F.: An equatorial ocean recharge paradigm for ENSO. Part I:
Conceptual model, J. Atmos. Sci., 54, 811–829, 1997.
Kao, H.-Y. and Yu, J.-Y.: Contrasting eastern-Pacific and central-Pacific
types of ENSO, J. Climate, 22, 615–632, 2009.
Keys, R.: Cubic convolution interpolation for digital image processing, IEEE
T. Acoust., 29, 1153–1160,
1981.
Kirtman, B., Shukla, J., Balmaseda, M., Graham, N., Penland, C., Xue, Y.,
and Zebiak, S.: Current status of ENSO forecast skill: A report to the
CLIVAR Working Group on Seasonal to Interannual Prediction, available at: http://nora.nerc.ac.uk/id/eprint/144128/1/nino3.pdf (last access: 15 November 2021),
2001.
Kug, J.-S., Jin, F.-F., and An, S.-I.: Two types of El Niño events: cold
tongue El Niño and warm pool El Niño, J. Climate, 22,
1499–1515, 2009.
Lau, K.-M., Li, P., and Nakazawa, T.: Dynamics of super cloud clusters,
westerly wind bursts, 30-60 day oscillations and ENSO: An unified view,
J. Meteorol. Soc. Jpn., 67, 205–219, 1989.
Lau, K.-M., Ho, C.-H., and Chou, M.-D.: Water vapor and cloud feedback over
the tropical oceans: Can we use ENSO as a surrogate for climate change?,
Geophys. Res. Lett., 23, 2971–2974, 1996.
Mazumder, R., Hastie, T., and Tibshirani, R.: Spectral regularization
algorithms for learning large incomplete matrices, J. Mach.
Learn. Res., 11, 2287–2322, 2010.
McDermott, P. L. and Wikle, C. K.: An ensemble quadratic echo state network
for non-linear spatio-temporal forecasting, Stat, 6, 315–330, https://doi.org/doi.org/10.1002/sta4.160, 2017.
McDermott, P. L. and Wikle, C. K.: Bayesian recurrent neural network models
for forecasting and quantifying uncertainty in spatial-temporal data,
Entropy, 21, 184, https://doi.org/10.3390/e21020184, 2019.
McPhaden, M. J.: Tropical Pacific Ocean heat content variations and ENSO
persistence barriers, Geophys. Res. Lett., 30, 1480, https://doi.org/10.1029/2003GL016872, 2003.
McPhaden, M. J.: A 21st century shift in the relationship between ENSO SST
and warm water volume anomalies, Geophys. Res. Lett., 39, L09706, https://doi.org/10.1029/2012GL051826,
2012.
Meinen, C. S. and McPhaden, M. J.: Observations of warm water volume changes
in the equatorial Pacific and their relationship to El Niño and La
Niña, J. Climate, 13, 3551–3559, 2000.
Mu, B., Peng, C., Yuan, S., and Chen, L.: ENSO forecasting over multiple
time horizons using ConvLSTM network and rolling mechanism, in: 2019
International Joint Conference on Neural Networks (IJCNN), IEEE, 1–8,
2019.
Park, J.-H., Kug, J.-S., Li, T., and Behera, S. K.: Predicting El Niño
beyond 1-year lead: effect of the Western Hemisphere warm pool, Sci.
Rep., 8, 1–8, 2018.
Qin, B.: BrunoQin/ENSO-ASC: ENSO-ASC 1.0.1 (1.0.1), Zenodo [code], https://doi.org/10.5281/zenodo.5201715, 2021a.
Qin, B.: The training and validation dataset for ENSO-ASC model, Zenodo [data set], https://doi.org/10.5281/zenodo.5179867, 2021b.
Ren, H.-L., Jin, F.-F., Tian, B., and Scaife, A. A.: Distinct persistence
barriers in two types of ENSO, Geophys. Res. Lett., 43, 10–973,
2016.
Ren, H.-L., Zuo, J., and Deng, Y.: Statistical predictability of Niño
indices for two types of ENSO, Clim. Dynam., 52, 5361–5382, 2019.
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., Luccioni, A., Maharaj, T., Sherwin, E. D., Mukkavilli, S. K., Kording, K. P., Gomes, C., Ng, A. Y., Hassabis, D., Platt, J. C., Creutzig, F., Chayes, J., and Bengio, Y.: Tackling climate change with machine learning, arXiv [preprint], arXiv:1906.05433, 2019.
Shi, X. and Yeung, D.-Y.: Machine learning for spatiotemporal sequence
forecasting: A survey, arXiv [preprint], arXiv:1808.06865 2018.
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., and Woo, W.-C.:
Convolutional LSTM network: A machine learning approach for precipitation
nowcasting, arXiv [preprint], arXiv:1506.04214 2015.
Wang, C., Deser, C., Yu, J.-Y., DiNezio, P., and Clement, A.: El Niño
and southern oscillation (ENSO): a review, Coral reefs of the eastern
tropical Pacific, 85–106, https://doi.org/10.1007/978-94-017-7499-4_4, 2017.
Wang, Z., Bovik, A. C., Sheikh, H. R., and Simoncelli, E. P.: Image quality
assessment: from error visibility to structural similarity, IEEE
T. Image Process., 13, 600–612, 2004.
Webster, P.: The annual cycle and the predictability of the tropical coupled
ocean-atmosphere system, Meteorol. Atmos. Phys., 56, 33–55,
1995.
Wentz, F. J., Ricciardulli, L., Gentemann, C., Meissner, T., Hilburn, K. A., and Scott, J.: Remote Sensing Systems Coriolis WindSat Environmental Suite on 0.25 deg grid, Version 7.0.1. Remote Sensing Systems, Santa Rosa, CA [data set], available at: http://www.remss.com/missions/windsat (last access: 15 November 2021), 2013.
Wentz, F. J., Meissner, T., Gentemann, C., Hilburn, K. A., and Scott, J.: Remote Sensing Systems GCOM-W1 AMSR2 Environmental Suite on 0.25 deg grid, Version 8.0. Remote Sensing Systems, Santa Rosa, CA [data set], available at: http://www.remss.com/missions/amsr (last access: 15 November 2021), 2014.
Wentz, F. J., Gentemann, C., and Hilburn, K. A.: Remote Sensing Systems TRMM TMI Environmental Suite on 0.25 deg grid, Version 7.1, Remote Sensing Systems, Santa Rosa, CA [data set], available at http://www.remss.com/missions/tmi (last access: 15 November 2021), 2015.
Xue, Y., Chen, M., Kumar, A., Hu, Z.-Z., and Wang, W.: Prediction skill and
bias of tropical Pacific sea surface temperatures in the NCEP Climate
Forecast System version 2, J. Climate, 26, 5358–5378, 2013.
Yosinski, J., Clune, J., Bengio, Y., and Lipson, H.: How transferable are
features in deep neural networks?, arXiv [preprint], arXiv:1411.1792 2014.
Yu, J.-Y. and Kim, S. T.: Relationships between extratropical sea level
pressure variations and the central Pacific and eastern Pacific types of
ENSO, J. Climate, 24, 708–720, 2011.
Yu, J.-Y., Kao, H.-Y., and Lee, T.: Subtropics-related interannual sea
surface temperature variability in the central equatorial Pacific, J.
Climate, 23, 2869–2884, 2010.
Zhang, R., Liu, Q., and Hang, R.: Tropical Cyclone Intensity Estimation
Using Two-Branch Convolutional Neural Network From Infrared and Water Vapor
Images, IEEE T. Geosci. Remote S., 58, 586–597,
2019.
Zhang, W., Jin, F.-F., Stuecker, M. F., Wittenberg, A. T., Timmermann, A.,
Ren, H.-L., Kug, J.-S., Cai, W., and Cane, M.: Unraveling El Niño's
impact on the East Asian monsoon and Yangtze River summer flooding,
Geophys. Res. Lett., 43, 11–375, 2016.
Zhang, W., Li, S., Jin, F.-F., Xie, R., Liu, C., Stuecker, M. F., and Xue,
A.: ENSO regime changes responsible for decadal phase relationship
variations between ENSO sea surface temperature and warm water volume,
Geophys. Res. Lett., 46, 7546–7553, 2019.
Zheng, F. and Zhu, J.: Spring predictability barrier of ENSO events from the
perspective of an ensemble prediction system, Global Planet. Change,
72, 108–117, 2010.
Zheng, G., Li, X., Zhang, R.-H., and Liu, B.: Purely satellite data–driven
deep learning forecast of complicated tropical instability waves, Sci.
Adv., 6, eaba1482, https://doi.org/10.1126/sciadv.aba1482, 2020.
Short summary
Considering the sophisticated energy exchanges and multivariate coupling in ENSO, we subjectively incorporate the prior physical knowledge into the modeling process and build up an ENSO deep learning forecast model with a multivariate air–sea coupler, named ENSO-ASC, the performance of which outperforms the other state-of-the-art models. The extensive experiments indicate that ENSO-ASC is a powerful tool for both the ENSO prediction and for the analysis of the underlying complex mechanisms.
Considering the sophisticated energy exchanges and multivariate coupling in ENSO, we...
Altmetrics
Final-revised paper
Preprint