Spatial predictions of total organic carbon (TOC) concentrations and stocks are crucial for understanding marine sediments’ role as a significant carbon sink in the global carbon cycle. In this study, we present a geospatial prediction of global TOC concentrations and stocks on a 5 × 5 arcmin grid, using a novel neural network approach. We also provide and apply a new compilation of over 21 000 global TOC measurements and a new set of predictors, including features such as seafloor lithologies, benthic oxygen fluxes, and chlorophyll-a satellite data. Moreover, we compare different machine learning models based on their performance metrics and predictions and assess their strengths and limitations. For the dataset used, we find that the performance metrics of the models are comparable and that the neural network approach outperforms, on unseen data, methods such as k-nearest neighbours and random forests, which tend to overfit the training data. We provide estimates of mean TOC concentrations and stocks, both on continental shelves and in deep-sea settings across various marine regions and oceans. Our model suggests that the upper 10 cm of oceanic sediments harbour approximately 156 Pg of TOC stocks and have a mean TOC concentration of 0.61 %. Furthermore, we introduce a standardized methodology for quantifying predictive uncertainty using Monte Carlo dropout. The method was applied to our neural network model and underlying features to generate a map of information gain that measures the expected increase in model knowledge, achieved through additional sampling at specific locations, which is pivotal for sampling strategy planning.
Introduction
Burial of particulate organic carbon in marine sediments removes carbon dioxide (CO2) from the atmosphere and generates molecular oxygen (O2) that accumulates in the atmosphere . It is a key process in the global carbon cycle that largely controls the atmospheric partial pressures of O2 and CO2 on geological timescales . The mechanisms controlling concentrations, standing stocks, and degradation and accumulation rates of organic carbon at the seabed are, however, complex and remain a topic of active research . Furthermore, present estimates of the spatial distribution of sedimentary carbon concentrations and stocks across the global ocean, including shelf regions, are limited due to sparse data and the high spatial variability observed in shelf deposits . An improved map of global organic carbon concentrations and stocks in marine surface sediments, including the continental shelf, could, hence, help to better understand processes governing the turnover and accumulation of organic carbon at the seabed.
Sedimentary organic carbon concentrations are typically reported as total organic carbon (TOC in weight percent), which includes particulate organic carbon bound to sediment grains and a minor contribution by organic carbon dissolved in sediment porewater . TOC varies between different geological environments . Fine-grained shelf and delta sediments deposited close to river mouths typically contain 0.5 %–1.0 % TOC at 0–10 cm sediment depth . A major fraction of TOC deposited in these environments (up to 67 %) is not formed by marine plankton but is produced by land plants . Shelf regions where neritic carbonates are formed by corals and other organisms at the seabed contain about 1 % TOC . However, large parts of the continent shelf (about 50 %–70 %) do not receive sediment inputs and are covered by relict sands that contain only minor amounts of TOC (about 0.1 %). Typical deep-sea sediments, which are not associated with high-productivity regions, contain about 0.2 %–0.4 % TOC . In oceanic upwelling regions with high productivity, large amounts of TOC are rapidly deposited at the seabed such that sedimentary TOC concentrations are usually higher than 1 % and may reach up to 10 % . Elevated TOC values are also reported for surface sediments deposited in the Arctic Ocean (1.0 %) and the deep basins of the Black Sea (2.0 %) . Considering these observations, the global mean TOC concentration in both shelf and deep-sea sediments seems to be close to 0.5 % to 1.0 %.
The inventory or standing stock of TOC in surface sediments (in mass of carbon per seafloor area) is calculated by multiplying TOC concentrations by the dry bulk density of sediments and the thickness of the considered surface layer. Different methods have been applied to derive the standing stock of TOC at regional and global scales. An early estimate based on limited data and expert knowledge concluded that the global TOC stock is 146 Pg TOC for a 30 cm surface layer . The first estimate of the global TOC inventory derived by a machine learning approach (k-nearest neighbours – kNNs) using an extended database (5623 data points) yielded a global inventory of 87 ± 43 Pg TOC in the top 5 cm layer . In subsequent publications with an extended database (11 574 sediment cores) and a more advanced machine learning approach (random forest model), the global inventory was estimated as 2322 Pg TOC for the top 1 m of the sediment column . This inventory exceeds the global TOC inventory in terrestrial soils and suggests that TOC in marine surface sediments is the largest TOC pool at Earth's surface . Another estimate of the global TOC inventory was derived by reactive transport modelling of sedimentary processes employing a range of global datasets . This model yields a global inventory of 170 Pg TOC for the top 10 cm affected by biological mixing processes.
Since about 70 % of Earth's surface is covered by oceans and sampling sediments at the seafloor is costly, data coverage will always be sparse. Therefore, advanced methods are required to derive spatial information on sediment properties from a limited number of point measurements. Machine learning approaches, which have rapidly advanced in recent years, are the most promising approach to tackling this challenge. So far, k-nearest neighbours and random forest models have been applied to derive global maps of sediment porosity , TOC concentration , TOC inventory , sedimentation rate , and regional estimates of TOC accumulation rates . However, machine learning techniques have their own challenges and limitations. Overfitting issues are often encountered, and a standardized approach for estimating predictive uncertainty has not yet been established .
Given these challenges, this paper aims to derive more robust maps of TOC concentrations and inventories for the global ocean. These maps, including the continental shelf, are based on a new, larger TOC measurement database and an extended collection of predictors to improve the accuracy of predictions for highly heterogeneous and undersampled geological settings. We compiled an enlarged database of TOC concentrations in surface sediments with 21 125 entries and applied a deep neural network (DNN) as a more advanced machine learning approach that considers the non-linear relationships between TOC and other geological features. The global ocean was divided into two different domains (shelf and deep sea), and the network was trained separately for each of these domains. Moreover, we introduced a standardized methodology called Monte Carlo dropout to quantify predictive uncertainties in the DNN model and derive information gain to guide future sampling efforts.
MaterialsFeatures
An extensive repository of features from both the sea surface and the seafloor at a 5 × 5 arcmin grid resolution has been compiled using previously reported feature lists that include a range of oceanographic, geological, geographic, biological, and biogeochemical parameters. It is worth noting that oceanographic features are updated very often from newer models and measurements, and some of the features used here might be outdated. Features deemed irrelevant to TOC distributions (e.g. crustal and mantle properties, distance to the plate boundary, continental ridges, and trenches) were excluded. Additional features that may influence TOC distributions were added to improve TOC predictions. These include total oxygen uptake (respiration rates) at the seabed , sediment lithology , tidal velocities , and chlorophyll-a concentrations at the sea surface .
Ninety-nine raw feature grids are compiled for a comprehensive representation of the marine environment, providing the necessary input for the neural network analysis in this study to predict TOC concentrations in marine sediments. Most of these features are easily measurable from the sea surface by e.g. satellite observations, making them a reliable dataset compared to the less accessible properties of the seafloor. Some of the seafloor feature grids used in this work were previously generated from raw data using machine learning methods (e.g. a porosity grid provided by ). Others were reprocessed in this work to achieve global coverage at a resolution of 5 × 5 arcmin (e.g. sediment lithology, ).
Neighbourhood information was incorporated for a subset of the features. Specifically, 40 of the 99 initial features were averaged spatially using a 50 km radius . Spatial averaging was applied when TOC concentrations are assumed to be affected not only by the local feature value, but also feature values in the surrounding area. This approach was used for selected physical (e.g. current velocity), chemical (e.g. dissolved compounds), and biological (e.g. bio-fauna abundance) parameters.
Overall, a total of 139 features, including 99 original features and 40 additional spatially averaged features, is used in the model. The complete feature list is presented in Appendix .
TOC data
The dataset for TOC concentrations (in weight percent) utilized in this study has been compiled from multiple sources. It includes global datasets and regional datasets for the northern Gulf of Mexico and the North Sea (Wenyen Zhang, personal communication, 2023, HEREON). Each label represents a known measurement (TOC concentration) and is paired with the nearest grid point on the 139-feature grids via L2 distance computation, resulting in the association of a feature vector with each label. For those stations where TOC is reported as function of sediment depth, we calculated the mean TOC concentration for the top 10 cm and used this mean as the model label. For many stations, values are only reported for the top 1–2 cm (around 19 000 measurements). We included these stations in our model since they contain valuable information, but we acknowledge that they may be somewhat higher than those integrated over the top 10 cm since TOC concentrations tend to decrease with sediment depth due to ongoing TOC degradation. However, most sediments deposited on the continental shelf and in high-productivity regions of the open ocean are affected by intense biogenic and physical mixing processes such that the downcore TOC decrease is usually small within the mixed surface layer (0–10 cm sediment depth). The labelled data are pre-processed to enhance the reliability and robustness of the dataset for subsequent model development and validation. We first searched for duplicates in our combined database that may arise when the same data are reported in multiple databases. They were removed from the combined database when longitudes, latitudes, and TOC concentrations were identical. Moreover, coastal regions often exhibit clustered measurements, potentially resulting in shared feature vectors, as all the measurements lie in the same feature grid cell. To mitigate this, a variance assessment is conducted. Labels that share the same feature vectors, exhibiting high variance (the standard deviation of these labels is higher than 20 % of the maximum of these labels) are excluded, while those with low variance are averaged, and the shared feature vector is assigned. Also, some data points situated in close proximity to land were not captured adequately by the 5 × 5 arcmin grid. To address this, reasonable values are assigned by interpolating from the nearest points, ensuring the overall quality of the dataset. Our database includes a total of 110 149 data points that have been consolidated as discussed above such that the final TOC database employed in the model is composed of 21 125 entries (Fig. ). Both the datasets for the labels and features can be downloaded at 10.5281/zenodo.11186224.
Quantitative TOC measurements (i.e. labels) acquired from various sources . Notably, data point clusters are observed in close proximity to coastal regions. The colour maps used for the figures in this paper are from and .
Methods
The primary objective of this study is to build a supervised prediction model that uses feature grid maps as inputs to predict TOC concentrations as outputs. Additionally, we aim to quantify prediction uncertainties using Monte Carlo dropout and information theory techniques. The supervised model is trained using the set of labels (TOC data) and their corresponding feature vectors. Due to the non-linearity in the relationships between data and features, we choose deep-learning models, which are good at understanding such patterns. Deep neural networks (DNNs) transform data non-linearly with non-linear activation functions such as ReLU (rectified linear unit), a piecewise linear function that outputs 0 for negative inputs and the input itself for positive inputs, introducing non-linearity into the DNN. Therefore, even after one layer, multi-collinearity in the data is eliminated. In our case of a deep neural network, the final output is controlled by numerous combinations of ReLU functions involving higher-order interactions of original features .
Deep-learning model
Deep neural networks have achieved state-of-the-art results in a variety of tasks in ocean observation, prediction, and forecasting of ocean phenomena . DNN architectures, which are intrinsically non-parametric and non-linear, are less susceptible to the curse of dimensionality. They capture complex relationships between data and features at different levels of abstraction through their hierarchical nature, which makes them well-suited to resolving highly complex geoscientific problems .
Here, we use a multi-layer perceptron (MLP), feed-forward DNN to predict global TOC in sediments and introduce a new approach to mapping uncertainty in predictions that serves as a quantifiable measure of information gain from sampling. To further improve our predictions, the global ocean was separated into a continental shelf and deep-sea region using the 200 m water depth horizon as a boundary. Two separate models were trained for these regions (shelf: 0–200 m, deep sea: > 200 m) to consider the different processes that drive sedimentation and control TOC values in the deep-sea and shelf environments. The same set of features is used for both regions, but the interplay of these features differs between the contrasting environments. The weights and biases in the DNN are initialized using the technique proposed by . Batch normalization (which normalizes the inputs of each layer for faster and more stable training) and dropout (which assigns a probability of being deactivated to each node during training and thus prevents overfitting) are applied to each layer for regularization. ReLU is used as the activation function.
The Monte Carlo dropout method is implemented here to estimate uncertainty in the DNN model, leveraging dropout layers as approximate Bayesian inferences . It gives us an ensemble of predictions from different subsets of neurons in the same DNN model. Kullback–Leibler (KL) divergence is used to map information gain from the quantified predictive uncertainty. In the field of information theory, KL divergence represents the information gain and is defined as the difference of the cross-entropy between the observation and prediction of an event and the entropy in the observation of the event . In our context, the predicted distribution arises from the Monte Carlo dropout prediction ensemble, while the reconstructed observed distribution is modelled with a normal distribution, with the predicted value as a mean and a standard deviation of 0.05 TOC % arising from both technical handling and the precision of the weighting tool .
Uncertainty and information gain are inherently associated insofar as there cannot be high information gain without high uncertainty. However, information gain also depends on the observation probability distribution and is constrained by it. In other words, information gain measures the expected increase in model knowledge achieved through field sampling at a specific location. This concept provides a strategic guide for determining optimal sampling strategies: taking samples in regions with the highest information gain values is the most efficient way of refining our model’s representation of the real world. The mathematical formulation of entropy, cross-entropy, and information gain is detailed in Appendix .
Results and discussions
Understanding the global distribution of TOC concentrations and stocks is crucial for advancing our knowledge of the carbon cycle and sedimentary environments worldwide. Before delving into the prediction maps from the DNN, we first compare the performance of three methods: DNNs, kNNs, and random forests. Separate models are run for the deep-sea and continental shelf regions, and the outcomes are summarized in Table . For kNN, five neighbours were utilized for the continental shelves and four for the deep sea, based on a sensitivity analysis with respect to model performance. Random forests employed 100 estimators for both marine regions. The DNN consists of 10 layers with 128 nodes each. The choice of hyperparameters in the models is discussed in Appendix . This comparison sets the groundwork for a detailed exploration of DNN results. All of the methods were run with the same training–testing splits of the dataset, and the random split is seeded to make the methods reproducible.
Comparison of machine learning methods based on performance metrics: Pearson correlation coefficient (Pearson CC), coefficient of determination (R2), and mean squared error (MSE) for predicted values vs. observed labels for the training and testing data. The train:test data ratio is 85:15. The better-performing method, based on the metric, is highlighted in bold.
MethodTraining data Testing data (15 % of all the data) Pearson CCR2MSEPearson CCR2MSEkNN0.9210.450.5170.8520.7190.541Random forest0.986 0.9660.2390.8670.7450.499DNN0.9280.8440.4920.888 0.7370.537
The results of this model comparison show that random forest and kNN algorithms exhibit higher correlation coefficients and superior overall performance in the training dataset than the DNN. However, the DNN outperforms the other two algorithms in the testing data performance (Table ) for the dataset used. This discrepancy suggests a potential overfitting issue, where the kNN and random forest models may have become specialized in learning the training data. The emphasis on generalization capabilities is crucial in our context due to data scarcity in many regions, making predictions in unexplored areas a priority. The correlation plot between the measured and predicted data shows similar errors for the training and testing datasets, which confirms that the DNN model largely avoids overfitting (Fig. ). The observed underestimation of TOC concentrations at higher values is likely due to the distribution of the ground truth dataset, which is predominantly composed of low TOC concentrations (< 1 %). Training an NN model on such an imbalanced dataset often results in a model that is biased towards predicting lower values, effectively “erring on the side of caution”. Several approaches could be employed to address this issue, such as weighting the gradient descent steps based on concentration values, applying a logarithmic transformation to the TOC scale, or balancing the dataset by withholding low-value labels. However, each of these methods is likely to introduce trade-offs, potentially reducing accuracy in other areas. Ultimately, the most effective way of improving the model's performance in predicting higher TOC concentrations is to obtain additional TOC samples within this higher range.
Heatmap of the correlation plot between measured (labels) and predicted data (targets) using DNN for (a) training data and (b) testing data in order to assess the model performance. The minimal difference observed between the training and testing errors serves as an indicator of the model's ability to avoid overfitting.
The prediction map of the DNN is presented in Fig. , while maps generated by kNN and random forests are provided in Appendix (Figs. and ). Both the kNN and random forests showed artifacts, particularly in the equatorial Pacific and Atlantic oceans, similar to the map published by . As stated by , there is no standard means of quantifying uncertainty in kNN. In random forests, the variance or standard deviation of all the sub-output values for measuring the regression uncertainty is considered an uncertainty quantification method, but it is difficult to provide the uncertainty for an individual base learner . Estimating the confidence of the predictions should be an important factor in deciding which model to use. On the other hand, uncertainty quantification in the DNN is an active field of research and has standardized methods. Nonetheless, kNNs and random forests are useful learning algorithms when computational resources are constrained and require an out-of-the-box solution.
Global prediction map of the TOC concentration using a DNN. A higher TOC concentration is observed in the Arctic region and in upwelling areas located along the western continental margins of America and Africa, the equatorial Pacific, and the Arabian Sea.
We also tested a DNN model where the global ocean was not separated into shelf and deep-sea regions but treated as one entity. The resulting TOC map shows spurious features in the Pacific Ocean (Appendix ), similar to those found in previous predictions. This additional model shows that the separation of the ocean into shelf and deep-sea regions improves the model results.
Our DNN-based map of TOC concentrations (Fig. ) shows similarities to maps previously published by and , who used geostatistical methods and a kNN model. All of the maps show elevated concentrations in the Arctic region and in upwelling areas located along the western continental margins of North America, South America, Africa, the equatorial Pacific, and the Arabian Sea. This pattern can be explained by elevated rates of marine primary and export production in upwelling regions delivering large fluxes of TOC to the seabed. The low TOC values in the open oceans are related to lower productivity and the large water depths limiting the TOC flux to the deep-sea floor. The predictions in Fig. are also consistent with the early work on TOC distributions by and , showing low TOC values in the open oceans and elevated values for upwelling regions and the Arctic region. The high TOC concentrations predicted for the Black Sea and Baltic Sea (Fig. ) are probably related to the lack of oxygen in the bottom waters of these marginal seas that promotes TOC preservation . The map published by shows several large areas in the open Pacific that have unusually high TOC concentrations. These patches are probably not realistic since they do not appear in other maps and are not consistent with our understanding of the TOC cycle. They may be artifacts generated by the kNN method and the sparse data coverage in these regions. Our new map avoids these artifacts and presents a pattern that corresponds better to our understanding of TOC accumulation on the seafloor for both the deep sea and the continental shelf, which were never modelled individually on previous maps.
We also produced a map of TOC stocks for the global ocean (Fig. ). The TOC stocks were calculated using the global porosity grid provided by and a density of dry solids (ds) of 2.6 g cm−3. We performed the calculation for the top 10 cm of the sediment column since our TOC data have been measured within this mixed surface layer. Moreover, the top 10 cm are the most vulnerable and dynamic part of the sedimentary TOC pool since they are subject to frequent biological and physical mixing processes and are affected by human interventions such as bottom trawling .
TOC stock=(1-porosity)×ds×TOC concentration×10 cm
TOC stock map using the global porosity grid provided by . The colour map is shown on a logarithmic scale.
The TOC stock is computed for global oceans and major seas , considering both continental shelves and deep-sea regions within each ocean and sea (Table ). Notably, the mean TOC concentration on continental shelves exhibits significant variability across regions. A visualization of the TOC stock in the oceans is provided in Appendix .
TOC stock in the continental shelf and deep-sea regions.
Continental shelves Deep sea RegionSum of the TOCAreaMean TOCSum of theAreaMean TOCstock (Pg)(×106 km2)concentration (%)TOC stock (Pg)(×106 km2)concentration (%)Arctic Ocean5.575.720.947.189.460.88Indian Ocean2.634.060.6125.8667.100.55Mediterranean Sea0.610.650.981.952.271.04North Atlantic Ocean2.824.260.6314.9637.460.58North Pacific Ocean2.743.830.6631.1673.420.67South Atlantic Ocean1.251.860.8212.7638.670.51South China and Easter Archipelago seas1.563.000.482.583.740.83South Pacific Ocean1.261.461.0232.9683.810.58Southern Ocean0.210.570.596.3920.160.43Baltic Sea*0.770.393.03Caspian Sea*0.720.382.27Total20.1526.200.79135.80336.080.59
* The total sums and the mean concentrations in the continental shelves include the Baltic Sea and the Caspian Sea. Without these regions, the total TOC stock in the continental shelves is 18.66 Pg, the area of the continental shelves is 25.42 ×106 km2, and the mean TOC concentration is 0.66 %.
According to our model, most the TOC stock can be found in the vast deep-sea basins of the Pacific, Indian, and Atlantic oceans, which is due to the large area of these basins (Table ). The shelf region harbours 12.1 % of the global stock (Table , excluding the Baltic Sea and Caspian Sea), similar to the fraction previously derived by , who suggested that 11.5 % of the global TOC stock is located on the continental shelves. The global TOC stock derived from our model amounts to 155.8 Pg carbon for the 10 cm layer considered in our calculations (Table ). This value is close to the global stock in the top 10 cm derived by reactive transport modelling (170 Pg carbon, ). The other stock estimates were calculated by applying a range of sediment thicknesses. When normalized to 10 cm, the stock reported by amounts to 174 Pg carbon, while the stock derived by amounts to 232 Pg carbon. The first stock estimate, which was based on expert knowledge and a limited database, corresponds to only 49 Pg carbon when normalized to 10 cm , which is lower than our estimate. Our new global stock assessment, hence, falls into the range of previous estimates.
According to our DNN model, the mean TOC concentration in continental shelf sediments, excluding the Baltic Sea and the Caspian Sea (0.70 %), is close to the concentration in deep-sea sediments (0.59 %, Table ). This is a surprising result since the high marine productivity and low water depths on the shelf induce high TOC fluxes to the seabed that should result in elevated TOC concentrations in surface sediments. Moreover, large amounts of terrestrial particulate organic carbon (POC) produced by land plants are deposited in shelf sediments , which should further increase TOC concentrations in these deposits. However, TOC concentrations in shelf surface sediments are diminished by a number of factors: (i) frequent biological and physical reworking that accelerates TOC degradation processes , (ii) dilution of TOC by inorganic material (clay, silt, and sand) in delta deposits and other shelf regions with high sedimentation rates , (iii) strong bottom currents that inhibit sediment deposition such that large shelf areas are covered by relict coarse-grained sediments that were deposited in the geological past and that do not contain significant amounts of TOC , and (iv) frequent bottom trawling that exposes sedimentary TOC to oxygen and accelerates TOC degradation . According to our DNN model, these factors could potentially decrease TOC concentrations in shelf sediments to such a degree that they attain mean values that are close to those observed in deep-sea sediments (Table ). It should, however, be noted that most TOC burial occurs on the shelf, where sedimentation rates are elevated due to the deposition of riverine particles .
A method based on cooperative game theory (SHAP, SHapley Additive exPlanations) is used to analyse our results further and identify features that have a large effect on the predicted distribution of TOC concentrations . The higher the SHAP value for a feature, the more important the feature is for the predictions of that particular model. According to our model analysis, the total oxygen uptake feature has the largest effect (SHAP value) on predicted TOC concentrations in shelf sediments, while the global porosity grid was the most important feature for deep-sea sediments. It should, however, be noted that the feature importance ranking is only valid for our specific model set-up and might not be representative of the real world. Model interpretability and feature importance ranking are discussed further in Appendix .
To guide future sampling, a new information gain map is provided (Fig. ). It identifies the regions that should be explored in order to improve the current model predictions. Some of the main takeaways from the information gain map are that (i) regions with high information gain are found in parts of the equatorial Pacific Ocean, in Zealandia, and around Papua New Guinea. These regions are less explored geographically, and hence the model is not trained with the features in this region. (ii) The continental slopes on the western coast of North America, in the east of Iceland, and in parts of the eastern coast of Africa have a higher information gain, though they have more measurements. This could be due to the steep slopes and rough topography in these regions that may induce a high spatial heterogeneity in TOC values that is not yet resolved by the model. (iii) Though the Southern Ocean is not well-explored, regions with higher information gain are only found with relatively steep terrain, such as areas located close to islands and ocean ridges. These examples show that an abundance of measurements does not necessarily correspond to lower information gain and vice versa. Information gain depends not only on the geographical proximity of measurements, but also on their proximity in the parameter space and the congruence of the measurements made there. Including measurements from a region of higher information gain should lead to higher model knowledge, and hence this is more valuable compared to regions of low information gain. An experiment showing this is presented in Appendix .
The information gain map serves as a guide for determining optimal sampling locations, i.e. those with high information gain values. The colour scheme highlights the high information gain regions with brighter colours. Information gain does not have any units and is non-negative – [0,inf).
Conclusions
The comparison between different modelling approaches, including DNNs, kNNs, and random forests, highlights the effectiveness of each method in predicting TOC concentrations. While kNN and random forest models exhibit higher correlation coefficients and overall performance in the training dataset, the DNN outperforms them in testing data performance. This suggests a potential overfitting issue with the kNN and random forest models, where they may have become specialized in learning the training data. Nonetheless, these algorithms remain useful, especially when computational resources are limited.
Our DNN-based map of TOC concentrations shows elevated values in specific regions such as the Arctic and upwelling areas along continental margins. These patterns are consistent with known processes of marine primary and export production. Notably, our model that treats the shelf and deep-sea regions as separate entities captures their individual dynamics with higher accuracy and yields a better global map of TOC concentrations than a model version that simulates the entire ocean as one continuous system. It specifically avoids artifacts like unrealistically high TOC concentrations in open-ocean regions with poor data coverage that have also been encountered in previous kNN and forest models. The computed TOC stock for global oceans and major seas provides valuable insights into the distribution and magnitude of TOC storage. Despite significant variability in the mean TOC concentration across continental shelves, our model confirms that the majority of the TOC stock is found in deep-sea basins. Surprisingly, mean TOC concentrations in continental shelves are close to those in deep-sea sediments, suggesting complex processes at play that diminish TOC concentrations in shelf sediments.
The analysis of information gain highlights regions with sparse or contradicting measurements and higher uncertainty, providing guidance for future sampling efforts. It reveals that the abundance of measurements does not necessarily correspond to lower uncertainty, emphasizing the importance of considering both geographical proximity and parameter space proximity in sampling strategies.
In conclusion, our study contributes to a better understanding of global TOC distributions and stocks, shedding light on the complex interplay between biological, physical, and geological processes in marine sedimentary environments. The insights gained from our modelling approach can inform future research and management efforts aimed at preserving and managing marine carbon sinks.
Feature list
File names adhere to the naming conventions discussed below. The naming structure is partitioned by underscores and periods in the following order: the interface to which the gridded values refer, the quantity of values contained within the grid, the units and reference values or units (e.g. metres below sea level), the data source, the statistic calculated (if applicable), the grid pitch, and the file extension.
SSSea surface–atmosphere interface (may also be the average of the entire water column)SFSeafloor–water interface (may also be denoted by GL – ground level)(r50 km) – raw feature and feature averaged at a 50 km radiusThe units referenced are as follows. KGM3Kilograms per cubic metreMSMetres per secondKMKilometresM_ASLMetres above sea level (i.e. metres referenced to the sea level)MWM2Milliwatt per square metreTGCYRTeragrams of carbon per yearTGYRTeragrams per yearMAMega-annumMMetresMGCM2Milligrams of carbon per square metreDEGDegreesSSeconds
Most of the features presented below were collected by and . The new datasets, including the additions from this work, are available at 10.5281/zenodo.11186224.
Feature list with the descriptions and references used as input for all of the models in the paper.
FeatureExplanationData sourceGL _COAST _FROM _LAND _IS _1.0 _ETOPO2v2.5m.nc (raw, r50 km)Coastline, with a binary indicator for the presence of a coastline. This dataset is derived from ETOPO2v2, with 2 min gridded global relief data for land topography.GL _COAST _FROM _SEA _IS _1.0 _ETOPO2v2.r50km.men.5m.nc (raw, r50 km)Coastline with a binary indicator for the presence of a coastline using ETOPO2v2 relief data for ocean bathymetryGL _DIST _TO _COAST _KM _ETOPO.r50km.men.5m.grd (raw, r50 km)Distance of the ocean grid points to the nearest coastGL _ELEVATION _M _ASL _ETOPO2v2.r50km.men.5m.grd (raw, r50 km)Elevation data from ETOPO2v2, representing heights above sea levelGL _RIVERMOUTH _CO2 _TGCYR-1 _ORNL.r50km.men.5m.grd (raw, r50 km)Carbon dioxide flux at river mouths, measured in teragrams of carbon per year (Tg C yr−1)GL _RIVERMOUTH _DOC _TGCYR-1 _ORNL.r50km.men.5m.grd (raw, r50 km)Dissolved organic carbon flux at river mouths (Tg C yr−1)GL _RIVERMOUTH _HCO3 _TGCYR-1 _ORNL.r50km.men.5m.grd (raw, r50 km)Bicarbonate HCO3- flux at river mouths (Tg C yr−1)GL _RIVERMOUTH _POC _TGCYR-1 _ORNL.r50km.men.5m.grd (raw, r50 km)Particulate organic carbon flux at river mouths (Tg C yr−1)GL _RIVERMOUTH _TSS _TGYR-1 _ORNL.r50km.men.5m.grd (raw, r50 km)Total suspended solid flux at river mouths (50 km resolution) (Tg C yr−1). All of the riverine fluxes are binary features, with the magnitudes of the fluxes defined at the coastline and with a value of 0 for the ocean's interior.GL _TOT _SED _THICK _M _CRUST1 _NOAA.r50km.men.5m.grd (raw, r50 km)Total sediment thickness in Earth's crust (m)2N2 _ocean _eot20 _modified.nc;K1 _ocean _eot20 _modified.nc;K2 _load _eot20 _modified.nc;K2 _ocean _eot20 _modified.nc;M2 _load _eot20 _modified.nc;M2 _ocean _eot20 _modified.nc;M4 _load _eot20 _modified.nc;M4 _ocean _eot20 _modified.nc;MF _load _eot20 _modified.nc;MF _ocean _eot20 _modified.nc;MM _load _eot20 _modified.nc;MM _ocean _eot20 _modified.nc;N2 _load _eot20 _modified.nc;N2 _ocean _eot20 _modified.nc;O1 _load _eot20 _modified.nc;O1 _ocean _eot20 _modified.nc;P1 _load _eot20 _modified.nc;P1 _ocean _eot20 _modified.nc;Q1 _load _eot20 _modified.nc;S1 _load _eot20 _modified.nc;S1 _ocean _eot20 _modified.nc;S2 _load _eot20 _modified.nc;S2 _ocean _eot20 _modified.nc;SA _load _eot20 _modified.nc;SA _ocean _eot20 _modified.nc; SSA_load_eot20_modified.nc; SSA_ocean_eot20_modified.nc provided global atlases of both ocean and load tides, containing information about the amplitudes and phases of 17 tidal constituents (ocean and load) for the global ocean. These constituents include 2N2, J1, K1, K2, M2, M4, MF, MM, N2, O1, P1, Q1, S1, S2, SA, SSA, and T2, which extend across the entire global ocean and range from 66° S to 66° N. For higher latitudes, the FES2014b model is used to fill in the gaps. Eleven satellite altimetry missions contribute to this model.ChlorSummerMean.ncAverage chlorophyll-a concentration during summer (June to November), collected from July 2002 till July 2022ChlorWinterMean.ncAverage chlorophyll-a concentration during winter (December to May), collected from July 2002 till July 2022
Continued.
FeatureExplanationData sourceDERIVATIVE _GL _ELEVATION _M _ASL _ETOPO2v2.5.ncSlope from ETOPO2v2.5 dataGL _HEATFLUX _MWM2 _Becker.5m.ncOceanic heat flux data (exchange of heat energy between the ocean surface and the atmosphere) in megawatts per square metre (MW m−2)GL _LAND _IS _1.0 _ETOPO2v2.5m.ncLand mask dataPOROSITY _global _prediction.grdGlobal prediction map for porosity of surface sediments using a random forest methodSF _ACTIVE _SEAMOUNTS _KIM.r10km.wct.5m.grdVolcanically active seamount location data at 10 km resolutionSF _AVG _SEA _DENSITY _KGM3 _DECADAL _MEAN _woa13x.5m.grd (raw, r50 km)Sea density (kg m−3), averagedSF _COASTLINE _IS _1.0.5m.ncCoastline data from Global Land One-kilometer Base Elevation (GLOBE)SF _CURRENT _EAST _MS _2012 _12 _HYCOMx.5m.grd;SF _CURRENT _NORTH _MS _2012 _12 _HYCOMx.5m.grd;SF _CURRENT _MAG _MS _2012 _12 _HYCOMx.5m.grd (raw, r50 km)Ocean bottom current data for the east–west component, north–south component, and total magnitude using the HYCOM model (m s−1). The data are provided at 1/12° resolution. The dataset has a time range from 1 August 1995 to 31 December 2012, temporally averaged.SF _GRAINSIZE _D16 _MM _NGDC.5m.nc;SF _GRAINSIZE _D50 _MM _NGDC.5m.nc;SF _GRAINSIZE _D84 _MM _NGDC.5m.ncGrain-size data with the 16th percentile (D16), median (D50), and 84th percentile (D84)SF _SEA _BULKMODULUS _MPA _DECADAL _MEAN _woa13x.5m.ncSea bulk modulus (MPa) averaged over 6 decades from the years 1955 to 2012. The sea bulk modulus is an important thermodynamic property and is a measure of resistance to the compressibility of a fluid. It is calculated from the International Equation of State of Seawater of .SF _SEA _CONDUCTIVITY _SM _DECADAL _MEAN _woa13v2x.5m.grd (raw, r50 km)Average conductivity of seawater (dissolved ions) at the sea surface over 6 decades from the years 1955 to 2012. The units are Siemens per metre (S m−1).SF _SEA _OXYGEN _MLL _DECADAL _MEAN _woa13v2x.5m.grd (raw, r50 km)Average dissolved oxygen concentration in seawater in millilitres per litre over a decadal meanSF _SEA _OXYGEN _PCTSAT _DECADAL _MEAN _woa13v2x.5m.grd (raw, r50 km)Oxygen concentration in seawater percentage saturation averaged over 6 decades from the years 1955 to 2012SF _SEA _PRESSURE _MPA _DECADAL _MEAN _woa13x.5m.ncSeawater pressure (MPa) averaged over 6 decades from the years 1955 to 2012SF _SEA _SALINITY _PSU _DECADAL _MEAN _woa13v2x.5m.ncSeawater salinity in practical salinity units averaged over 6 decades from the years 1955 to 2012
Continued.
FeatureExplanationData sourceSF _SEA _SEA _OXYGEN _UTILIZATION _MOLM3 _DECADAL _MEAN _woa13v2x.5m.grd (raw, r50 km)Oxygen concentration in seawater utilization (mol m−3) averaged over 6 decades from the years 1955 to 2012SF _SEA _TEMPERATURE _C _DECADAL _MEAN _woa13v2x.5m.grd (raw, r50 km)Seawater temperature in degrees Celsius averaged over 6 decades from the years 1955 to 2012SL _GEOID _M _ABOVE _WGS84 _NGA _egm2008.5m.grdHeight of the geoid above the WGS84 reference ellipsoid (m) and referenced to the National Geospatial-Intelligence Agency (NGA)SS _BIOMASS _BACTERIA _LOG10 _MGCM2 _WEI2010x.5m.grd (raw, r50 km); SS _BIOMASS _FISH _LOG10 _MGCM2 _WEI2010x.5m.grd (raw, r50 km); SS _BIOMASS _INVERTEBRATE _LOG10 _MGCM2 _WEI2010x.5m.grd (raw, r50 km); SS _BIOMASS _MACROFAUNA _LOG10 _MGCM2 _WEI2010x.5m.grd (raw, r50 km); SS _BIOMASS _MEGAFAUNA _LOG10 _MGCM2 _WEI2010x.5m.grd (raw, r50 km); SS _BIOMASS _MEIOFAUNA _LOG10 _MGCM2 _WEI2010x.5m.grd (raw, r50 km); SS _BIOMASS _TOTAL _LOG10 _MGCM2 _WEI2010x.5m.grd (raw, r50 km)Distribution of mean biomass predictions for (a) bacteria, (b) fish, (c) invertebrates, (d) macrofauna, (e) megafauna, and (f) meiofauna. The mean biomass was computed using a random forest algorithm. The total biomass was combined from predictions of bacteria, meiofauna, macrofauna, and megafauna biomasses. Predictions were smoothed by inverse distance weighting interpolation to 0.1° resolution and displayed on a logarithm scale (base 10), which was then converted into 5 arcmin grids by .SS _CHLOROPHYLL _LOG _MG _M3 _MODIS _Aqua _MISSION _MEANx.5m.grd (raw, r50 km); SS _PIC _LOG _MOL _M3-1 _MODIS _Aqua _MISSION _MEANx.5m.grd (raw, r50 km); SS _POC _LOG _MOL _M3-1 _MODIS _Aqua _MISSION _MEANx.5m.grd (raw, r50 km)The Moderate Resolution Imaging Spectroradiometer (MODIS) is a 36-band spectroradiometer measuring visible and infrared radiation and obtaining data that are used to derive the near-surface concentration of chlorophyll a (chlor_a) (mg m−3). This is calculated using an empirical relationship derived from in situ measurements of chlor_a, concentrations of particulate organic carbon (POC) and particulate inorganic carbon (PIC) (i.e. calcium carbonate or calcite), and blue- to green-band ratios of in situ remote sensing reflectances (Rrs).SS _CORIOLIS.5m.ncCoriolis data, generated using empirical meansSS _DENSITY _KGM-3 _SACD _Aquarius _MISSION _MEANx.5m.grdThe Aquarius/SAC-D satellite mission, launched on 10 June 2011, was a joint venture between NASA and the Argentinian Space Agency (CONAE). The mission featured the sea surface salinity sensor Aquarius and was the first mission with the primary goal of measuring sea surface salinity (SSS) from space. The monthly maps of sea surface density are derived from Aquarius sea surface salinity and ancillary sea surface temperature. The time period used to average is between 25 August 2011 and 7 June 2015.SS _GEOID _ANOMALY _NGA _egm2008.5m.nc (raw, r50 km)The regional Free-air and Bouguer gravity anomaly grids (averaged over 2.5 arcmin by 2.5 arcmin) are computed at BGI (Bureau Gravimetrique International) from the EGM2008 spherical harmonic coefficients.SS _MIXED _LAYER _DEPTH _MAX _M _Goyetx.5m.grd (raw, r50 km); SS _MIXED _LAYER _DEPTH _MIN _M _Goyetx.5m.grd (raw, r50 km)This shows the geographical distribution of the maximum and minimum depths (m) of the mixed layer. The observations are in the time span between March 1995 and February 1996.
Continued.
FeatureExplanationData sourceSS _PHOTO _AVAIL _RAD _EINSTEIN _M-2 _DAY _SNPP _VIIRS _MISSION _MEANx.5m.grd (raw, r50 km); SS _PHYTO _ABSORPTION _443NM _M-1 _SNPP _VIIRS _MISSION _MEANx.5m.grdDaily average photosynthetically available radiation (PAR) at the ocean surface (Einstein m−2 d−1). The Visible Infrared Imaging Radiometer Suite (VIIRS) on the Suomi National Polar-orbiting Partnership (SNPP) was developed for global ocean colour products. PAR is defined as the quantum energy flux from the Sun in the 400–700 nm range. For ocean colour applications, PAR is a common input used in modelling marine primary productivity. An average of the sensors and the 443 nm wavelength maps is used as a feature.SS _WAVE _DIRECTION _DEG _2012 _12 _WAVEWATCH3x.5m.grd (raw, r50 km); SS _WAVE _HEIGHT _M _2012 _12 _WAVEWATCH3x.5m.grd (raw, r50 km); SS _WAVE _PERIOD _S _2012 _12 _WAVEWATCH3x.5m.grd (raw, r50 km)Mean wave direction (°), wave height (m), and wave period (s). The data are provided at 1/12° resolution. The dataset is averaged over the time range from 1 August 1995 to 31 December 2012. The features are based on the third-generation wave model WAVEWATCH III®.SS _WINDSPEED _MS-1 _SACD _Aquarius _MISSION _MEANx.5m.grd (raw, r50 km)Mean wind speed (m s−1) from the Aquarius/SAC-D satellite mission. The time period used for averaging is between 25 August 2011 and 7 June 2015.TOU _Jorgenson2022.ncGlobal map of the total oxygen uptake (TOU) of the seabedlitho_maps_type1_.ncLithology map: mudflats binary map (median grain size < 0.05 mm)litho_maps_type2_.ncLithology map: fine-sand binary map (median grain size 0.05–0.5 mm)litho_maps_type3_.ncLithology map: sand binary map (median grain size 0.5–2 mm)litho_maps_type4_.ncLithology map: clay binary map (median grain size < 0.01 mm)litho_maps_type5_.ncLithology map: gravel and stone binary map (median grain size > 2 mm)litho_maps_type6_.ncLithology map: bedrock binary maplithology _grain _size _global _8.ncGlobal seabed sediment map with 24 different classes or types of sediments based on a logarithmic progression of the median grain sizeInformation gain
In this paper, KL divergence, also known as information gain or relative entropy, has been used to quantify model uncertainty. As pointed out, in the absence of observational information, the amount of information can be taken to be numerically equal to the amount of uncertainty concerning the model prediction. The mathematical derivation of KL divergence against the theoretical background of information theory is presented below. The information entropy of a random variable X with a probability distribution P is represented as
H(P)=-∑iP(xi)logP(xi).
Top left: difference in the prediction of the TOC concentration between ϕ(x,W,b) and ϕwh+low_ig(x,W,b)2. Top right: difference in the prediction of the TOC concentration between ϕ(x,W,b) and ϕwh+high_ig(x,W,b)2. Brighter colours (shades of yellow) show higher differences, and darker colours (shades of blue) show lower differences. Bottom left (red box): zoomed-in version of the equatorial Pacific region in panels (a) and (c). Bottom right (green box): zoomed-in versions of the Caspian and Black seas in panels (b) and (d).
The definition of entropy determines the minimum channel capacity required to reliably transmit the information as encoded binary digits. Usually, the true distribution P(X) denotes observed data, measurements, or an exact probability distribution. Here, P(X) is constructed using a normal distribution with a mean value equal to Monte Carlo dropout prediction and a standard deviation of 0.05 TOC %, which arises from both technical handling and the precision of the weighting tool . The predicted distribution Q(X) is derived from the Monte Carlo dropout prediction ensemble. The measure Q(X) typically represents a theoretical framework, a model, a description, or an approximation of P(X). The cross-entropy between P(X) and Q(X) measures the average number of binary digits to represent an event from P(X) by Q(X). It is represented as
H(P,Q)=-∑iP(xi)logQ(xi).
Performance metrics of models trained on different subsets of data based on information gain for different splits of data (seeds): Pearson CC, R2, and MSE for predicted values vs. observed labels for the training and testing data. The train:test data ratio is 85:15. The better-performing dataset, based on the metric, is highlighted in bold. It shows that the performance on the test dataset, or the generalisation is mostly higher when using the dataset with higher information gain.
DNN model with different training datasetsTraining data Testing data (15 % of all of the data) Pearson CCR2MSEPearson CCR2MSEϕwh+low_ig(x,W,b)10.9180.8400.5350.8140.6410.692ϕwh+high_ig(x,W,b)10.9180.8330.5860.8250.6790.640ϕwh+low_ig(x,W,b)20.9270.8560.4050.8870.7840.525ϕwh+high_ig(x,W,b)20.9240.8430.4700.8770.7610.593ϕwh+low_ig(x,W,b)30.9350.8640.4100.8190.6680.575ϕwh+high_ig(x,W,b)30.9320.8530.4280.8550.7280.475
The information gain that measures the difference between the cross-entropy (Eq. ) and the entropy (Eq. ) is represented as DKL(P‖Q).
DKL(P‖Q)=H(P,Q)-H(P)=∑iP(xi)logP(xi)Q(xi)
DKL(P‖Q) is always non-negative and remains well-defined for continuous distributions. To obtain the continuous distribution for the predicted distribution Q(X), the prediction ensemble is binned into histograms to obtain an approximate probability density function (PDF). This PDF is then modelled using curve-fitting techniques typically fitted to a Gaussian distribution (Algorithm ). DKL(P‖Q) is calculated globally for each prediction and plotted on the information gain map.
In supervised machine learning, a model's predictive performance is usually determined by withholding a test dataset during the training phase and comparing the final model outputs to these known values. Such a procedure is not possible when evaluating the performance of information gain: firstly, the concept of a ground truth for the information gain values does not exist. Secondly, we aim to measure the effect that data point selection guided by information gain has on the model output, not the information gain itself. Thus, in order to explore the effect that information gain has on data sampling and model refinement, we devised the following experiment: a DNN model with the same parameters as the original one was trained while withholding one-third of the original training dataset: ϕwh(x,W,b). Afterwards, this model was used to calculate the information gain for each point in the withheld data. These additional data points were sorted according to their information gain values and divided into two subsets of equal size. Each of these subsets was used along with the initial two-thirds to train two new DNN models: one with added high information gain data points (ϕwh+high_ig(x,W,b)) and one with added low information gain data points (ϕwh+low_ig(x,W,b)). To validate the entirety of the training data, the process was repeated two more times, withholding a different third of the dataset each time.
In two of the three executions, the (test) performance of ϕwh+high_ig(x,W,b) was superior to that of ϕwh+low_ig(x,W,b) (Table ). While the difference in performance from the different data subsets might be small in magnitude, the selection of high information gain points also has a positive effect on the structure of the global inference patterns: in Fig. we took the prediction maps for both models of the worst-performing data subset, ϕwh+high_ig(x,W,b)2 and ϕwh+low_ig(x,W,b)2, and calculated the absolute difference between them and the inference map of the original model ϕ(x,W,b) in Fig. . Regardless of the performance metrics, the high information gain model resembles the output of the original model more closely than the low information gain model.
Comparison of the methods
One of the drawbacks of using DNN is the number of hyperparameters that needs to be tuned. The number of layers and the nodes in each layer were decided using a trial-and-error method starting with the simplest configuration of three layers of eight neurons. The model complexity was increased till the validation and training performance were comparable, thus avoiding overfitting while still getting relatively good performance in the test dataset. The initial learning rate was chosen based on the model convergence. The DNN model had 10 layers of 128 nodes each with a learning rate of 0.01. The batch size, decided based on the amount of data, was set to 500 and was also chosen based on model convergence. On the other hand, the parameters that were tuned in the random forest algorithm and kNNs were the number of trees in the forest (controlled by the number of estimators in sklearn) and the number of neighbours, respectively. They are tuned using the performance metrics for 1–50 neighbours for kNN. The number of estimators is 10, 20, 30, …, 100 for random forests.
Though it is difficult to tune the DNN model, Table highlights superior performance in the training dataset for kNNs and random forests, while their test performance or generalization capability lags behind that of DNNs. Figures and show artifacts of the global predictions from kNNs and random forests, particularly in the equatorial Pacific and Atlantic oceans.
Global prediction map of TOC concentrations using a k-nearest neighbour algorithm, with the five nearest neighbours in the continental shelves and the four nearest neighbours in the deep sea. Spurious patches are observed in the equatorial Pacific Ocean and in the Atlantic Ocean.
Global prediction map of TOC concentrations using a random forest algorithm with 100 estimators. Spurious patches are observed in the Atlantic Ocean and the Bay of Bengal.
TOC stock in different marine regions
Table breaks down how much TOC stock is found in different parts of the ocean. Each region is listed, showing how much TOC is there. Here we show a visualization of the different regions in Fig. .
In Fig. , we use a waffle chart to make it easier to see how the TOC is split among these regions. It is like dividing a pie into slices, but here we use squares. With a total of about 156 Pg of TOC worldwide, the South Pacific Ocean gets the biggest share, while the Baltic Sea gets the smallest.
TOC stocks in different oceans.
TOC stocks in different oceans: waffle chart.
DNN model run without separation of deep-sea and shelf environments
Here, we test a DNN model where the global ocean was not separated into shelf and deep-ocean regions but treated as one entity. The resulting TOC map shows spurious features in the Pacific Ocean, similar to those that occur in the map published by . These results underscore the importance of separating shelf and deep-ocean regions in order to achieve more accurate and realistic model outcomes.
TOC concentration map when the DNN model was not separated into shelf and deep-ocean regions. We see unrealistic TOC concentrations, especially in the Pacific Ocean.
Model interpretability using SHAP values
Explaining and understanding why a model makes a certain prediction is as crucial as accuracy and uncertainty in the predictions. This becomes particularly challenging in high-dimensional spaces, where interpreting complex models can be more intricate compared to simpler yet less accurate models. proposed SHAP as a unified framework for interpreting predictions. SHAP assigns importance values to each feature for a particular prediction, providing a comprehensive understanding of the model's decision-making process. In our supervised learning model f trained on features X∈X⊆Rd to predict outcomes Y∈Y⊆R, SHAP, a feature attribution method, considers the model predictions to be decomposed as a sum f(x)=ϕ0+∑j=1dϕ(j,x), where ϕ0 is the baseline expectation (i.e. ϕ0=E[f(x)]) and ϕ(j,x) denotes the Shapley value of feature j at point x.
In our analysis, we aim to simplify the interpretation process by presenting the average importance of features across all of the predictions, from the deep sea to the continental shelves. All of the effects describe the behaviour of the model and are not necessarily causal in the real world.
The summary plot in Figs. and combines the feature importance with feature effects. The summary plot displays Shapley values representing the impact of features on predictions. Each point represents a Shapley value for a feature and an instance. The y axis position indicates the feature, while the x axis position corresponds to the Shapley value. Feature values are represented by colours ranging from low (blue) to high (red). To visualize feature importance, points are spread along the y axis to reveal the distribution of Shapley values per feature. The features are ordered based on their importance, determined by the mean absolute Shapley values across all of the predictions. The Shapley value is expressed in the same units as the TOC concentration. This indicates the extent to which a specific feature value influences the TOC concentration and whether it drives it towards higher or lower values.
Summary plot of Shapley values of the deep-sea DNN model. The global porosity grid has the highest feature importance. Regions with high porosity lead to higher TOC concentrations and vice versa. In the mechanistic model of , porosity is positively correlated with the organic carbon flux through a specific depth. The biological features that include total biomass, meiofauna, fish biomass in the sea surface , oxygen concentration in bottom waters , and daily average PAR show that higher biomass or marine productivity leads to higher TOC concentrations, as expected. On the other hand, higher oxygen saturation leads to oxic conditions, resulting in the oxidation of the organic carbon and hence a lower TOC concentration. The other features which dominate are the physical oceanographic features, where higher feature values result in lower TOC concentrations, such as tidal features (Q1 loading) , sea bulk modulus , and seafloor pressure .
Summary plot of Shapley values of the continental shelf DNN model. The total oxygen uptake of the seabed has the highest feature importance, with regions of higher oxygen uptake resulting in lower TOC concentrations and denoting oxic conditions. Regions with higher porosity result in higher TOC concentrations, while regions with lower porosity result in lower TOC concentrations but with less impact. The lithology map is a binary map. Regions with fine sand, with grain sizes between 0.05 and 0.5 mm (1 mm being the higher feature value), have low TOC concentrations. Higher sediment thicknesses in Earth's crust lead to lower TOC concentrations because of dilution . The bottom current components, north–south and east–west, result in reduced TOC concentrations due to higher resuspension of sediments, the inhibition of sedimentation, and burial of organic carbon. Higher average seawater conductivity results in lower TOC concentrations. Higher particulate organic carbon (POC) in the water column has a positive impact on the TOC concentrations, as expected. It can be seen that the feature importance is not as clearly defined as in the deep ocean (as the high (red) and low (blue) feature values are mixed) because of the complex dynamics on continental shelves.
Algorithms
DNN training with batch normalization and dropout, including Monte Carlo dropout for inference.
Labelled dataset D={(x1,y1),(x2,y2),…,(xN,yN)}
xi: feature vector for the ith label
yi: corresponding TOC %
Input: feature vector xj
Output: predicted TOC % predicted% for xj
Method: construct a neural network with 10 layers and 128 nodes per layer: ϕ(x,W,b)
Apply batch normalization and dropout to each layer.
Initialize optimizer (e.g. Adam) with appropriate learning rate and parameters.
Initialize loss function (e.g. mean squared error) for regression.
Train the neural network with D for 1000 epochs:
forepoch=1to num_epochs do
Randomly shuffle the training dataset..
for(xi,yi) in Ddo
Forward pass: compute predictions yi^=ϕ(xi,W,b).
Compute target loss: losstarget=MSE(yi,yi^).
Back-propagation: update weights and biases using optimizer, with losstarget as the cost function.
endfor
endfor
Set dropout to active during inference
Perform Monte Carlo dropout for M forward runs:
y^jensemble=ϕ(xj,W,b,dropout_maskT)
Predicted TOC %, yj^ for xj=1M∑m=1My^jensemble
Calculating information gain for the predictions.
Monte Carlo dropout prediction ensemble, y^ensemble, for each grid cell
for each grid cell do
Fit a Gaussian probability density function Qj(y) for y^jensemble using histograms and curve fitting algorithm.
Generate original distribution Pj(y) with mean yj^ and standard deviation 0.05 (sampling error).
Calculate Kullback–Leibler divergence:
DKL(Pj‖Qj)=∑iPj(yi)logPj(yi)Qj(yi)
endfor
Code availability
The repository of the code to run the different models and analyse the outputs is available at https://github.com/paramnav/nn-toc and 10.5281/zenodo.12206145.
Data availability
The raw features and labels as well as the model outputs are available at 10.5281/zenodo.11186224.
Author contributions
NP: data curation, formal analysis, investigation, methodology, software, validation, visualization, writing – original draft preparation. EG: conceptualization, data curation, formal analysis, investigation, methodology, software, supervision, visualization, writing – original draft preparation. EBG: data curation, investigation, methodology, supervision, validation, writing – original draft preparation. MB: funding acquisition, project administration, supervision, validation, writing – original draft preparation. KW: conceptualization, funding acquisition, methodology, project administration, supervision, validation, writing – original draft preparation.
Competing interests
The contact author has declared that none of the authors has any competing interests.
Disclaimer
Publisher’s note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors.
Acknowledgements
The first author wishes to thank the Helmholtz School for Marine Data Science (MarDATA) for its direct financial support.
The authors would like to thank the reviewers and the editorial team, for their insightful reviews, which led to further improvement of the work.
AI tools were used to correct the manuscript and optimize the code. The authors are grateful for the high-performance computing sources at Kiel University.
Financial support
This work was partially funded by the Cluster of Excellence “The Ocean Floor – Earth’s Uncharted Interface” (EXC 2077) and the Deutsche Forschungsgemeinschaft (DFG) (project no. 390741603) hosted by the Research Faculty MARUM – Center for Marine Environmental Sciences, University of Bremen, Germany.The article processing charges for this open-access publication were covered by the GEOMAR Helmholtz Centre for Ocean Research Kiel.
Review statement
This paper was edited by Sandra Arndt and reviewed by Taylor Lee and Sarah Paradis.
ReferencesArndt, S., Jørgensen, B., LaRowe, D., Middelburg, J., Pancost, R., and Regnier, P.: Quantifying the degradation of organic matter in marine sediments: A review and synthesis, Earth-Sci. Rev., 123, 53–86, 10.1016/j.earscirev.2013.02.008, 2013.Atwood, T. B., Witt, A., Mayorga, J., Hammill, E., and Sala, E.: Global Patterns in Marine Sediment Carbon Stocks, Frontiers in Marine Science, 7, 165, 10.3389/fmars.2020.00165, 2020.Baturin, G. N.: Issue of the relationship between primary productivity of organic carbon in ocean and phosphate accumulation (Holocene-Late Jurassic), Lith. Miner. Resour., 42, 318–348, 10.1134/S0024490207040025, 2007.Beazley, M. J.: The significance of organic carbon and sediment surface area to the benthic biogeochemistry of the slope and deep water environments of the northern Gulf of Mexico, Master's thesis, Texas A&M University, http://hdl.handle.net/1969.1/534 (last access: 3 February 2024), 2003.Becker, J. J., Wood, W. T., and Martin, K. M.: Global Crustal Heat Flow Using Random Decision Forest Prediction, in: AGU Fall Meeting Abstracts, vol. 2014, NG31A–3788, https://ui.adsabs.harvard.edu/abs/2014AGUFMNG31A3788B/abstract (last access: 3 February 2024), 2014.Berner, R. A.: Burial of organic carbon and pyrite sulfur in the modern ocean: its geochemical and environmental significance, Am. J. Sci., 282, 451–473, 10.2475/ajs.282.4.451, 1982.Berner, R. A.: Processes of the Long-Term Carbon Cycle: Organic Matter and Carbonate Burial and Weathering, in: The Phanerozoic Carbon Cycle: CO2 and O2, Oxford University Press, ISBN 9780195173338, 10.1093/oso/9780195173338.003.0005, 2004.Boudreau, B. P.: Diagenetic models and their implementation, vol. 505, Springer Berlin, ISBN 978-3-642-64399-6, 10.1007/978-3-642-60421-8, 1997.Boyer, T. P., Antonov, J. I., Baranova, O. K., Coleman, C., Garcia, H. E., and Grodsky, A.: World Ocean Database 2013, NOAA Atlas NESDIS 72, Technical Ed. Silver Spring, MD, 10.7289/V5NZ85MT, 2013.Bradley, J. A., Hülse, D., LaRowe, D. E., and Arndt, S.: Transfer efficiency of organic carbon in marine sediments, Nat. Commun., 13, 7297, 10.1038/s41467-022-35112-9, 2022.Burdige, D. J.: Burial of terrestrial organic matter in marine sediments: A re-assessment, Global Biogeochem. Cy., 19, GB4011, 10.1029/2004GB002368, 2005.Burdige, D. J.: Preservation of Organic Matter in Marine Sediments – Controls, Mechanisms, and an Imbalance in Sediment Organic Carbon Budgets?, Chem. Rev., 107, 467–485, 10.1021/cr050347q, 2007.Crameri, F.: Scientific colour maps, Zenodo [data set], 10.5281/zenodo.8409685, 2023. De Veaux, R. D. and Ungar, L. H.: Multicollinearity: A tale of two nonparametric regressions, in: Selecting Models from Data, edited by: Cheeseman, P. and Oldford, R. W., Springer New York, New York, NY, 393–402, ISBN 978-1-4612-2660-4, 1994.Diesing, M., Thorsnes, T., and Bjarnadóttir, L. R.: Organic carbon densities and accumulation rates in surface sediments of the North Sea and Skagerrak, Biogeosciences, 18, 2139–2160, 10.5194/bg-18-2139-2021, 2021.Emerson, S. and Hedges, J. I.: Processes controlling the organic carbon content of open ocean sediments, Paleoceanography, 3, 621–634, 10.1029/PA003i005p00621, 1988. Emery, K. O.: Relict sediments on continental shelves of the world, Am. Assoc. Petr. Geol. B., 52, 445–464, 1968.Flanders Marine Institute: Global Oceans and Seas, version 1, 10.14284/542, https://www.marineregions.org/ (last access: 25 August 2023), 2021.Gal, Y. and Ghahramani, Z.: Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning, in: Proceedings of The 33rd International Conference on Machine Learning, New York, New York, USA, edited by: Balcan, M. F. and Weinberger, K. Q., Proceedings of Machine Learning Research, vol. 48, PMLR, 19 June 2016, 1050–1059, https://proceedings.mlr.press/v48/gal16.html (last access: 24 February 2022), 2016. Garlan, T., Gabelotaud, I., Lucas, S., and Marchès, E.: A World Map of Seabed Sediment Based on 50 Years of Knowledge, World Academy of Science, Engineering and Technology, International Journal of Geological and Environmental Engineering, 12, 409–419, 2018.Goyet, C., Healy, R., and Ryan, J.: Global Distribution of Total Inorganic Carbon and Total Alkalinity Below the Deepest Winter Mixed Layer Depths, ORNIJCDIAC-127 NDP-076, 10.3334/zCDIAC/otg.ndp076, 2000.Hall, S. J.: The continental shelf benthic ecosystem: current status, agents for change and future prospects, Environ. Conserv., 29, 350–374, http://www.jstor.org/stable/44520615 (last access: 26 June 2022), 2002.Hart-Davis, M. G., Piccioni, G., Dettmering, D., Schwatke, C., Passaro, M., and Seitz, F.: EOT20: a global ocean tide model from multi-mission satellite altimetry, Earth Syst. Sci. Data, 13, 3869–3884, 10.5194/essd-13-3869-2021, 2021. He, K., Zhang, X., Ren, S., and Sun, J.: Delving deep into rectifiers: Surpassing human-level performance on imagenet classification, in: Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile, 1026–1034, 7–13 December 2015.Hedges, J. I. and Keil, R. G.: Sedimentary organic matter preservation: an assessment and speculative synthesis, Mar. Chem., 49, 81–115, 10.1016/0304-4203(95)00008-F, 1995. Joint Panel on Oceanographic Tables and Standards: Processing of Oceanographic Station Data, UNESCO, Paris, ISBN 978-92-3-102756-7, 1991.Jørgensen, B. B., Wenzhöfer, F., Egger, M., and Glud, R. N.: Sediment oxygen consumption: Role in the global marine carbon cycle, Earth-Sci. Rev., 228, 103987, 10.1016/j.earscirev.2022.103987, 2022.Kim, S. S. and Wessel, P.: New global seamount census from the altimetry-derived gravity data, Geophys. J. Int., 186, 615–631, 10.1111/j.1365-246X.2011.05076.x, 2011.Kullback, S. and Leibler, R. A.: On Information and Sufficiency, Ann. Math. Stat., 22, 79–86, http://www.jstor.org/stable/2236703 (last access: 19 April 2023), 1951.LaRowe, D., Arndt, S., Bradley, J., Estes, E., Hoarfrost, A., Lang, S., Lloyd, K., Mahmoudi, N., Orsi, W., Shah Walter, S., Steen, A., and Zhao, R.: The fate of organic carbon in marine sediments – New insights from recent data and analysis, Earth-Sci. Rev., 204, 103146, 10.1016/j.earscirev.2020.103146, 2020a.LaRowe, D. E., Arndt, S., Bradley, J. A., Burwicz, E., Dale, A. W., and Amend, J. P.: Organic carbon and microbial activity in marine sediments on a global scale throughout the Quaternary, Geochim. Cosmochim. Ac., 286, 227–247, 10.1016/j.gca.2020.07.017, 2020b.LeCun, Y., Bengio, Y., and Hinton, G.: Deep learning, Nature, 521, 436–444, 10.1038/nature14539, 2015.Lee, T. R., Wood, W. T., and Phrampus, B. J.: A Machine Learning (kNN) Approach to Predicting Global Seafloor Total Organic Carbon, Global Biogeochem. Cy., 33, 37–46, 10.1029/2018GB005992, 2019.Lee, T. R., Wood, W. T., Skarke, A., Phrampus, B. J., and Obelcz, J.: Data files associated with the k-nearest neighbor global prediction of isopachs for present to middle Miocene, Zenodo [data set], 10.5281/zenodo.3675364, 2020.Legge, O., Johnson, M., Hicks, N., Jickells, T., Diesing, M., Aldridge, J., Andrews, J., Artioli, Y., Bakker, D. C. E., Burrows, M. T., Carr, N., Cripps, G., Felgate, S. L., Fernand, L., Greenwood, N., Hartman, S., Kröger, S., Lessin, G., Mahaffey, C., Mayor, D. J., Parker, R., Queirós, A. M., Shutler, J. D., Silva, T., Stahl, H., Tinker, J., Underwood, G. J. C., Van Der Molen, J., Wakelin, S., Weston, K., and Williamson, P.: Carbon on the Northwest European Shelf: Contemporary Budget and Future Influences, Frontiers in Marine Science, 7, 143, 10.3389/fmars.2020.00143, 2020.Lucas, M. and Giles, H.: Quantifying Uncertainty in Random Forests via Confidence Intervals and Hypothesis Tests, J. Mach. Learn. Res., 17, 1–41, http://jmlr.org/papers/v17/14-168.html (last access: 4 August 2023), 2016.Ludwig, W., Amiotte-Suchet, P., and Probst, J. L.: ISLSCP II Global River Fluxes of Carbon and Sediments to the Oceans, ORNL Distributed Active Archive Center [data set], 10.3334/ORNLDAAC/1028, 2011. Lundberg, S. M. and Lee, S.-I.: A unified approach to interpreting model predictions, in: Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS'17, Curran Associates Inc., Red Hook, NY, USA, 4–9 December 2017, 4768–4777, ISBN 9781510860964, 2017.Martin, K. M., Wood, W. T., and Becker, J. J.: A global prediction of seafloor sediment porosity using machine learning, Geophys. Res. Lett., 42, 10640–10646, 10.1002/2015GL065279, 2015.NASA: Announcement of Aquarius Level 2 Data Availability, Physical Oceanography Distributed Active Archive Center (PODAAC), https://aquarius.oceansciences.org/cgi/gal_density.htm (last access: 23 October 2023), 2011.NASA: MODIS-Aqua Ocean Color Data, Goddard Space Flight Center, Ocean Ecology Laboratory, Ocean Biology Processing Group, 10.5067/AQUA/MODIS_OC.2014.0, 2014.National Geophysical Data Center: The NGDC Seafloor Sediment Grain Size Database, first Version, NOAA National Centers for Environmental Information, 10.7289/V5G44N6W, 1976.National Geophysical Data Center: 2-minute Gridded Global Relief Data (ETOPO2) v2, NCEI [data set], 10.7289/V5J1012Q, 2006.Pape, T., Bünz, S., Hong, W.-L., Torres, M. E., Riedel, M., Panieri, G., Lepland, A., Hsu, C.-W., Wintersteller, P., Wallmann, K., Schmidt, C., Yao, H., and Bohrmann, G.: Origin and Transformation of Light Hydrocarbons Ascending at an Active Pockmark on Vestnesa Ridge, Arctic Ocean, J. Geophys. Res.-Sol. Ea., 125, e2018JB016679, 10.1029/2018JB016679, 2020.Paradis, S., Nakajima, K., Van der Voort, T. S., Gies, H., Wildberger, A., Blattmann, T. M., Bröder, L., and Eglinton, T. I.: The Modern Ocean Sediment Archive and Inventory of Carbon (MOSAIC): version 2.0, Earth Syst. Sci. Data, 15, 4105–4125, 10.5194/essd-15-4105-2023, 2023.Parameswaran, N., González, E., Burwicz-Galerne, E., Braack, M., and Wallmann, K.: Code for Global Prediction Of Total Organic Carbon In Marine Sediments Using Deep Neural Networks (nn-toc), GitHub [code], https://github.com/paramnav/nn-toc (last access: 13 November 2024), 2024a.Parameswaran, N., González, E., Burwicz-Galerne, E., Braack, M., and Wallmann, K.: Dataset for the Global Prediction Of Total Organic Carbon In Marine Sediments Using Deep Neural Networks (nn-toc), Zenodo [data set], 10.5281/zenodo.11186224, 2024b.Pavlis, N. K., Holmes, S. A., Kenyon, S. C., and Factor, J. K.: The EGM2008 Global Gravitational Model, abstract 2008AGUFM.G22A..01P, 2008 General Assembly of the European Geosciences Union, Vienna, Austria, https://ui.adsabs.harvard.edu/abs/2008AGUFM.G22A..01P (last access: 7 October 2014), 2008.Phrampus, B. J., Lee, T. R., and Wood, W. T.: Predictor Grids for “A Global Probabilistic Prediction of Cold Seeps and Associated Seafloor Fluid Expulsion Anomalies (SEAFLEAs)”, Zenodo [data set], 10.5281/zenodo.3459805, 2019. Rényi, A.: On measures of entropy and information, in: Proceedings of the fourth Berkeley symposium on mathematical statistics and probability, volume 1: contributions to the theory of statistics, Fourth Berkley Symposum on Mathematical Statistics and Probablity June 20-July 30, 1960, Statistical Laboratory of the University of California vol. 4, University of California Press, 547–562, 1961.Restreppo, G. A., Wood, W. T., and Phrampus, B. J.: Oceanic sediment accumulation rates predicted via machine learning algorithm: towards sediment characterization on a global scale, Geo-Mar. Lett., 40, 755–763, 10.1007/s00367-020-00669-1, 2020.Restreppo, G. A., Wood, W. T., and Phrampus, B. J.: A machine-learning derived model of seafloor sediment accumulation, Mar. Geol., 440, 106577, 10.1016/j.margeo.2021.106577, 2021.Romankevich, E., Vetrov, A., and Peresypkin, V.: Organic matter of the World Ocean, Russ. Geol. Geophys., 50, 299–307, 10.1016/j.rgg.2009.03.013, 2009.Sala, E., Mayorga, J., Bradley, D., Cabral, R. B., Atwood, T. B., Auber, A., Cheung, W., Costello, C., Ferretti, F., Friedl, er, A. M., Gaines, S. D., Garilao, C., Goodell, W., Halpern, B. S., Hinson, A., Kaschner, K., Kesner-Reyes, K., Leprieur, F., McGowan, J., Morgan, L. E., Mouillot, D., Palacios-Abrantes, J., Possingham, H. P., Rechberger, K. D., Worm, B., and Lubchenco, J.: Protecting the global ocean for biodiversity, food and climate, Nature, 592, 397–402, 10.1038/s41586-021-03371-z, 2021.Seiter, K., Hensen, C., Schröter, J., and Zabel, M.: Organic carbon content in surface sediments – defining regional provinces, Deep-Sea Res. Pt. I, 51, 2001–2026, 10.1016/j.dsr.2004.06.014, 2004.Shannon, C. E.: A mathematical theory of communication, The Bell System Technical Journal, 27, 379–423, 10.1002/j.1538-7305.1948.tb01338.x, 1948.Song, S., Santos, I. R., Yu, H., Wang, F., Burnett, W. C., Bianchi, T. S., Dong, J., Lian, E., Zhao, B., Mayer, L., Yao, Q., Yu, Z., and Xu, B.: A global assessment of the mixed layer in coastal sediments and implications for carbon storage, Nat. Commun., 13, 4903, 10.1038/s41467-022-32650-0, 2022.Song, T., Pang, C., Hou, B., Xu, G., Xue, J., Sun, H., and Meng, F.: A review of artificial intelligence in marine science, Front. Earth Sci., 11, 10.3389/feart.2023.1090185, 2023.The HYCOM+NCODA Ocean Reanalysis: 1/12 deg global HYCOM+NCODA Ocean Reanalysis, funded by: U.S. Navy and the Modeling and Simulation Coordination Office, https://www.hycom.org/data/glbu0pt08/expt-19pt1 (last access: 19 March 2014), 2014. Thyng, K. M., Greene, C. A., Hetland, R. D., Zimmerle, H. M., and DiMarco, S. F.: True Colors of Oceanography, Oceanography, 29, 9–13, 10.5670/oceanog.2016.66, 2016.van der Voort, T. S., Blattmann, T. M., Usman, M., Montluçon, D., Loeffler, T., Tavagna, M. L., Gruber, N., and Eglinton, T. I.: MOSAIC (Modern Ocean Sediment Archive and Inventory of Carbon): a (radio)carbon-centric database for seafloor surficial sediments, Earth Syst. Sci. Data, 13, 2135–2146, 10.5194/essd-13-2135-2021, 2021.Wei, C.-L., Rowe, G. T., Escobar-Briones, E., Boetius, A., Soltwedel, T., and Caley, M. J.: Global patterns and predictions of seafloor biomass using random forests, PLoS ONE, 5, e15323, 10.1371/journal.pone.0015323, 2010.Whittaker, J., Goncharov, A., Williams, S., Müller, R. D., and Leitchenkov, G.: Global sediment thickness dataset updated for the Australian-Antarctic Southern Ocean, Geochem. Geophy. Geosy., 14, 3297–3305, 10.1002/ggge.20181, 2013.