<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing with OASIS Tables v3.0 20080202//EN" "journalpub-oasis3.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:oasis="http://docs.oasis-open.org/ns/oasis-exchange/table" xml:lang="en" dtd-version="3.0">
  <front>
    <journal-meta><journal-id journal-id-type="publisher">GMD</journal-id><journal-title-group>
    <journal-title>Geoscientific Model Development</journal-title>
    <abbrev-journal-title abbrev-type="publisher">GMD</abbrev-journal-title><abbrev-journal-title abbrev-type="nlm-ta">Geosci. Model Dev.</abbrev-journal-title>
  </journal-title-group><issn pub-type="epub">1991-9603</issn><publisher>
    <publisher-name>Copernicus Publications</publisher-name>
    <publisher-loc>Göttingen, Germany</publisher-loc>
  </publisher></journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.5194/gmd-11-3313-2018</article-id><title-group><article-title>Baseline evaluation of the impact of updates to the MIT Earth System Model on its model parameter estimates</article-title><alt-title>MESM baseline evaluation</alt-title>
      </title-group><?xmltex \runningtitle{MESM baseline evaluation}?><?xmltex \runningauthor{A. G. Libardoni et
al.}?>
      <contrib-group>
        <contrib contrib-type="author" corresp="no" rid="aff1">
          <name><surname>Libardoni</surname><given-names>Alex G.</given-names></name>
          
        </contrib>
        <contrib contrib-type="author" corresp="yes" rid="aff1 aff2">
          <name><surname>Forest</surname><given-names>Chris E.</given-names></name>
          <email>ceforest@psu.edu</email>
        <ext-link>https://orcid.org/0000-0002-2643-0186</ext-link></contrib>
        <contrib contrib-type="author" corresp="no" rid="aff3">
          <name><surname>Sokolov</surname><given-names>Andrei P.</given-names></name>
          
        </contrib>
        <contrib contrib-type="author" corresp="no" rid="aff3">
          <name><surname>Monier</surname><given-names>Erwan</given-names></name>
          
        <ext-link>https://orcid.org/0000-0001-5533-6570</ext-link></contrib>
        <aff id="aff1"><label>1</label><institution>Department of Meteorology, Pennsylvania State University, University Park, PA, USA</institution>
        </aff>
        <aff id="aff2"><label>2</label><institution>Earth and Environmental Systems Institute, Pennsylvania State University, University Park, PA, USA</institution>
        </aff>
        <aff id="aff3"><label>3</label><institution>Joint Program on the Science and Policy of Global Change, Massachusetts Institute of Technology, Cambridge, MA, USA</institution>
        </aff>
      </contrib-group>
      <author-notes><corresp id="corr1">Chris E. Forest (ceforest@psu.edu)</corresp></author-notes><pub-date><day>21</day><month>August</month><year>2018</year></pub-date>
      
      <volume>11</volume>
      <issue>8</issue>
      <fpage>3313</fpage><lpage>3325</lpage>
      <history>
        <date date-type="received"><day>23</day><month>February</month><year>2018</year></date>
           <date date-type="rev-request"><day>29</day><month>March</month><year>2018</year></date>
           <date date-type="rev-recd"><day>26</day><month>July</month><year>2018</year></date>
           <date date-type="accepted"><day>1</day><month>August</month><year>2018</year></date>
      </history>
      <permissions>
        
        
      <license license-type="open-access"><license-p>This work is licensed under the Creative Commons Attribution 4.0 International License. To view a copy of this licence, visit <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">https://creativecommons.org/licenses/by/4.0/</ext-link></license-p></license></permissions><self-uri xlink:href="https://gmd.copernicus.org/articles/11/3313/2018/gmd-11-3313-2018.html">This article is available from https://gmd.copernicus.org/articles/11/3313/2018/gmd-11-3313-2018.html</self-uri><self-uri xlink:href="https://gmd.copernicus.org/articles/11/3313/2018/gmd-11-3313-2018.pdf">The full text article is available as a PDF file from https://gmd.copernicus.org/articles/11/3313/2018/gmd-11-3313-2018.pdf</self-uri>
      <abstract>
    <p id="d1e121">For over 20 years, the Massachusetts Institute of Technology Earth System
Model (MESM) has been used extensively for climate change research. The model
is under continuous development with components being added and updated. To
provide transparency in the model development, we perform a baseline
evaluation by comparing model behavior and properties in the newest version
to the previous model version. In particular, changes resulting from updates
to the land surface model component and the input forcings used in historical
simulations of climate change are investigated. We run an 1800-member
ensemble of MESM historical climate simulations where the model parameters
that set climate sensitivity, the rate of ocean heat uptake, and the net
anthropogenic aerosol forcing are systematically varied. By comparing model
output to observed patterns of surface temperature changes and the linear
trend in the increase in ocean heat content, we derive probability
distributions for the three model parameters. Furthermore, we run a
372-member ensemble of transient climate simulations where all model forcings
are fixed and carbon dioxide concentrations are increased at the rate of
1 % year<inline-formula><mml:math id="M1" display="inline"><mml:msup><mml:mi/><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula>. From these runs, we derive response surfaces for
transient climate response and thermosteric sea level rise as a function of
climate sensitivity and ocean heat uptake. We show that the probability
distributions shift towards higher climate sensitivities and weaker aerosol
forcing when using the new model and that the climate response surfaces are
relatively unchanged between model versions. Because the response surfaces
are independent of the changes to the model forcings and similar between
model versions with different land surface models, we suggest that the change
in land surface model has limited impact on the temperature evolution in the
model. Thus, we attribute the shifts in parameter estimates to the updated
model forcings.</p>
  </abstract>
    </article-meta>
  </front>
<body>
      

<sec id="Ch1.S1" sec-type="intro">
  <title>Introduction</title>
      <p id="d1e143">Equilibrium climate sensitivity (ECS), the equilibrium global mean surface
temperature change due to a doubling of atmospheric carbon dioxide
concentrations, is a climate system property that has been widely studied and
strongly influences future climate projections. One of the complexities of
ECS is that it is a function of many feedbacks and processes that act on
different spatial and temporal scales. In particular, the lapse rate, water
vapor, cryosphere, and cloud feedbacks play especially critical roles in
determining the climate sensitivity <xref ref-type="bibr" rid="bib1.bibx3" id="paren.1"/>. Given its influence on
future climate change, many studies using a range of methods have attempted
to estimate ECS.</p>
      <p id="d1e149">One class of studies estimates ECS directly from observations using a global
energy budget approach <xref ref-type="bibr" rid="bib1.bibx11 bib1.bibx33 bib1.bibx24 bib1.bibx28" id="paren.2"/>. These
studies calculate probability distributions of ECS from estimates of global
mean surface temperature change, the heat stored in the ocean, and changes in
radiative forcing, along with the associated uncertainties in their
measurements. A second class of studies uses simplified climate models such as
Earth system models of intermediate complexity (EMICs) or energy balance
models
<xref ref-type="bibr" rid="bib1.bibx8 bib1.bibx10 bib1.bibx19 bib1.bibx26 bib1.bibx32 bib1.bibx16" id="paren.3"><named-content content-type="pre">e.g.,</named-content></xref>.
Taking advantage of the computational efficiency of the simplified<?pagebreak page3314?> models,
these studies run large ensembles over a range of climate sensitivity values
in addition to adjusting other relevant factors, such as the rate of ocean
heat uptake and a measure of the net aerosol forcing. By comparing model runs
to observations and evaluating how well individual model runs match the past,
estimates of ECS and other parameters are given as probability distributions.</p>
      <p id="d1e160">Transient climate response (TCR) provides a second metric for estimating
future climate change and is defined as the global mean surface temperature
change at the time of carbon dioxide (<inline-formula><mml:math id="M2" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">CO</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msub></mml:mrow></mml:math></inline-formula>) doubling in response to
<inline-formula><mml:math id="M3" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">CO</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msub></mml:mrow></mml:math></inline-formula> concentrations increasing at the rate of 1 % year<inline-formula><mml:math id="M4" display="inline"><mml:msup><mml:mi/><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula>.
<inline-formula><mml:math id="M5" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">CO</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msub></mml:mrow></mml:math></inline-formula> doubling occurs in year 70 of this scenario, making TCR a
shorter-term assessment of climate change than ECS. Unlike ECS, which
requires reaching an equilibrium state, TCR is estimated while the climate
system is still adjusting to a time-dependent forcing. There is a constant
evolution in the strength and activity of processes and feedbacks in both the
atmosphere and the ocean as the climate system adjusts to reach equilibrium.
Due to the long timescales required to reach equilibrium, <xref ref-type="bibr" rid="bib1.bibx1" id="text.4"/>
argue that we should focus on estimating TCR, which is more policy-relevant
than ECS. Estimates of TCR can be made from current historical observations
and are more meaningful on the decadal timescale, whereas even if the
equilibrium response is known, it may never be reached. However, even if more
focus is placed on TCR than ECS, the two are closely linked. When considering
atmosphere–ocean interactions, TCR has been shown to depend on both climate
sensitivity and the rate at which heat is mixed into the deep ocean
<xref ref-type="bibr" rid="bib1.bibx42 bib1.bibx2" id="paren.5"/>.</p>
      <p id="d1e215">One EMIC that has been extensively used in studies estimating ECS and TCR is
the climate component of the Massachusetts Institute of Technology (MIT)
Integrated Global Systems Model <xref ref-type="bibr" rid="bib1.bibx37" id="paren.6"><named-content content-type="pre">IGSM;</named-content></xref>.
<xref ref-type="bibr" rid="bib1.bibx8 bib1.bibx9 bib1.bibx10" id="text.7"/> and <xref ref-type="bibr" rid="bib1.bibx25 bib1.bibx26" id="text.8"/>
estimated the joint probability distribution for climate sensitivity and
other model parameters in IGSM. Each study used similar, but not identical,
versions of IGSM with changes both to key components of the model and to the
input data used to force the model. Climate change diagnostics were also
modified in the studies. The Earth system component of IGSM has undergone
further development and a new, updated version was incorporated into the
integrated framework. This study serves as a baseline evaluation of how
probability distributions for the model parameters change as a result of
updating the Earth system component. More specifically, we investigate the
impact of (1) the structural changes to the model, (2) the historical
datasets used to force the model, and (3) the sampling strategy used to vary
the model parameters.</p>
      <p id="d1e230">In the past, “IGSM” has been used to reference both the fully integrated
model as well as the standalone Earth system component. We follow this
convention and refer to the older version of the Earth system model as IGSM,
and we refer to the updated version of the model as the MIT Earth System
Model (MESM). In this study, we provide a transparent method of testing and
accounting for how the simulated behavior and probability distribution
functions change in response to the recent model development. We derive a new
joint probability distribution by closely following the methods of
<xref ref-type="bibr" rid="bib1.bibx25" id="text.9"/> to show the impact that the new version of the model has
on the parameter estimates and find that the new version of the model leads
to higher climate sensitivity estimates in addition to shifts in the
distributions of the other model parameters. The effects on the parameter
distributions due to changing observations and temperature metrics will be
addressed in future studies in order to separate their impacts from changes
due to the model update alone. We also show here how the emergent behavior of
MESM compares to the older IGSM by running a new set of transient simulations
and calculating how the response surfaces for TCR and thermosteric sea level
rise depend on ECS and the rate of ocean heat uptake.</p>
      <p id="d1e236">In Sect. <xref ref-type="sec" rid="Ch1.S2"/>, we give a brief description of the MIT modeling
framework and the differences between IGSM and MESM. We describe the process
for deriving the joint probability distribution function used in
<xref ref-type="bibr" rid="bib1.bibx25" id="text.10"/> and the modifications implemented in this study in
Sect. <xref ref-type="sec" rid="Ch1.S3"/>. Parameter distributions and response surfaces are
presented in Sect. <xref ref-type="sec" rid="Ch1.S4"/>. In particular, we test whether changes
in the distributions and responses are due to reducing the number of model
diagnostics, the sampling of the parameter space, or changes in the model
structure and input forcings. We present our conclusions in
Sect. <xref ref-type="sec" rid="Ch1.S5"/>.</p>
</sec>
<sec id="Ch1.S2">
  <title>Model</title>
      <p id="d1e256">The climate component of the updated MIT Earth System Model
<xref ref-type="bibr" rid="bib1.bibx38" id="paren.11"/> replaces the version described in <xref ref-type="bibr" rid="bib1.bibx37" id="text.12"/> and
is an Earth system model of intermediate complexity. It consists of a
zonally averaged atmosphere, zonally averaged land model, and a mixed-layer
anomaly diffusing ocean model. The mixed-layer ocean model includes specified
vertically integrated horizontal heat transport by the deep ocean, a
so-called “<inline-formula><mml:math id="M6" display="inline"><mml:mi>Q</mml:mi></mml:math></inline-formula> flux”. This flux has been calculated from a simulation in
which sea surface temperatures and the sea-ice distribution were relaxed
toward their present-day climatology. Heat mixing into the deep ocean is
parameterized by the diffusion of the difference of the temperature at the
bottom of the seasonal thermocline from its value in a pre-industrial climate
simulation <xref ref-type="bibr" rid="bib1.bibx12 bib1.bibx41" id="paren.13"/>. Since this diffusion represents the
cumulative effect of heat mixing by all physical processes, the values of the
diffusion coefficients are significantly larger than those used in the
subgrid-scale diffusion parameterizations in ocean global circulation
models. The spatial distribution of the diffusion coefficients used<?pagebreak page3315?> in the
diffusive model is based on observations of tritium mixing into the deep
ocean <xref ref-type="bibr" rid="bib1.bibx13" id="paren.14"/>.</p>
      <p id="d1e278">The radiation code takes into account major greenhouse gases (<inline-formula><mml:math id="M7" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">H</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msub><mml:mi mathvariant="normal">O</mml:mi></mml:mrow></mml:math></inline-formula>,
<inline-formula><mml:math id="M8" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">CO</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msub></mml:mrow></mml:math></inline-formula>, <inline-formula><mml:math id="M9" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">CH</mml:mi><mml:mn mathvariant="normal">4</mml:mn></mml:msub></mml:mrow></mml:math></inline-formula>, <inline-formula><mml:math id="M10" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">N</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msub><mml:mi mathvariant="normal">O</mml:mi></mml:mrow></mml:math></inline-formula>, chlorofluorocarbons (CFCs), and
<inline-formula><mml:math id="M11" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">O</mml:mi><mml:mn mathvariant="normal">3</mml:mn></mml:msub></mml:mrow></mml:math></inline-formula>) and multiple types of aerosols (e.g., <inline-formula><mml:math id="M12" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">SO</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msub></mml:mrow></mml:math></inline-formula>, black and
organic carbon). In historical climate simulations, non-sulfate aerosol
loadings are kept at their default values while the sulfate aerosol forcing
is parameterized through changes in surface albedo using historical data on
<inline-formula><mml:math id="M13" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">SO</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msub></mml:mrow></mml:math></inline-formula> emissions. Historical climate simulations are initialized from
conditions obtained from a long equilibrium simulation for 1860 conditions.</p>
      <p id="d1e363">Three model parameters that impact the climate system response are easily
modified in MESM. These parameters are the equilibrium climate sensitivity
(ECS), the effective ocean diffusivity (<inline-formula><mml:math id="M14" display="inline"><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>), and the net aerosol scaling
factor (<inline-formula><mml:math id="M15" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula>). ECS is changed by adjusting the strength of the
cloud feedback at different levels in the model <xref ref-type="bibr" rid="bib1.bibx39 bib1.bibx40" id="paren.15"/>.
The adjustment required for a specific ECS is obtained from a lookup table
derived from model simulations with different feedback strengths where
<inline-formula><mml:math id="M16" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">CO</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msub></mml:mrow></mml:math></inline-formula> concentrations have been doubled and the climate system allowed
to reach equilibrium. <inline-formula><mml:math id="M17" display="inline"><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> represents the global mean ocean diffusion
coefficient in the mixed-layer ocean model. The global mean diffusivity is
adjusted by scaling the spatial diffusivity pattern by the same factor at all
locations. A lower global mean diffusivity implies slower mixing of heat into
the deep ocean and a higher global mean diffusivity implies faster mixing.
The albedo adjustment used for the sulfate aerosol forcing is prescribed by a
latitude-dependent pattern that differs over land and ocean
<xref ref-type="bibr" rid="bib1.bibx7" id="paren.16"/>. This pattern is held fixed spatially but scaled temporally
by estimated emissions of sulfur dioxide. <inline-formula><mml:math id="M18" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula> sets the amplitude
of the pattern in the 1980s. By choosing a set of the three parameters,
<inline-formula><mml:math id="M19" display="inline"><mml:mrow><mml:mi mathvariant="italic">θ</mml:mi><mml:mo>=</mml:mo><mml:mo>(</mml:mo><mml:mtext>ECS</mml:mtext><mml:mo>,</mml:mo><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula>, we simulate different climate
states.</p>
      <p id="d1e458">We now highlight two major updates made between the current version of MESM
and its predecessor. The first update was the incorporation of a new land
surface model. The Community Land Model (CLM) version 3.5 <xref ref-type="bibr" rid="bib1.bibx31" id="paren.17"/>
replaced CLM version 2.1 to improve estimates of the surface heat balance in
the model. A second update to the model was an adjustment to the radiative
forcing of non-<inline-formula><mml:math id="M20" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">CO</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msub></mml:mrow></mml:math></inline-formula> greenhouse gases in the radiation code. The
adjustment was made to match the calculations used in the Intergovernmental
Panel on Climate Change (IPCC) experiments and produces weaker forcing for
those constituents. Additionally, the forcings used to drive the model
<xref ref-type="bibr" rid="bib1.bibx9" id="paren.18"/> were extended and, in some cases, new data sources were
used. Greenhouse gas concentrations and stratospheric aerosols from volcanic
eruptions were obtained from the National Aeronautics and Space
Administration Goddard Institute for Space Studies modeling group forcing
suite. The procedure for updating the greenhouse gas emissions from
<xref ref-type="bibr" rid="bib1.bibx14" id="text.19"/> and the volcanic aerosol forcing from <xref ref-type="bibr" rid="bib1.bibx34" id="text.20"/> was
described in <xref ref-type="bibr" rid="bib1.bibx30" id="text.21"/>. Updates included incorporating data from more
observational sources and extending the length of the datasets. Sulfate
aerosol loading from <xref ref-type="bibr" rid="bib1.bibx35" id="text.22"/> was extended to 2011 by
<xref ref-type="bibr" rid="bib1.bibx18" id="text.23"/>. The <xref ref-type="bibr" rid="bib1.bibx20" id="text.24"/> solar irradiance dataset replaced the
<xref ref-type="bibr" rid="bib1.bibx21" id="text.25"/> dataset. Lastly, the ozone concentration database developed by
the Atmospheric Chemistry and Climate initiative (AC&amp;C) and Stratospheric
Processes and their Role in Climate project (SPARC) ozone concentration
database <xref ref-type="bibr" rid="bib1.bibx5" id="paren.26"/> that was developed in support of the Coupled Model
Intercomparison Project phase 5 (CMIP5) replaced the concentration data used
in <xref ref-type="bibr" rid="bib1.bibx9" id="text.27"/>. The concentrations in the dataset, hereafter referred
to as AC&amp;C/SPARC, drive the tropospheric and stratospheric ozone forcing in
the radiation code. In Sect. <xref ref-type="sec" rid="Ch1.S4"/>, we show the differences
between the old and new datasets for those forcings where the data sources
have changed, namely solar and ozone.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F1" specific-use="star"><caption><p id="d1e512">Parameter pairings where the models have been run. Points in black
are common to both the IGSM and MESM ensembles. Blue points are unique to the
IGSM ensemble and red points are unique to the MESM ensemble.</p></caption>
        <?xmltex \igopts{width=341.433071pt}?><graphic xlink:href="https://gmd.copernicus.org/articles/11/3313/2018/gmd-11-3313-2018-f01.pdf"/>

      </fig>

</sec>
<sec id="Ch1.S3">
  <title>Methods</title>
      <p id="d1e527">In this section, we present an outline of the methodology used to derive the
joint probability distribution function (PDF) for the model parameters and
highlight the changes implemented between this study and previous studies
using IGSM. We follow closely the methods of <xref ref-type="bibr" rid="bib1.bibx25" id="text.28"/>, which we
briefly summarize here. To derive the PDFs, we compare output from each model
simulation to time series of observed climate change. A given model run is
evaluated through the use of a goodness-of-fit statistic:
          <disp-formula id="Ch1.E1" content-type="numbered"><mml:math id="M21" display="block"><mml:mrow><mml:msup><mml:mi>r</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msup><mml:mo>=</mml:mo><mml:mo>(</mml:mo><mml:mi mathvariant="bold-italic">x</mml:mi><mml:mo>(</mml:mo><mml:mi mathvariant="italic">θ</mml:mi><mml:mo>)</mml:mo><mml:mo>-</mml:mo><mml:mi mathvariant="bold-italic">y</mml:mi><mml:msup><mml:mo>)</mml:mo><mml:mi>T</mml:mi></mml:msup><mml:msubsup><mml:mi mathvariant="bold">C</mml:mi><mml:mtext>N</mml:mtext><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:msubsup><mml:mo>(</mml:mo><mml:mi mathvariant="bold-italic">x</mml:mi><mml:mo>(</mml:mo><mml:mi mathvariant="italic">θ</mml:mi><mml:mo>)</mml:mo><mml:mo>-</mml:mo><mml:mi mathvariant="bold-italic">y</mml:mi><mml:mo>)</mml:mo><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>
        where <inline-formula><mml:math id="M22" display="inline"><mml:mrow><mml:mi mathvariant="bold-italic">x</mml:mi><mml:mo>(</mml:mo><mml:mi mathvariant="italic">θ</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> and <inline-formula><mml:math id="M23" display="inline"><mml:mi mathvariant="bold-italic">y</mml:mi></mml:math></inline-formula> are vectors of model output
for a given set of model parameters and observed data, respectively, and
<inline-formula><mml:math id="M24" display="inline"><mml:mrow><mml:msubsup><mml:mi mathvariant="bold">C</mml:mi><mml:mtext>N</mml:mtext><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:msubsup></mml:mrow></mml:math></inline-formula> is the inverse of the noise–covariance matrix. In
its simplest form, the <inline-formula><mml:math id="M25" display="inline"><mml:mrow><mml:msup><mml:mi>r</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msup></mml:mrow></mml:math></inline-formula> statistic is the weighted sum of squares
residual between the model simulation and the observed pattern. The weights
applied to the residuals are estimated from the unforced climate variability
in a fully coupled, three-dimensional model and represent the observed
patterns we would expect in the absence of external forcings. In
<xref ref-type="bibr" rid="bib1.bibx25" id="text.29"/>, surface temperature, upper-air temperature, and global
mean ocean heat content patterns were used to evaluate model performance. We
note that the definition of <inline-formula><mml:math id="M26" display="inline"><mml:mrow><mml:msup><mml:mi>r</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msup></mml:mrow></mml:math></inline-formula> presented here is different than the
coefficient of determination for the goodness of fit of a linear model. In a
linear model, high values of <inline-formula><mml:math id="M27" display="inline"><mml:mrow><mml:msup><mml:mi>r</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msup></mml:mrow></mml:math></inline-formula> indicate a good fit to the model. In our
weighted sum, low values of <inline-formula><mml:math id="M28" display="inline"><mml:mrow><mml:msup><mml:mi>r</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msup></mml:mrow></mml:math></inline-formula> indicate a good fit between the model
output and the observations.</p>
      <?pagebreak page3316?><p id="d1e679">The goodness-of-fit statistics for each pattern used to evaluate the model
are converted to a PDF using the likelihood function described in
<xref ref-type="bibr" rid="bib1.bibx25" id="text.30"/> and modified by <xref ref-type="bibr" rid="bib1.bibx23" id="text.31"/>. Through an application
of Bayes' theorem, the individual likelihoods are combined to derive a joint
PDF for the three model parameters. As in <xref ref-type="bibr" rid="bib1.bibx25" id="text.32"/>, we apply an
expert prior to ECS and uniform priors to <inline-formula><mml:math id="M29" display="inline"><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> and <inline-formula><mml:math id="M30" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula>.
Marginal probability distributions for individual parameters are calculated
by integrating the joint PDF over the other two parameters.</p>
      <p id="d1e713">We make two changes to the methodology of <xref ref-type="bibr" rid="bib1.bibx25" id="text.33"/> to derive PDFs
using MESM simulations. First, we run the model for <inline-formula><mml:math id="M31" display="inline"><mml:mi mathvariant="italic">θ</mml:mi></mml:math></inline-formula> values that sample
individual parameters over a wider range and on a more regular grid. Climate
sensitivity is sampled from 0.5 to 10.0 <inline-formula><mml:math id="M32" display="inline"><mml:mrow><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:math></inline-formula> in increments of
0.5 <inline-formula><mml:math id="M33" display="inline"><mml:mrow><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:math></inline-formula> by adjusting the strength of the cloud feedback, the
square root of ocean diffusivity is sampled from 0 to 8 <inline-formula><mml:math id="M34" display="inline"><mml:mrow><mml:mi mathvariant="normal">cm</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:msup><mml:mi mathvariant="normal">s</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn><mml:mo>/</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula>
in increments of 1 <inline-formula><mml:math id="M35" display="inline"><mml:mrow><mml:mi mathvariant="normal">cm</mml:mi><mml:mspace linebreak="nobreak" width="0.125em"/><mml:msup><mml:mi mathvariant="normal">s</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn><mml:mo>/</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula>, and the aerosol forcing amplitude is
sampled from <inline-formula><mml:math id="M36" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1.75</mml:mn></mml:mrow></mml:math></inline-formula> to 0.5 <inline-formula><mml:math id="M37" display="inline"><mml:mrow><mml:mi mathvariant="normal">W</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:msup><mml:mi mathvariant="normal">m</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula> in increments
0.25 <inline-formula><mml:math id="M38" display="inline"><mml:mrow><mml:mi mathvariant="normal">W</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:msup><mml:mi mathvariant="normal">m</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula>. By choosing this sampling strategy, we have increased
the number of runs from 640 with IGSM to 1800 runs with MESM, widened the
range of parameter values sampled, and increased the density of model runs
within the parameter space (Fig. <xref ref-type="fig" rid="Ch1.F1"/>).</p>
      <p id="d1e839">As a second change, we reduce the number of diagnostics used to evaluate
model performance. In general, independent temperature patterns should be
used to evaluate model performance because they rule out different regions of
the parameter space for being inconsistent with the observed climate record.
In particular, <xref ref-type="bibr" rid="bib1.bibx44" id="text.34"/> show that surface temperature and ocean heat
content time series provide good constraints on model estimation. Further,
<xref ref-type="bibr" rid="bib1.bibx23" id="text.35"/> shows upper-air temperatures to be highly correlated with
surface temperature via the lapse rate and water vapor feedbacks. For these
reasons, we now omit the upper-air temperature diagnostic. The removal of the
upper-air diagnostic leaves two temperature diagnostics for evaluating model
performance: (1) decadal mean surface air temperature anomalies from
1946 to 1995 with respect to a 1906–1995 climatology in four equal-area zonal
bands, and (2) the linear trend in global mean ocean heat content from
1955 to 1995 in the 0–3 km layer. As in <xref ref-type="bibr" rid="bib1.bibx25" id="text.36"/>, we use five
surface temperature datasets <xref ref-type="bibr" rid="bib1.bibx17 bib1.bibx4 bib1.bibx36 bib1.bibx15" id="paren.37"/>
and one ocean heat content dataset <xref ref-type="bibr" rid="bib1.bibx22" id="paren.38"/> as observations. Five
different joint PDFs are derived by combining the likelihood from the ocean
diagnostic with the likelihood derived from each of the individual surface
temperature datasets.</p>
</sec>
<sec id="Ch1.S4">
  <title>Results</title>
      <p id="d1e863">Our results are presented as follows. We first identify the changes in the
input forcings used in our historical simulations by comparing the solar and
ozone components used in the IGSM runs with those used in the MESM runs.
Second, we show how the probability distribution functions change when
reducing the number of model diagnostics from three to two through the
omission of the upper-air diagnostic. Third, we derive probability
distributions using the MESM<?pagebreak page3317?> ensemble and directly compare them to those
derived using the IGSM ensemble using the full ensembles and the case where
only runs with <inline-formula><mml:math id="M39" display="inline"><mml:mi mathvariant="italic">θ</mml:mi></mml:math></inline-formula> values common to both ensembles are used. Fourth, we
evaluate how well the model captures the observations by comparing model
output from the MESM ensemble to the observed climate record. Finally, we
derive the response surfaces for transient climate response and thermosteric
sea level rise for MESM and compare them to the corresponding surfaces from
IGSM.</p>
      <p id="d1e873">To identify changes in the forcing time series used to drive the model, we
compare the input forcings for the two components for which we have changed
datasets. When comparing the forcing time series, only differences in the
changes relative to 1860 impact the historical simulations. Time-invariant
differences are accounted for in the offline <inline-formula><mml:math id="M40" display="inline"><mml:mi>Q</mml:mi></mml:math></inline-formula> flux and initial condition
calculations, but differences in the changes are not. In Fig. <xref ref-type="fig" rid="Ch1.F2"/>, we
show the old and new solar forcing time series. We see that the biggest
difference observed in the solar irradiance time series is a bias towards
lower values when using the <xref ref-type="bibr" rid="bib1.bibx20" id="text.39"/> data. The bias is relatively
constant at approximately 4.5 <inline-formula><mml:math id="M41" display="inline"><mml:mrow><mml:mi mathvariant="normal">W</mml:mi><mml:mspace linebreak="nobreak" width="0.125em"/><mml:msup><mml:mi mathvariant="normal">m</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula> until 1920, but then
increases towards 5.0 <inline-formula><mml:math id="M42" display="inline"><mml:mrow><mml:mi mathvariant="normal">W</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:msup><mml:mi mathvariant="normal">m</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula> moving forward in time. The growth of
this low bias introduces a weakening of the solar forcing beginning in 1920
in the new suite of forcings.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F2"><caption><p id="d1e924">Annual mean total solar irradiance. The bias between the
<xref ref-type="bibr" rid="bib1.bibx21" id="text.40"/> and <xref ref-type="bibr" rid="bib1.bibx20" id="text.41"/> datasets leads to a reduction in radiative
forcing in the new forcing suite.</p></caption>
        <?xmltex \igopts{width=236.157874pt}?><graphic xlink:href="https://gmd.copernicus.org/articles/11/3313/2018/gmd-11-3313-2018-f02.pdf"/>

      </fig>

      <?xmltex \floatpos{t}?><fig id="Ch1.F3" specific-use="star"><caption><p id="d1e942">Ozone concentration in the old IGSM time series (red) and the
<xref ref-type="bibr" rid="bib1.bibx5" id="text.42"/> AC&amp;C/SPARC concentrations (black). <bold>(a–c)</bold> Annual
mean ozone mixing ratio in the total column in the global
average <bold>(a)</bold>, Northern Hemisphere <bold>(b)</bold>, and Southern
Hemisphere <bold>(c)</bold>. Panels <bold>(d–f)</bold> are as in <bold>(a–c)</bold> but for the
average above 200 mb. Panels <bold>(g–i)</bold> are as in <bold>(a–c)</bold> but for the
average below 200 mb.</p></caption>
        <?xmltex \igopts{width=398.338583pt}?><graphic xlink:href="https://gmd.copernicus.org/articles/11/3313/2018/gmd-11-3313-2018-f03.pdf"/>

      </fig>

      <p id="d1e979">We observe that ozone concentrations estimated from the AC&amp;C/SPARC dataset
differ in both space and time when compared to the previous concentrations
used with IGSM (Fig. <xref ref-type="fig" rid="Ch1.F3"/>). One clear difference is that the
AC&amp;C/SPARC dataset introduces more temporal variability in stratospheric
ozone concentrations (which we approximate as pressure levels above 200 mb)
prior to 1950. After 1950, AC&amp;C/SPARC tends to have lower ozone
concentrations in the stratosphere and slightly greater concentrations in the
troposphere (levels below 200 mb). However, similar to with the solar
forcing, we are concerned with the temporal change in the forcing imposed by
the ozone concentrations, rather than the relative magnitude of the
concentrations across datasets. Beginning in 1900, tropospheric ozone
concentrations increase less rapidly in the AC&amp;C/SPARC dataset when compared
to the IGSM dataset. Differences in stratospheric ozone concentrations remain
relatively constant until 1950, but then decrease at a slower rate in the
AC&amp;C/SPARC time series. These patterns are generally consistent in the
global and hemispheric means. When considered separately, increased
tropospheric ozone concentrations tend to increase radiative forcing
<xref ref-type="bibr" rid="bib1.bibx43" id="paren.43"/> and decreased stratospheric concentrations tend to
increase radiative forcing <xref ref-type="bibr" rid="bib1.bibx6" id="paren.44"/>. Thus, the less rapid increase
in tropospheric ozone concentration and less rapid decrease in stratospheric
ozone concentration in the AC&amp;C/SPARC dataset both contribute to a weaker
radiative forcing over the historical period in the new suite of forcings.</p>
      <p id="d1e990">With the input forcings documented, we focus on deriving probability
distributions for the model parameters. We first test the impact of omitting
the upper-air diagnostic. As noted in Sect. <xref ref-type="sec" rid="Ch1.S3"/>, the surface
and upper-air temperature diagnostics are highly correlated. As a result,
they reject similar regions of the parameter space for being inconsistent
with the observed climate record. Thus, those regions are rejected twice,
while regions inconsistent with the ocean heat content diagnostic are
rejected only once. Multiplying the Bayesian likelihood estimate by the same
pattern twice leads to a potential bias in the distributions towards regions
that are consistent with the surface temperature diagnostic.</p>

<?xmltex \floatpos{t}?><table-wrap id="Ch1.T1"><caption><p id="d1e998">The 90 % confidence intervals for climate sensitivity (ECS) and
net aerosol forcing (<inline-formula><mml:math id="M43" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula>). Distributions that include the
upper-air diagnostic are from <xref ref-type="bibr" rid="bib1.bibx25" id="text.45"/> and distributions with two
diagnostics exclude the upper-air diagnostic.</p></caption><oasis:table frame="topbot"><?xmltex \begin{scaleboxenv}{.85}[.85]?><oasis:tgroup cols="7">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="left"/>
     <oasis:colspec colnum="3" colname="col3" align="right"/>
     <oasis:colspec colnum="4" colname="col4" align="right"/>
     <oasis:colspec colnum="5" colname="col5" align="right" colsep="1"/>
     <oasis:colspec colnum="6" colname="col6" align="right"/>
     <oasis:colspec colnum="7" colname="col7" align="right"/>
     <oasis:thead>
       <oasis:row>

         <oasis:entry colname="col1"/>

         <oasis:entry colname="col2"/>

         <oasis:entry colname="col3">No. of</oasis:entry>

         <oasis:entry namest="col4" nameend="col5" align="center" colsep="1">ECS </oasis:entry>

         <oasis:entry namest="col6" nameend="col7" align="center"><inline-formula><mml:math id="M49" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula></oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col1"/>

         <oasis:entry colname="col2"/>

         <oasis:entry colname="col3">diags.</oasis:entry>

         <oasis:entry rowsep="1" namest="col4" nameend="col5" align="center" colsep="1">(<inline-formula><mml:math id="M50" display="inline"><mml:mrow><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:math></inline-formula>) </oasis:entry>

         <oasis:entry rowsep="1" namest="col6" nameend="col7" align="center">(<inline-formula><mml:math id="M51" display="inline"><mml:mrow><mml:mi mathvariant="normal">W</mml:mi><mml:mspace linebreak="nobreak" width="0.125em"/><mml:msup><mml:mi mathvariant="normal">m</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula>) </oasis:entry>

       </oasis:row>
       <oasis:row rowsep="1">

         <oasis:entry colname="col1"/>

         <oasis:entry colname="col2"/>

         <oasis:entry colname="col3"/>

         <oasis:entry colname="col4">5 %</oasis:entry>

         <oasis:entry colname="col5">95 %</oasis:entry>

         <oasis:entry colname="col6">5 %</oasis:entry>

         <oasis:entry colname="col7">95 %</oasis:entry>

       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>

         <oasis:entry colname="col1"/>

         <oasis:entry rowsep="1" colname="col2" morerows="1">HadCRUT2<sup>1</sup></oasis:entry>

         <oasis:entry colname="col3">3</oasis:entry>

         <oasis:entry colname="col4">2.0</oasis:entry>

         <oasis:entry colname="col5">5.3</oasis:entry>

         <oasis:entry colname="col6"><inline-formula><mml:math id="M52" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.19</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

         <oasis:entry colname="col7"><inline-formula><mml:math id="M53" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.70</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

       </oasis:row>
       <oasis:row>

         <?xmltex \rotentry?><oasis:entry colname="col1" morerows="8">Surface temperature dataset</oasis:entry>

         <oasis:entry rowsep="1" colname="col3">2</oasis:entry>

         <oasis:entry rowsep="1" colname="col4">1.9</oasis:entry>

         <oasis:entry rowsep="1" colname="col5">5.2</oasis:entry>

         <oasis:entry rowsep="1" colname="col6"><inline-formula><mml:math id="M54" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.19</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

         <oasis:entry rowsep="1" colname="col7"><inline-formula><mml:math id="M55" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.71</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry rowsep="1" colname="col2" morerows="1">HadCRUT3<sup>2</sup></oasis:entry>

         <oasis:entry colname="col3">3</oasis:entry>

         <oasis:entry colname="col4">1.9</oasis:entry>

         <oasis:entry colname="col5">5.1</oasis:entry>

         <oasis:entry colname="col6"><inline-formula><mml:math id="M56" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.22</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

         <oasis:entry colname="col7"><inline-formula><mml:math id="M57" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.74</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

       </oasis:row>
       <oasis:row rowsep="1">

         <oasis:entry colname="col3">2</oasis:entry>

         <oasis:entry colname="col4">1.7</oasis:entry>

         <oasis:entry colname="col5">5.0</oasis:entry>

         <oasis:entry colname="col6"><inline-formula><mml:math id="M58" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.38</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

         <oasis:entry colname="col7"><inline-formula><mml:math id="M59" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.79</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry rowsep="1" colname="col2" morerows="1">NCDC<sup>3</sup></oasis:entry>

         <oasis:entry colname="col3">3</oasis:entry>

         <oasis:entry colname="col4">1.8</oasis:entry>

         <oasis:entry colname="col5">4.7</oasis:entry>

         <oasis:entry colname="col6"><inline-formula><mml:math id="M60" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.37</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

         <oasis:entry colname="col7"><inline-formula><mml:math id="M61" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.78</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

       </oasis:row>
       <oasis:row rowsep="1">

         <oasis:entry colname="col3">2</oasis:entry>

         <oasis:entry colname="col4">1.6</oasis:entry>

         <oasis:entry colname="col5">4.8</oasis:entry>

         <oasis:entry colname="col6"><inline-formula><mml:math id="M62" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.38</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

         <oasis:entry colname="col7"><inline-formula><mml:math id="M63" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.79</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry rowsep="1" colname="col2" morerows="1">GISTEMP 250<sup>4</sup></oasis:entry>

         <oasis:entry colname="col3">3</oasis:entry>

         <oasis:entry colname="col4">1.3</oasis:entry>

         <oasis:entry colname="col5">3.6</oasis:entry>

         <oasis:entry colname="col6"><inline-formula><mml:math id="M64" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.32</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

         <oasis:entry colname="col7"><inline-formula><mml:math id="M65" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.83</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

       </oasis:row>
       <oasis:row rowsep="1">

         <oasis:entry colname="col3">2</oasis:entry>

         <oasis:entry colname="col4">1.1</oasis:entry>

         <oasis:entry colname="col5">4.0</oasis:entry>

         <oasis:entry colname="col6"><inline-formula><mml:math id="M66" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.35</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

         <oasis:entry colname="col7"><inline-formula><mml:math id="M67" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.83</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col2" morerows="1">GISTEMP 1200<sup>5</sup></oasis:entry>

         <oasis:entry colname="col3">3</oasis:entry>

         <oasis:entry colname="col4">1.2</oasis:entry>

         <oasis:entry colname="col5">3.4</oasis:entry>

         <oasis:entry colname="col6"><inline-formula><mml:math id="M68" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.33</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

         <oasis:entry colname="col7"><inline-formula><mml:math id="M69" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.80</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col3">2</oasis:entry>

         <oasis:entry colname="col4">1.0</oasis:entry>

         <oasis:entry colname="col5">3.7</oasis:entry>

         <oasis:entry colname="col6"><inline-formula><mml:math id="M70" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.35</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

         <oasis:entry colname="col7"><inline-formula><mml:math id="M71" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.83</mml:mn></mml:mrow></mml:math></inline-formula></oasis:entry>

       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup><?xmltex \end{scaleboxenv}?></oasis:table><?xmltex \begin{scaleboxenv}{.9}[.9]?><table-wrap-foot><p id="d1e1015"><inline-formula><mml:math id="M44" display="inline"><mml:msup><mml:mi/><mml:mn mathvariant="normal">1</mml:mn></mml:msup></mml:math></inline-formula> Hadley Centre Climatic Research Unit
Temperature version 2 <xref ref-type="bibr" rid="bib1.bibx17" id="paren.46"/>.<?xmltex \hack{\\}?><inline-formula><mml:math id="M45" display="inline"><mml:msup><mml:mi/><mml:mn mathvariant="normal">2</mml:mn></mml:msup></mml:math></inline-formula> Hadley Centre Climatic
Research Unit Temperature version 3 <xref ref-type="bibr" rid="bib1.bibx4" id="paren.47"/>.<?xmltex \hack{\\}?><inline-formula><mml:math id="M46" display="inline"><mml:msup><mml:mi/><mml:mn mathvariant="normal">3</mml:mn></mml:msup></mml:math></inline-formula> National
Climatic Data Center merged land–ocean dataset <xref ref-type="bibr" rid="bib1.bibx36" id="paren.48"/>.<?xmltex \hack{\\}?><inline-formula><mml:math id="M47" display="inline"><mml:msup><mml:mi/><mml:mn mathvariant="normal">4</mml:mn></mml:msup></mml:math></inline-formula> GISS
Surface Temperature Analysis with 250 km smoothing <xref ref-type="bibr" rid="bib1.bibx15" id="paren.49"/>.<?xmltex \hack{\\}?><inline-formula><mml:math id="M48" display="inline"><mml:msup><mml:mi/><mml:mn mathvariant="normal">5</mml:mn></mml:msup></mml:math></inline-formula> GISS Surface Temperature Analysis with 1200 km smoothing
<xref ref-type="bibr" rid="bib1.bibx15" id="paren.50"/>.</p></table-wrap-foot><?xmltex \end{scaleboxenv}?></table-wrap>

      <?pagebreak page3318?><p id="d1e1578">Starting from the distributions calculated in <xref ref-type="bibr" rid="bib1.bibx25" id="text.51"/>, we derive
new distributions based only on the surface temperature and ocean heat
content diagnostics presented in Sect. <xref ref-type="sec" rid="Ch1.S3"/>. We show that
reducing the number of diagnostics from three to two leads to slight changes
in the parameter estimates (Table <xref ref-type="table" rid="Ch1.T1"/>). We only present
comparisons for ECS and <inline-formula><mml:math id="M72" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula> because distributions of <inline-formula><mml:math id="M73" display="inline"><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> were
poorly constrained in <xref ref-type="bibr" rid="bib1.bibx25" id="text.52"/> and no uncertainty bounds were
given. In general, ECS estimates tend to be slightly lower when using only
two diagnostics and aerosol estimates are nearly unchanged. Further, the
relationships between the distributions with respect to the surface dataset are
unchanged. Because the changes using only two diagnostics do not change any
conclusions from the original study and conservatively remove the risk of
double counting the surface signal, we justify the removal of the upper-air
diagnostic.</p>

<table-wrap id="Ch1.T2" specific-use="star"><caption><p id="d1e1617">The 90 % confidence intervals and means for climate sensitivity
(ECS), ocean diffusivity (<inline-formula><mml:math id="M74" display="inline"><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>), and net aerosol forcing
(<inline-formula><mml:math id="M75" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula>). Surface temperature datasets are the same as in
Table <xref ref-type="table" rid="Ch1.T1"/>.</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="12">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="left"/>
     <oasis:colspec colnum="3" colname="col3" align="left"/>
     <oasis:colspec colnum="4" colname="col4" align="right"/>
     <oasis:colspec colnum="5" colname="col5" align="right"/>
     <oasis:colspec colnum="6" colname="col6" align="right" colsep="1"/>
     <oasis:colspec colnum="7" colname="col7" align="right"/>
     <oasis:colspec colnum="8" colname="col8" align="right"/>
     <oasis:colspec colnum="9" colname="col9" align="right" colsep="1"/>
     <oasis:colspec colnum="10" colname="col10" align="right"/>
     <oasis:colspec colnum="11" colname="col11" align="right"/>
     <oasis:colspec colnum="12" colname="col12" align="right"/>
     <oasis:thead>
       <oasis:row>

         <oasis:entry colname="col1"/>

         <oasis:entry colname="col2"/>

         <oasis:entry rowsep="1" colname="col3" morerows="2">Model and runs</oasis:entry>

         <oasis:entry namest="col4" nameend="col6" align="center" colsep="1">ECS </oasis:entry>

         <oasis:entry namest="col7" nameend="col9" align="center" colsep="1"><inline-formula><mml:math id="M76" display="inline"><mml:msqrt><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:msqrt></mml:math></inline-formula></oasis:entry>

         <oasis:entry namest="col10" nameend="col12" align="center"><inline-formula><mml:math id="M77" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula></oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col1"/>

         <oasis:entry colname="col2"/>

         <oasis:entry rowsep="1" namest="col4" nameend="col6" align="center" colsep="1">(<inline-formula><mml:math id="M78" display="inline"><mml:mrow><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:math></inline-formula>) </oasis:entry>

         <oasis:entry rowsep="1" namest="col7" nameend="col9" align="center" colsep="1">(<inline-formula><mml:math id="M79" display="inline"><mml:mrow><mml:mi mathvariant="normal">cm</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:msup><mml:mi mathvariant="normal">s</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn><mml:mo>/</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula>) </oasis:entry>

         <oasis:entry rowsep="1" namest="col10" nameend="col12" align="center">(<inline-formula><mml:math id="M80" display="inline"><mml:mrow><mml:mi mathvariant="normal">W</mml:mi><mml:mspace linebreak="nobreak" width="0.125em"/><mml:msup><mml:mi mathvariant="normal">m</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula>) </oasis:entry>

       </oasis:row>
       <oasis:row rowsep="1">

         <oasis:entry colname="col1"/>

         <oasis:entry colname="col2"/>

         <oasis:entry colname="col4">5 %</oasis:entry>

         <oasis:entry colname="col5">95 %</oasis:entry>

         <oasis:entry colname="col6">Mean</oasis:entry>

         <oasis:entry colname="col7">5 %</oasis:entry>

         <oasis:entry colname="col8">95 %</oasis:entry>

         <oasis:entry colname="col9">Mean</oasis:entry>

         <oasis:entry colname="col10">5 %</oasis:entry>

         <oasis:entry colname="col11">95 %</oasis:entry>

         <oasis:entry colname="col12">Mean</oasis:entry>

       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>

         <?xmltex \rotentry?><oasis:entry colname="col1" morerows="19">Surface temperature dataset</oasis:entry>

         <oasis:entry rowsep="1" colname="col2" morerows="3">HadCRUT2</oasis:entry>

         <oasis:entry colname="col3">Full IGSM</oasis:entry>

         <oasis:entry colname="col4">1.9</oasis:entry>

         <oasis:entry colname="col5">5.2</oasis:entry>

         <oasis:entry colname="col6">3.0</oasis:entry>

         <oasis:entry colname="col7">0.1</oasis:entry>

         <oasis:entry colname="col8">2.1</oasis:entry>

         <oasis:entry colname="col9">0.9</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M81" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.19</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M82" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.71</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M83" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.46</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col3">Subsampled IGSM</oasis:entry>

         <oasis:entry colname="col4">1.9</oasis:entry>

         <oasis:entry colname="col5">5.2</oasis:entry>

         <oasis:entry colname="col6">3.0</oasis:entry>

         <oasis:entry colname="col7">0.1</oasis:entry>

         <oasis:entry colname="col8">2.1</oasis:entry>

         <oasis:entry colname="col9">0.9</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M84" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.16</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M85" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.71</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M86" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.45</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col3">Full MESM</oasis:entry>

         <oasis:entry colname="col4">2.1</oasis:entry>

         <oasis:entry colname="col5">5.7</oasis:entry>

         <oasis:entry colname="col6">3.5</oasis:entry>

         <oasis:entry colname="col7">0.1</oasis:entry>

         <oasis:entry colname="col8">2.3</oasis:entry>

         <oasis:entry colname="col9">1.0</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M87" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.03</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M88" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.39</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M89" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.22</oasis:entry>

       </oasis:row>
       <oasis:row rowsep="1">

         <oasis:entry colname="col3">Subsampled MESM</oasis:entry>

         <oasis:entry colname="col4">2.1</oasis:entry>

         <oasis:entry colname="col5">5.7</oasis:entry>

         <oasis:entry colname="col6">3.4</oasis:entry>

         <oasis:entry colname="col7">0.1</oasis:entry>

         <oasis:entry colname="col8">2.2</oasis:entry>

         <oasis:entry colname="col9">1.0</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M90" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.03</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M91" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.39</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M92" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.22</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry rowsep="1" colname="col2" morerows="3">HadCRUT3</oasis:entry>

         <oasis:entry colname="col3">Full IGSM</oasis:entry>

         <oasis:entry colname="col4">1.7</oasis:entry>

         <oasis:entry colname="col5">4.0</oasis:entry>

         <oasis:entry colname="col6">2.8</oasis:entry>

         <oasis:entry colname="col7">0.2</oasis:entry>

         <oasis:entry colname="col8">2.9</oasis:entry>

         <oasis:entry colname="col9">1.2</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M93" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.22</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M94" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.75</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M95" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.50</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col3">Subsampled IGSM</oasis:entry>

         <oasis:entry colname="col4">1.7</oasis:entry>

         <oasis:entry colname="col5">4.0</oasis:entry>

         <oasis:entry colname="col6">2.8</oasis:entry>

         <oasis:entry colname="col7">0.2</oasis:entry>

         <oasis:entry colname="col8">2.9</oasis:entry>

         <oasis:entry colname="col9">1.2</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M96" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.20</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M97" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.75</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M98" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.49</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col3">Full MESM</oasis:entry>

         <oasis:entry colname="col4">1.9</oasis:entry>

         <oasis:entry colname="col5">5.4</oasis:entry>

         <oasis:entry colname="col6">3.2</oasis:entry>

         <oasis:entry colname="col7">0.2</oasis:entry>

         <oasis:entry colname="col8">3.6</oasis:entry>

         <oasis:entry colname="col9">1.3</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M99" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.05</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M100" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.43</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M101" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.24</oasis:entry>

       </oasis:row>
       <oasis:row rowsep="1">

         <oasis:entry colname="col3">Subsampled MESM</oasis:entry>

         <oasis:entry colname="col4">1.9</oasis:entry>

         <oasis:entry colname="col5">5.4</oasis:entry>

         <oasis:entry colname="col6">3.2</oasis:entry>

         <oasis:entry colname="col7">0.2</oasis:entry>

         <oasis:entry colname="col8">3.0</oasis:entry>

         <oasis:entry colname="col9">1.2</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M102" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.05</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M103" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.42</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M104" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.24</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry rowsep="1" colname="col2" morerows="3">NCDC</oasis:entry>

         <oasis:entry colname="col3">Full IGSM</oasis:entry>

         <oasis:entry colname="col4">1.6</oasis:entry>

         <oasis:entry colname="col5">4.8</oasis:entry>

         <oasis:entry colname="col6">2.7</oasis:entry>

         <oasis:entry colname="col7">0.3</oasis:entry>

         <oasis:entry colname="col8">3.7</oasis:entry>

         <oasis:entry colname="col9">1.6</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M105" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.38</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M106" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.79</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M107" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.59</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col3">Subsampled IGSM</oasis:entry>

         <oasis:entry colname="col4">1.6</oasis:entry>

         <oasis:entry colname="col5">4.8</oasis:entry>

         <oasis:entry colname="col6">2.7</oasis:entry>

         <oasis:entry colname="col7">0.3</oasis:entry>

         <oasis:entry colname="col8">3.7</oasis:entry>

         <oasis:entry colname="col9">1.6</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M108" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.36</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M109" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.79</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M110" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.58</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col3">Full MESM</oasis:entry>

         <oasis:entry colname="col4">2.0</oasis:entry>

         <oasis:entry colname="col5">5.4</oasis:entry>

         <oasis:entry colname="col6">3.2</oasis:entry>

         <oasis:entry colname="col7">0.3</oasis:entry>

         <oasis:entry colname="col8">3.7</oasis:entry>

         <oasis:entry colname="col9">1.6</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M111" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.15</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M112" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.45</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M113" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.29</oasis:entry>

       </oasis:row>
       <oasis:row rowsep="1">

         <oasis:entry colname="col3">Subsampled MESM</oasis:entry>

         <oasis:entry colname="col4">2.0</oasis:entry>

         <oasis:entry colname="col5">5.3</oasis:entry>

         <oasis:entry colname="col6">3.2</oasis:entry>

         <oasis:entry colname="col7">0.3</oasis:entry>

         <oasis:entry colname="col8">3.2</oasis:entry>

         <oasis:entry colname="col9">1.5</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M114" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.15</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M115" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.45</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M116" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.29</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry rowsep="1" colname="col2" morerows="3">GISTEMP 250</oasis:entry>

         <oasis:entry colname="col3">Full IGSM</oasis:entry>

         <oasis:entry colname="col4">1.1</oasis:entry>

         <oasis:entry colname="col5">4.0</oasis:entry>

         <oasis:entry colname="col6">2.1</oasis:entry>

         <oasis:entry colname="col7">0.7</oasis:entry>

         <oasis:entry colname="col8">4.8</oasis:entry>

         <oasis:entry colname="col9">2.7</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M117" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.35</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M118" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.86</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M119" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.61</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col3">Subsampled IGSM</oasis:entry>

         <oasis:entry colname="col4">1.1</oasis:entry>

         <oasis:entry colname="col5">4.0</oasis:entry>

         <oasis:entry colname="col6">2.1</oasis:entry>

         <oasis:entry colname="col7">0.6</oasis:entry>

         <oasis:entry colname="col8">4.8</oasis:entry>

         <oasis:entry colname="col9">2.7</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M120" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.35</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M121" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.86</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M122" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.60</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col3">Full MESM</oasis:entry>

         <oasis:entry colname="col4">1.3</oasis:entry>

         <oasis:entry colname="col5">4.8</oasis:entry>

         <oasis:entry colname="col6">2.6</oasis:entry>

         <oasis:entry colname="col7">0.8</oasis:entry>

         <oasis:entry colname="col8">7.3</oasis:entry>

         <oasis:entry colname="col9">3.5</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M123" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.13</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M124" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.53</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M125" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.34</oasis:entry>

       </oasis:row>
       <oasis:row rowsep="1">

         <oasis:entry colname="col3">Subsampled MESM</oasis:entry>

         <oasis:entry colname="col4">1.4</oasis:entry>

         <oasis:entry colname="col5">4.7</oasis:entry>

         <oasis:entry colname="col6">2.6</oasis:entry>

         <oasis:entry colname="col7">0.8</oasis:entry>

         <oasis:entry colname="col8">4.7</oasis:entry>

         <oasis:entry colname="col9">2.6</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M126" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.13</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M127" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.51</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M128" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.33</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col2" morerows="3">GISTEMP 1200</oasis:entry>

         <oasis:entry colname="col3">Full IGSM</oasis:entry>

         <oasis:entry colname="col4">1.0</oasis:entry>

         <oasis:entry colname="col5">3.7</oasis:entry>

         <oasis:entry colname="col6">1.9</oasis:entry>

         <oasis:entry colname="col7">0.8</oasis:entry>

         <oasis:entry colname="col8">4.9</oasis:entry>

         <oasis:entry colname="col9">3.1</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M129" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.35</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M130" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.83</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M131" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.56</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col3">Subsampled IGSM</oasis:entry>

         <oasis:entry colname="col4">1.0</oasis:entry>

         <oasis:entry colname="col5">3.7</oasis:entry>

         <oasis:entry colname="col6">1.9</oasis:entry>

         <oasis:entry colname="col7">0.7</oasis:entry>

         <oasis:entry colname="col8">4.9</oasis:entry>

         <oasis:entry colname="col9">3.1</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M132" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.35</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M133" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.82</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M134" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.56</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col3">Full MESM</oasis:entry>

         <oasis:entry colname="col4">1.3</oasis:entry>

         <oasis:entry colname="col5">4.8</oasis:entry>

         <oasis:entry colname="col6">2.6</oasis:entry>

         <oasis:entry colname="col7">0.8</oasis:entry>

         <oasis:entry colname="col8">7.3</oasis:entry>

         <oasis:entry colname="col9">3.5</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M135" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.14</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M136" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.49</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M137" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.33</oasis:entry>

       </oasis:row>
       <oasis:row>

         <oasis:entry colname="col3">Subsampled MESM</oasis:entry>

         <oasis:entry colname="col4">1.3</oasis:entry>

         <oasis:entry colname="col5">4.7</oasis:entry>

         <oasis:entry colname="col6">2.6</oasis:entry>

         <oasis:entry colname="col7">0.8</oasis:entry>

         <oasis:entry colname="col8">4.7</oasis:entry>

         <oasis:entry colname="col9">2.6</oasis:entry>

         <oasis:entry colname="col10"><inline-formula><mml:math id="M138" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.14</oasis:entry>

         <oasis:entry colname="col11"><inline-formula><mml:math id="M139" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.49</oasis:entry>

         <oasis:entry colname="col12"><inline-formula><mml:math id="M140" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula>0.32</oasis:entry>

       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table></table-wrap>

      <p id="d1e2884">We next evaluate the impacts that changing the model from IGSM to MESM and
updating the forcing suite have on the parameter distributions. We present
the new marginal distributions for each parameter in Fig. <xref ref-type="fig" rid="Ch1.F4"/> and
observe significant differences between those derived using IGSM and those
derived using MESM with the updated forcings (Table <xref ref-type="table" rid="Ch1.T2"/>). Across
all datasets, climate sensitivity distributions shift towards higher values
and the uncertainty bounds encompass a wider range. When considering the
90 % confidence intervals across the distributions derived from each
surface dataset, we find climate sensitivity now lies between 1.3 and
5.7 <inline-formula><mml:math id="M141" display="inline"><mml:mrow><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:math></inline-formula>, as opposed to the estimated interval of 1.2 to
5.3 <inline-formula><mml:math id="M142" display="inline"><mml:mrow><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:math></inline-formula> from <xref ref-type="bibr" rid="bib1.bibx25" id="text.53"/>. While the uncertainty
bounds are still wide compared to other parameters, we observe that <inline-formula><mml:math id="M143" display="inline"><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> is
now better constrained with MESM. The distributions of <inline-formula><mml:math id="M144" display="inline"><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> derived using
the GISTEMP datasets are still unconstrained with upper tails extending to
the edge of the parameter domain, but all other datasets now show an upper
bound well within the ensemble range. We also observe a marked shift in the
aerosol estimates. When MESM is used with the updated forcing suite, there is
a sizable shift towards weaker aerosol forcing across all datasets. Whereas
past estimates put the net aerosol forcing between <inline-formula><mml:math id="M145" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.83</mml:mn></mml:mrow></mml:math></inline-formula> and
<inline-formula><mml:math id="M146" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.19</mml:mn></mml:mrow></mml:math></inline-formula> <inline-formula><mml:math id="M147" display="inline"><mml:mrow><mml:mi mathvariant="normal">W</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:msup><mml:mi mathvariant="normal">m</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula>, our new estimate of aerosol forcing is between
<inline-formula><mml:math id="M148" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.53</mml:mn></mml:mrow></mml:math></inline-formula> and <inline-formula><mml:math id="M149" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.03</mml:mn></mml:mrow></mml:math></inline-formula> <inline-formula><mml:math id="M150" display="inline"><mml:mrow><mml:mi mathvariant="normal">W</mml:mi><mml:mspace linebreak="nobreak" width="0.125em"/><mml:msup><mml:mi mathvariant="normal">m</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula>.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F4" specific-use="star"><caption><p id="d1e3018">Marginal probability distribution functions and TCR cumulative
distribution functions (CDFs) derived from
MESM simulations using the HadCRUT2, HadCRUT3, NCDC, GISTEMP 250, and GISTEMP
1200 surface temperature datasets as observations: <bold>(a)</bold> ECS,
<bold>(b)</bold> <inline-formula><mml:math id="M151" display="inline"><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>, and <bold>(c)</bold> <inline-formula><mml:math id="M152" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula>. Whisker plots indicate
boundaries for the 2.5–97.5 (dots), 5–95 (vertical bar ends), 25–75 (box
ends), and 50 (vertical bar in box) percentiles. Distribution means are
represented by diamonds and modes are represented by open circles.
<bold>(d)</bold> TCR CDFs derived from 1000-member Latin hypercube samples drawn from the
joint parameter distributions and the TCR functional fit.</p></caption>
        <?xmltex \igopts{width=341.433071pt}?><graphic xlink:href="https://gmd.copernicus.org/articles/11/3313/2018/gmd-11-3313-2018-f04.pdf"/>

      </fig>

      <?xmltex \floatpos{t}?><fig id="Ch1.F5" specific-use="star"><caption><p id="d1e3064">Marginal probability distribution functions derived from the full
IGSM (dashed) and MESM (solid) ensembles using the HadCRUT2, HadCRUT3, NCDC,
GISTEMP 250, and GISTEMP 1200 surface temperature datasets as observations:
<bold>(a)</bold> ECS, <bold>(b)</bold> <inline-formula><mml:math id="M153" display="inline"><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>, and <bold>(c)</bold> <inline-formula><mml:math id="M154" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula>. Whisker
plots indicate boundaries for the 2.5–97.5 (dots), 5–95 (vertical bar
ends), 25–75 (box ends), and 50 (vertical bar in box) percentiles.
Distribution means are represented by diamonds and modes are represented by
open circles. For a given dataset, the top and bottom whisker plots
correspond to the MESM and IGSM ensembles, respectively.</p></caption>
        <?xmltex \igopts{width=341.433071pt}?><graphic xlink:href="https://gmd.copernicus.org/articles/11/3313/2018/gmd-11-3313-2018-f05.pdf"/>

      </fig>

      <?pagebreak page3319?><p id="d1e3104">To test whether the differences observed in the parameter estimates were due
to the model update, rather than the increased density of model runs, we
subsampled each ensemble at the 480 <inline-formula><mml:math id="M155" display="inline"><mml:mi mathvariant="italic">θ</mml:mi></mml:math></inline-formula> values where they overlap (see
Fig. <xref ref-type="fig" rid="Ch1.F1"/>). We summarize these distributions in Table <xref ref-type="table" rid="Ch1.T2"/>
and see that there is very little sensitivity when the ensembles are
subsampled. Across all datasets, the distributions we derive using the full
640-member IGSM ensemble and those we derive using the 480-member IGSM
ensemble are nearly identical for all three parameters. The same is true for
the MESM ensemble, except for the distributions we derive for <inline-formula><mml:math id="M156" display="inline"><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>. We
consistently estimate a smaller upper bound for <inline-formula><mml:math id="M157" display="inline"><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> in the subsampled MESM
ensemble compared to when the full MESM ensemble is used. This arises because
we assign a probability of zero to regions of the parameter space that have
not been sampled. Thus, for the subsampled MESM ensemble, we assign a
probability of zero for <inline-formula><mml:math id="M158" display="inline"><mml:msqrt><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:msqrt></mml:math></inline-formula> between 5 and 8 <inline-formula><mml:math id="M159" display="inline"><mml:mrow><mml:mi mathvariant="normal">cm</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:msup><mml:mi mathvariant="normal">s</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn><mml:mo>/</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula>,
but the likelihood function does not evaluate to zero in this region when
using information from the full ensemble. As a result, the full ensemble does
not artificially cut off the distribution at <inline-formula><mml:math id="M160" display="inline"><mml:msqrt><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:msqrt></mml:math></inline-formula> equal to
5 <inline-formula><mml:math id="M161" display="inline"><mml:mrow><mml:mi mathvariant="normal">cm</mml:mi><mml:mspace linebreak="nobreak" width="0.125em"/><mml:msup><mml:mi mathvariant="normal">s</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn><mml:mo>/</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula> and leads to higher upper bounds on the distributions.
Knowing this, we can conclude from the similarity between distributions
derived from the full and subsampled ensembles that the differences we
observe between the IGSM and MESM ensembles are due to the differences
between the model and forcing themselves, not the increased density of model
runs.</p>

      <?xmltex \floatpos{p}?><fig id="Ch1.F6"><caption><p id="d1e3210">Observed and simulated global mean surface temperature anomalies.
The observed time series (red) are derived from each of the five surface
temperature datasets used in the surface temperature diagnostic. Also shown
are the time series for each MESM simulation (black). Runs with parameter
settings closest to the median values from each distribution are highlighted
(blue). All anomalies are calculated with respect to the 1906–1995
climatology used in the surface diagnostic.</p></caption>
        <?xmltex \igopts{width=236.157874pt}?><graphic xlink:href="https://gmd.copernicus.org/articles/11/3313/2018/gmd-11-3313-2018-f06.pdf"/>

      </fig>

      <?xmltex \floatpos{p}?><fig id="Ch1.F7"><caption><p id="d1e3221">Histogram of linear trends in the 0–3 km global mean ocean heat
content estimated from each MESM ensemble member. The observed trend (red)
and trends estimated from the MESM simulations with parameter values closest
to the medians from each distribution (blue) are shown as vertical lines.</p></caption>
        <?xmltex \igopts{width=236.157874pt}?><graphic xlink:href="https://gmd.copernicus.org/articles/11/3313/2018/gmd-11-3313-2018-f07.pdf"/>

      </fig>

      <p id="d1e3230">To further demonstrate the total effect of changes to the model, forcings,
and ensemble design, we compare the marginal distributions derived from the
full IGSM and MESM ensembles using each surface temperature dataset
(Fig. <xref ref-type="fig" rid="Ch1.F5"/>). For all five datasets, we observe shifts towards higher
climate sensitivity, slightly higher ocean diffusivity, and weaker aerosol
forcing, consistent with our previous discussion. Further, we demonstrate
that the higher ocean diffusivities using the MESM ensembles are the result
of not assigning zero probability for <inline-formula><mml:math id="M162" display="inline"><mml:msqrt><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:msqrt></mml:math></inline-formula> between 5 and
8 <inline-formula><mml:math id="M163" display="inline"><mml:mrow><mml:mi mathvariant="normal">cm</mml:mi><mml:mspace linebreak="nobreak" width="0.125em"/><mml:msup><mml:mi mathvariant="normal">s</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn><mml:mo>/</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula>. This is clearly evident in the distributions derived
using the GISTEMP datasets (Fig. <xref ref-type="fig" rid="Ch1.F5"/>b), where the IGSM distributions
drop sharply to 0 at <inline-formula><mml:math id="M164" display="inline"><mml:msqrt><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:msqrt></mml:math></inline-formula> equal to 5  <inline-formula><mml:math id="M165" display="inline"><mml:mrow><mml:mi mathvariant="normal">cm</mml:mi><mml:mspace linebreak="nobreak" width="0.125em"/><mml:msup><mml:mi mathvariant="normal">s</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn><mml:mo>/</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula>.</p>
      <p id="d1e3304">Because the parameters are estimated jointly, identifying the causes for
specific changes in the marginal distributions is not always
straightforward. With this caveat, we now present reasons for the observed
changes in the parameter distributions. We begin with <inline-formula><mml:math id="M166" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula>. As
discussed earlier in this section, changes to both the solar and ozone
forcing lead to a reduction in their contribution to the global radiation
budget. Additionally, there has been a weakening of non-<inline-formula><mml:math id="M167" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">CO</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msub></mml:mrow></mml:math></inline-formula>
greenhouse gas forcing introduced by the new radiation code in MESM. These
factors result in a decrease in the net radiative forcing on the planet. With
the surface temperature and ocean heat content diagnostics unchanged, the
same temperature patterns need to be matched despite the weaker net forcing.
One adjustment to the climate system that can help accomplish the matching is
to increase the forcing from another term in the energy budget. Of the three
model parameters, <inline-formula><mml:math id="M168" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula> is the only one that directly changes the
radiative forcing, and we thus observe the shift towards less negative
aerosol forcing.</p>
      <p id="d1e3340">An explanation similar to that used for the aerosol distribution can be
applied to explaining the observed shifts in the climate sensitivity
distribution. In its most basic sense,<?pagebreak page3320?> climate sensitivity is a temperature
change per unit forcing. When holding the temperature patterns fixed, the
change in temperature is a constant. When explaining the aerosol distribution
above, we implicitly fixed the climate sensitivity, requiring the aerosol
forcing to be less negative to keep the net forcing constant. However, if we
fix <inline-formula><mml:math id="M169" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula>, the same temperature change needs to be realized with the
weaker forcing due to the changes in the solar and ozone forcings. This
implies a higher climate sensitivity is required and explains the shifts we
observe in the ECS marginal distribution.</p>
      <p id="d1e3355">In practice, the model parameters are not independent of each other and can
change simultaneously. Many combinations of higher climate sensitivity and
weaker aerosol forcing lead to similar agreement with the observed
temperature record. This suggests a correlation between these two parameters
and highlights a strength of estimating the joint PDF for the model
parameters: the identification of relationships between the model parameters.
However, these relationships also highlight the challenge in attributing
changes in a single parameter to a specific cause.</p>
      <p id="d1e3358">Unlike the climate sensitivity and aerosol forcing distributions, a clear
physical explanation for the observed changes in the <inline-formula><mml:math id="M170" display="inline"><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> distribution is
more difficult to identify. One reason for this difficulty is the relative
insensitivity of the <inline-formula><mml:math id="M171" display="inline"><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> distribution to the model updates. This suggests
that either the ocean response is insensitive to changes in the model
forcings or that the diagnostics used in this study are unable to constrain
the parameter. The latter is explored in a separate study by the authors
<xref ref-type="bibr" rid="bib1.bibx27" id="paren.54"/>.</p>
      <p id="d1e3386">To evaluate how well the model captures the observed record and demonstrate
the wide range of climate states simulated by the MESM ensemble, we compare
the model output to the observed climate record (Figs. <xref ref-type="fig" rid="Ch1.F6"/>
and <xref ref-type="fig" rid="Ch1.F7"/>). In Fig. <xref ref-type="fig" rid="Ch1.F6"/>, we show the global mean surface
temperature time series for all ensemble members, along with each of the time
series from each of the five observational datasets used in the surface
diagnostic. In Fig. <xref ref-type="fig" rid="Ch1.F7"/>, we compare the linear trend in the 0–3 km
global mean ocean heat content estimated from the MESM simulations against
the observed estimate. For both the surface and ocean comparisons, we
highlight the estimates from the MESM ensemble members which have parameter
settings closest to the median values from the full ensemble MESM
distributions.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F8" specific-use="star"><caption><p id="d1e3399">Model response surfaces for <bold>(a)</bold> TCR and
<bold>(b)</bold> thermosteric sea level rise. Contours for the MESM response
surfaces are shown in black and contours for the IGSM surfaces are shown in
red. Differences between the fits are also shown <bold>(c, d)</bold>.</p></caption>
        <?xmltex \igopts{width=341.433071pt}?><graphic xlink:href="https://gmd.copernicus.org/articles/11/3313/2018/gmd-11-3313-2018-f08.pdf"/>

      </fig>

      <?pagebreak page3322?><p id="d1e3417">For both the surface temperature and ocean heat content trends, we have
sampled many climate states on the colder and warmer sides of the observed
values. We note here that the negative ocean heat content trends are the
result of simulations with strong cooling that lie well outside the
acceptable range of the parameter space. All simulations with this negative
trend have <inline-formula><mml:math id="M172" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula> less than or equal to <inline-formula><mml:math id="M173" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.75</mml:mn></mml:mrow></mml:math></inline-formula> <inline-formula><mml:math id="M174" display="inline"><mml:mrow><mml:mi mathvariant="normal">W</mml:mi><mml:mspace linebreak="nobreak" width="0.125em"/><mml:msup><mml:mi mathvariant="normal">m</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula>, a
zero-probability region in the MESM ensemble. For the global mean surface
temperature time series, the median simulations compare favorably to the
observed time series. For the ocean heat content trend, the median
simulations tend to overestimate the trend compared to the observed value.
Perfect matches should not be expected when comparing the median simulations
to the observations, however. Because we derived the distributions using the
surface and ocean records, only those runs that agree with both diagnostics
are not rejected for being inconsistent with the data. Thus, a model
simulation that reproduces the global mean surface temperature perfectly may
have too little warming in the deep ocean. Similarly, a model with the
perfect ocean heat content trend may not match the surface temperature time
series. Small deficiencies in the median runs compared to a single observed
record are the result of simultaneously matching the surface and ocean
records.</p>
      <p id="d1e3459">To estimate TCR in MESM, we run a 372-member ensemble where all forcings are
held fixed and carbon dioxide concentrations are increased by
1 % year<inline-formula><mml:math id="M175" display="inline"><mml:msup><mml:mi/><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula>. We calculate TCR by estimating the global mean
temperature change from the beginning of the simulation to the time of
<inline-formula><mml:math id="M176" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">CO</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msub></mml:mrow></mml:math></inline-formula> doubling. Concentrations double in year 70 and we estimate TCR as
the average global mean temperature change in years 60–80 of the simulation.
Temperature changes are calculated with respect to a control simulation with
the same model parameters and all forcings held fixed. In a similar manner,
we also estimate thermosteric sea level rise (SLR) at the time of doubling.
Because all forcings except those attributed to <inline-formula><mml:math id="M177" display="inline"><mml:mrow class="chem"><mml:msub><mml:mi mathvariant="normal">CO</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msub></mml:mrow></mml:math></inline-formula> are fixed, each
ECS–<inline-formula><mml:math id="M178" display="inline"><mml:msqrt><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:msqrt></mml:math></inline-formula> pair yields a single TCR value and a single SLR value,
independent of <inline-formula><mml:math id="M179" display="inline"><mml:mrow><mml:msub><mml:mi>F</mml:mi><mml:mtext>aer</mml:mtext></mml:msub></mml:mrow></mml:math></inline-formula>.</p>
      <p id="d1e3519">We fit a third-order polynomial in ECS and <inline-formula><mml:math id="M180" display="inline"><mml:msqrt><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:msqrt></mml:math></inline-formula> to the TCR and SLR
values calculated from each run to derive a functional fit for all parameter
pairs within the domain. The third-order polynomial fit is chosen to be of
the same form as the fits derived for the IGSM model. Further, an
investigation of different order fits (not shown) indicated that at least a
third-order fit is required to satisfactorily fit the data. From the
functional fits, we derive response surfaces for each of the transient
properties (Fig. <xref ref-type="fig" rid="Ch1.F8"/>). For comparison, we also show the fit derived
using the IGSM and its corresponding 1 % year<inline-formula><mml:math id="M181" display="inline"><mml:msup><mml:mi/><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula> runs, in addition
to the differences between the two. Outside of the region where ECS is
greater than 4 <inline-formula><mml:math id="M182" display="inline"><mml:mrow><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:math></inline-formula> and <inline-formula><mml:math id="M183" display="inline"><mml:msqrt><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:msqrt></mml:math></inline-formula> is less than about
0.5 <inline-formula><mml:math id="M184" display="inline"><mml:mrow><mml:mi mathvariant="normal">cm</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:msup><mml:mi mathvariant="normal">s</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn><mml:mo>/</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula> and away from the edges of the domain, TCR values
from IGSM and MESM agree quite well. There is a similar pattern of agreement
in<?pagebreak page3323?> the SLR response surface, with the biggest discrepancies occurring in the
high ECS–high <inline-formula><mml:math id="M185" display="inline"><mml:msqrt><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:msqrt></mml:math></inline-formula> region and near
the edges of the parameter domain.</p>
      <p id="d1e3606">We use the response surface to derive probability distributions for TCR. From
each of the joint probability distributions derived using the subsampled MESM
ensemble, we draw a 1000-member Latin hypercube sample <xref ref-type="bibr" rid="bib1.bibx29" id="paren.55"/> of
model parameters. The subsampled distributions are chosen so that we restrict
the domain to that of the IGSM ensemble, allowing for a more direct
comparison of the distributions. Otherwise, high <inline-formula><mml:math id="M186" display="inline"><mml:msqrt><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:msqrt></mml:math></inline-formula> values that are
within the domain of the functional fit to the MESM runs would be selected,
for which there is no fit using the IGSM function. We map each of the
ECS–<inline-formula><mml:math id="M187" display="inline"><mml:msqrt><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:msqrt></mml:math></inline-formula> pairs onto the response surface to provide an estimate of
TCR values. Binning the responses in a histogram with bin
size of 0.1 <inline-formula><mml:math id="M188" display="inline"><mml:mrow><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:math></inline-formula> allows a PDF to be calculated, and the
resulting cumulative density functions derived using MESM are displayed in
Fig. <xref ref-type="fig" rid="Ch1.F4"/>d. Comparing TCR distributions for the IGSM and MESM
ensembles shows a shift towards higher TCR with the latest results. When
comparing the range of 90 % confidence intervals derived using MESM to
those from <xref ref-type="bibr" rid="bib1.bibx25" id="text.56"/>, we find that TCR estimates increase from
0.87–2.31 <inline-formula><mml:math id="M189" display="inline"><mml:mrow><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:math></inline-formula> using IGSM to 0.90–2.72 <inline-formula><mml:math id="M190" display="inline"><mml:mrow><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:math></inline-formula>
using MESM. We have shown previously that the marginal distributions of
<inline-formula><mml:math id="M191" display="inline"><mml:msqrt><mml:mrow><mml:msub><mml:mi>K</mml:mi><mml:mi>v</mml:mi></mml:msub></mml:mrow></mml:msqrt></mml:math></inline-formula> are similar between the two models, indicating that this shift
towards higher TCR is driven by the higher ECS estimates derived from MESM.</p>
</sec>
<sec id="Ch1.S5" sec-type="conclusions">
  <title>Conclusions</title>
      <p id="d1e3697">In this study, we have provided an open, transparent means of testing the
changes in model response and parameter estimation to changes in the MIT
Integrated Global Systems Model framework. Not only does this systematic
accounting of the impacts give a reference point moving forward for studies
involving MESM, it proposes a template for assessing the impact that changes
in other simplified climate models have on the calibration of their own model
parameters. We hope that this study motivates other modeling groups to
perform similar investigations that provide documented accounts of model
updates, leading to a more robust understanding of the impacts that the
changes have on parameter estimation and model behavior.</p>
      <p id="d1e3700">By updating the model and its input forcings, we identify the impact that the
switch from the MIT Integrated Global Systems Model to the MIT Earth System
Model has on the probability distributions of model parameters. The decreases
in radiative forcing due to the change in radiative forcing code, the new
solar radiation data, and the new ozone concentrations used to estimate the
ozone forcing lead to a net energy deficit when compared to the replaced
forcings. This drives an upward shift in our estimates of the 90 %
confidence interval for climate sensitivity from between 1.2 and
5.3 <inline-formula><mml:math id="M192" display="inline"><mml:mrow><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:math></inline-formula> to between 1.3 and 5.7 <inline-formula><mml:math id="M193" display="inline"><mml:mrow><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:math></inline-formula>, a better
constraint on ocean diffusivity, and a decrease in the 90 % confidence
interval for the net anthropogenic aerosol forcing from between <inline-formula><mml:math id="M194" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.83</mml:mn></mml:mrow></mml:math></inline-formula> and
<inline-formula><mml:math id="M195" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.19</mml:mn></mml:mrow></mml:math></inline-formula> <inline-formula><mml:math id="M196" display="inline"><mml:mrow><mml:mi mathvariant="normal">W</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:msup><mml:mi mathvariant="normal">m</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula> to between <inline-formula><mml:math id="M197" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.53</mml:mn></mml:mrow></mml:math></inline-formula> and <inline-formula><mml:math id="M198" display="inline"><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">0.03</mml:mn></mml:mrow></mml:math></inline-formula> <inline-formula><mml:math id="M199" display="inline"><mml:mrow><mml:mi mathvariant="normal">W</mml:mi><mml:mspace width="0.125em" linebreak="nobreak"/><mml:msup><mml:mi mathvariant="normal">m</mml:mi><mml:mrow><mml:mo>-</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula>.
One caveat of our analysis is that because we changed the forcings and CLM
simultaneously, we cannot fully attribute the parameter shifts to the model
forcings alone. We have thus shown the total effect of changing both the
model and forcings on the parameter distributions, not the effects of the
changes individually.</p>
      <p id="d1e3802">Because TCR is independent of the input forcings, the only difference between
the IGSM and MESM configurations in the transient simulations is the land
surface model. By showing that the transient climate response surfaces
derived from the two models differ only slightly, we provide evidence that
the switch to CLM3.5 does not greatly impact the temperature evolution in the
model. We have drawn Latin hypercube samples from the parameter distributions
to provide estimates of TCR from the new response surface. Due to the shift
towards higher climate sensitivity and slightly weaker ocean diffusivity, we
observe an increase in our 90 % confidence interval of transient climate
response from 0.87–2.31 <inline-formula><mml:math id="M200" display="inline"><mml:mrow><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:math></inline-formula> to 0.85–2.73 <inline-formula><mml:math id="M201" display="inline"><mml:mrow><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup><mml:mi mathvariant="normal">C</mml:mi></mml:mrow></mml:math></inline-formula>.
By investigating the impact that the new forcings and a newer version of CLM
have on the estimates of model parameters and TCR, we have shown the inherent
differences that are present when comparing distributions derived using IGSM
and those derived from MESM.</p>
</sec>

      
      </body>
    <back><notes notes-type="codedataavailability">

      <p id="d1e3833">The source code of MESM will become publicly available
for non-commercial research and educational purposes as soon as a software
license that is being prepared by the MIT Technology Licensing Office is
complete. For further information, contact mesm-request@mit.edu. A working
paper describing and evaluating the MESM is available at
<uri>http://svante.mit.edu/~mesm/publications/MESM-paper.pdf</uri> (last access:
16 August 2018). All data required to reproduce the figures and tables in the
main text and scripts to replicate the figures are available in an online
archive. Model output is available upon request.</p>
  </notes><notes notes-type="authorcontribution">

      <p id="d1e3842">AGL and APS carried out the MESM simulations.
APS wrote the codes for extracting model output. AGL performed the analysis
and prepared the original manuscript. AGL and CEF developed the model
ensemble and experimental design. AGL, CEF, APS, and EM all contributed to
interpreting the analysis and synthesizing the findings.</p>
  </notes><notes notes-type="competinginterests">

      <p id="d1e3848">The authors declare that they have no conflict of
interest.</p>
  </notes><ack><title>Acknowledgements</title><p id="d1e3854">This work was supported by U.S. Department of Energy (DOE), Office of
Science, under award DE-FG02-94ER61937 and other government, industry and
foundation sponsors of the MIT Joint Program on the Science and Policy of
Global<?pagebreak page3324?> Change. For a complete list of sponsors and U.S. government funding
sources, see <uri>https://globalchange.mit.edu/sponsors/current/</uri> (last
access: 16 August 2018). The authors would like to thank the National
Climatic Data Center, the Hadley Centre for Climate Prediction and Research,
and the NASA Goddard Institute for Space Studies for producing publicly
available surface data products, and the NOAA National Centers for
Environmental Information for providing publicly available ocean heat content
data. We would also like to thank the University of Maryland for access to
the Evergreen high-performance computing cluster for model
simulations.<?xmltex \hack{\newline}?><?xmltex \hack{\newline}?> Edited by: David
Lawrence<?xmltex \hack{\newline}?> Reviewed by: two anonymous referees</p></ack><ref-list>
    <title>References</title>

      <ref id="bib1.bibx1"><label>Allen and Frame(2007)</label><mixed-citation>
Allen, M. R. and Frame, D. J.: Call off the quest, Science, 318, 582–583,
2007.</mixed-citation></ref>
      <ref id="bib1.bibx2"><label>Andrews and Allen(2008)</label><mixed-citation>
Andrews, D. G. and Allen, M. R.: Diagnosis of climate models in terms of
transient climate response and feedback response time, Atmos. Sci. Lett., 9,
7–12, 2008.</mixed-citation></ref>
      <ref id="bib1.bibx3"><label>Bony et al.(2006)</label><mixed-citation>
Bony, S., Colman, R., Kattsov, V. M., Allan, R. R., Bretherton, C. S.,
Dufresne, J.-L., Hall, A., Hallegatte, S., Holland, M. M., Ingram, W.,
Randall, D. A., Soden, B. J., Tselioudis, G., and Webb, M. J.: How well do we
understand and evaluate climate change feedback processes?, J. Clim., 19,
3445–3482, 2006.</mixed-citation></ref>
      <ref id="bib1.bibx4"><label>Brohan et al.(2006)</label><mixed-citation>Brohan, P., Kennedy, J. J., Harris, I., Tett, S. F. B., and Jones, P. D.:
Uncertainty estimates in regional and global observed temperature changes: A
new data set from 1850, J. Geophys. Res., 111, D12106, <ext-link xlink:href="https://doi.org/10.1029/2005JD006548" ext-link-type="DOI">10.1029/2005JD006548</ext-link>,
2006.</mixed-citation></ref>
      <ref id="bib1.bibx5"><label>Cionni et al.(2011)</label><mixed-citation>Cionni, I., Eyring, V., Lamarque, J. F., Randel, W. J., Stevenson, D. S., Wu,
F., Bodeker, G. E., Shepherd, T. G., Shindell, D. T., and Waugh, D. W.: Ozone
database in support of CMIP5 simulations: results and corresponding radiative
forcing, Atmos. Chem. Phys., 11, 11267–11292,
<ext-link xlink:href="https://doi.org/10.5194/acp-11-11267-2011" ext-link-type="DOI">10.5194/acp-11-11267-2011</ext-link>, 2011.</mixed-citation></ref>
      <ref id="bib1.bibx6"><label>Conley et al.(2013)</label><mixed-citation>Conley, A. J., Lamarque, J.-F., Vitt, F., Collins, W. D., and Kiehl, J.:
PORT, a CESM tool for the diagnosis of radiative forcing, Geosci. Model Dev.,
6, 469–476, <ext-link xlink:href="https://doi.org/10.5194/gmd-6-469-2013" ext-link-type="DOI">10.5194/gmd-6-469-2013</ext-link>, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx7"><label>Forest et al.(2001)</label><mixed-citation>
Forest, C. E., Allen, M. R., Sokolov, A. P., and Stone, P. H.: Constraining
climate model properties using optimal fingerprint detection methods, Clim.
Dynam., 18, 277–295, 2001.</mixed-citation></ref>
      <ref id="bib1.bibx8"><label>Forest et al.(2002)</label><mixed-citation>
Forest, C. E., Stone, P. H., Sokolov, A. P., Allen, M. R., and Webster, M. D.:
Quantifying uncertainties in climate system properties with the use of recent
climate observations, Science, 295, 113–117, 2002.</mixed-citation></ref>
      <ref id="bib1.bibx9"><label>Forest et al.(2006)</label><mixed-citation>Forest, C. E., Stone, P. H., and Sokolov, A. P.: Estimated PDFs of climate
system properties including natural and anthropogenic forcings, Geophys. Res.
Let., 33, L01705, <ext-link xlink:href="https://doi.org/10.1029/2005GL023977" ext-link-type="DOI">10.1029/2005GL023977</ext-link>, 2006.</mixed-citation></ref>
      <ref id="bib1.bibx10"><label>Forest et al.(2008)</label><mixed-citation>
Forest, C. E., Stone, P. H., and Sokolov, A. P.: Constraining climate model
parameters from observed 20th century changes, Tellus A, 60, 911–920, 2008.</mixed-citation></ref>
      <ref id="bib1.bibx11"><label>Gregory et al.(2002)</label><mixed-citation>
Gregory, J. M., Stouffer, R. J., Raper, S. C. B., Stott, P. A., and Rayner,
N. A.: An observationally based estimate of the climate sensitivity, J.
Climate, 15, 3117–3121, 2002.</mixed-citation></ref>
      <ref id="bib1.bibx12"><label>Hansen et al.(1984)</label><mixed-citation>
Hansen, J., Lacis, A., Rind, D., Russell, G., Stone, P., Fung, I., Ruedy, R.,
and Lerner, J.: Climate sensitivity: Analysis of feedback mechanisms, in:
Climate Processes and Climate Sensitivity, Geophysical Monograph, edited by:
Hansen, J. E. and Takahashi, T., American Geophysical Union, Washington, DC,
vol. 29, 130–163, 1984.</mixed-citation></ref>
      <ref id="bib1.bibx13"><label>Hansen et al.(1988)</label><mixed-citation>
Hansen, J., Lacis, A., Rind, D., Russell, G., Stone, P., Fung, I., Ruedy, R.,
and Stone, P.: Global climate changes as forecast by Goddard Institute for
Space Studies three-dimensional model, J. Geophys. Res., 93, 9341–9364,
1988.</mixed-citation></ref>
      <ref id="bib1.bibx14"><label>Hansen et al.(2007)</label><mixed-citation>Hansen, J., Sato, M., Ruedy, R., Kharecha, P., Lacis, A., Miller, R.,
Nazarenko, L., Lo, K., Schmidt, G., Russell, G., Aleinov, I., Bauer, S.,
Baum, E., Cairns, B., Canuto, V., Chandler, M., Cheng, Y., Cohen, A., Genio,
A. D., Faluvegi, G., Fleming, E., Friend, A., Hall, T., Jackman, C., Jonas,
J., Kelley, M., Kiang, N., Koch, D., Labow, G., Lerner, J., Menon, S.,
Novakov, T., Oinas, V., Perlwitz, J., Perlwitz, J., Rind, D., Romanou, A.,
Schmunk, R., Shindell, D., Stone, P., Sun, S., Streets, D., Tausnev, N.,
Thresher, D., Unger, N., Yao, M., and Zhang, S.: Climate simulations for
1880–2003 with GISS modelE, Clim. Dynam., 29, 661–696,
<ext-link xlink:href="https://doi.org/10.1007/s00382-007-0255-8" ext-link-type="DOI">10.1007/s00382-007-0255-8</ext-link>, 2007.</mixed-citation></ref>
      <ref id="bib1.bibx15"><label>Hansen et al.(2010)</label><mixed-citation>Hansen, J., Ruedy, R., Sato, M., and Lo, K.: Global surface temperature
change, Rev. Geophys., 48, RG4004, <ext-link xlink:href="https://doi.org/10.1029/2010RG000345" ext-link-type="DOI">10.1029/2010RG000345</ext-link>, 2010.</mixed-citation></ref>
      <ref id="bib1.bibx16"><label>Johansson et al.(2015)</label><mixed-citation>
Johansson, D. J. A., O'Neill, B. C., Tebaldi, C., and Haggstrom, O.:
Equilibrium climate sensitivity in light of observations over the warming
hiatus, Nat. Clim. Change, 5, 449–453, 2015.</mixed-citation></ref>
      <ref id="bib1.bibx17"><label>Jones and Moberg(2003)</label><mixed-citation>
Jones, P. and Moberg, A.: Hemispheric and large-scale surface air temperature
variations: An extensive revision and an update to 2001, J. Climate, 16,
206–223, 2003.</mixed-citation></ref>
      <ref id="bib1.bibx18"><label>Klimont et al.(2013)</label><mixed-citation>Klimont, Z., Smith, S. J., and Cofala, J.: The last decade of global
anthropogenic sulfur dioxide: 2000–2011 emissions, Environ. Res. Lett., 8,
014003, <ext-link xlink:href="https://doi.org/10.1088/1748-9326/8/1/014003" ext-link-type="DOI">10.1088/1748-9326/8/1/014003</ext-link>, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx19"><label>Knutti et al.(2003)</label><mixed-citation>
Knutti, R., Stocker, T. F., Joos, F., and Plattner, G.: Probabilistic climate
change projections using neural networks, Clim. Dynam., 21, 257–272, 2003.</mixed-citation></ref>
      <ref id="bib1.bibx20"><label>Kopp and Lean(2011)</label><mixed-citation>Kopp, G. and Lean, J. L.: A new, lower value of total solar irradiance:
Evidence and climate significance, Geophys. Res. Lett., 38, L01706,
<ext-link xlink:href="https://doi.org/10.1029/2010GL045777" ext-link-type="DOI">10.1029/2010GL045777</ext-link>, 2011.</mixed-citation></ref>
      <ref id="bib1.bibx21"><label>Lean(2000)</label><mixed-citation>
Lean, J. L.: Evolution of the sun's spectral irradiance since the Maunder
Minimum, Geophys. Res. Lett., 27, 2425–2428, 2000.</mixed-citation></ref>
      <ref id="bib1.bibx22"><label>Levitus et al.(2005)</label><mixed-citation>Levitus, S., Antonov, J., and Boyer, T.: Warming of the world ocean,
1955–2003, Geophys. Res. Lett., 32, L02604, <ext-link xlink:href="https://doi.org/10.1029/2004GL021592" ext-link-type="DOI">10.1029/2004GL021592</ext-link>, 2005.</mixed-citation></ref>
      <ref id="bib1.bibx23"><label>Lewis(2013)</label><mixed-citation>Lewis, N.: An objective Bayesian improved approach for applying optimal
fingerprint techniques to climate sensitivity, J. Climate, 26, 7414–7429,
<ext-link xlink:href="https://doi.org/10.1175/JCLI-D-12-00473.1" ext-link-type="DOI">10.1175/JCLI-D-12-00473.1</ext-link>, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx24"><label>Lewis and Curry(2014)</label><mixed-citation>Lewis, N. and Curry, J. A.: The implications for climate sensitivity of AR5
forcing and heat uptake estimates, Clim. Dynam., 45, 1009–1023,
<ext-link xlink:href="https://doi.org/10.1007/s00382-014-2342-y" ext-link-type="DOI">10.1007/s00382-014-2342-y</ext-link>, 2014.</mixed-citation></ref>
      <ref id="bib1.bibx25"><label>Libardoni and Forest(2011)</label><mixed-citation>Libardoni, A. G. and Forest, C. E.: Sensitivity of distributions of climate
system properties to the surface temperature dataset, Geophys. Res. Lett.,
38, L22705, <ext-link xlink:href="https://doi.org/10.1029/2011GL049431" ext-link-type="DOI">10.1029/2011GL049431</ext-link>, 2011.</mixed-citation></ref>
      <ref id="bib1.bibx26"><label>Libardoni and Forest(2013)</label><mixed-citation>Libardoni, A. G. and Forest, C. E.: Correction to “Sensitivity of
distributions of climate system properties to the surface<?pagebreak page3325?> temperature data
set”, Geophys. Res. Lett., 40, 2309–2311, <ext-link xlink:href="https://doi.org/10.1002/grl.50480" ext-link-type="DOI">10.1002/grl.50480</ext-link>, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx27"><label>Libardoni et al.(2018)</label><mixed-citation>
Libardoni, A. G., Forest, C. E., Sokolov, A. P., and Monier, E.: Estimates of
climate system properties incorporating recent climate change, Adv. Stat.
Clim. Meteorol. Oceanogr., in review, 2018.</mixed-citation></ref>
      <ref id="bib1.bibx28"><label>Masters(2014)</label><mixed-citation>Masters, T.: Observational estimate of climate sensitivity from changes in
the rate of ocean heat uptake and comparison to CMIP5 models, Clim.
Dynam.,42, 2173–2181, <ext-link xlink:href="https://doi.org/10.1007/s00382-013-1770-4" ext-link-type="DOI">10.1007/s00382-013-1770-4</ext-link>, 2014.</mixed-citation></ref>
      <ref id="bib1.bibx29"><label>McKay et al.(1979)</label><mixed-citation>
McKay, M. D., Beckman, R. J., and Conover, W. J.: A comparison of three methods
for selecting values of input variables in the analysis of output from a
computer code, Technometrics, 21, 239–245, 1979.</mixed-citation></ref>
      <ref id="bib1.bibx30"><label>Miller et al.(2014)</label><mixed-citation>
Miller, R. L., Schmidt, G. A., Nazarenko, L. S., Tausnev, N., Bauer, S. E.,
DelGenio, A. D., Kelley, M., Lo, K. K., Ruedy, R., Shindell, D. T., Aleinov,
I., Bauer, M., Bleck, R., Canuto, V., Chen, Y., Cheng, Y., Clune, T. L.,
Faluvegi, G., Hansen, J. E., Healy, R. J., Kiang, N. Y., Koch, D., Lacis,
A. A., LeGrande, A. N., Lerner, J., Menon, S., Oinas, V., Garcia-Pando,
C. P., Perlwitz, J. P., Puma, M. J., Rind, D., Romanou, A., Russell, G. L.,
Sato, M., Sun, S., Tsigaridis, K., Unger, N., Voulgarakis, A., Yao, M.-S.,
and Zhang, J.: CMIP5 historical simulations (1850–2012) with GISS
ModelE2, J. Adv. Model. Earth Syst., 6, 441–477, 2014.</mixed-citation></ref>
      <ref id="bib1.bibx31"><label>Oleson et al.(2008)</label><mixed-citation>Oleson, K. W., Niu, G.-Y., Yang, Z.-L., Lawrence, D. M., Thornton, P. E.,
Lawrence, P. J., Stockli, R., Dickinson, R. E., Bonan, G. B., Levis, S., Dai,
A., and Qian, T.: Improvements to the Community Land Model and their impact
on the hydrological cycle, J. Geophys. Res., 113, G01021,
<ext-link xlink:href="https://doi.org/10.1029/2007JG000563" ext-link-type="DOI">10.1029/2007JG000563</ext-link>, 2008.</mixed-citation></ref>
      <ref id="bib1.bibx32"><label>Olson et al.(2013)</label><mixed-citation>
Olson, R., Sriver, R., Chang, W., Haran, M., Urban, N. M., and Keller, K.:
What is the effect of unresolved internal climate variability on climate
sensitivity estimates?, J. Geophys. Res.-Atmos., 118, 4348–4358, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx33"><label>Otto et al.(2013)</label><mixed-citation>
Otto, A., Otto, F. E. L., Boucher, O., Church, J., Hegerl, G., Forster,
P. M., Gillett, N. P., Gregory, J., Johnson, G. C., Knutti, R., Lewis, N.,
Lohmann, U., Marotzke, J., Myhre, G., Shindell, D., Stevens, B., and Allen,
M. R.: Energy budget constraints on climate response, Nat. Geosci., 6,
415–416, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx34"><label>Sato et al.(1993)</label><mixed-citation>
Sato, M., Hansen, J. E., McCormick, M. P., and Pollack, J. B.: Stratospheric
aerosol optical depths, J. Geophys. Res., 98, 22987–22944, 1993.</mixed-citation></ref>
      <ref id="bib1.bibx35"><label>Smith et al.(2011)</label><mixed-citation>Smith, S. J., van Aardenne, J., Klimont, Z., Andres, R. J., Volke, A., and
Delgado Arias, S.: Anthropogenic sulfur dioxide emissions: 1850–2005, Atmos.
Chem. Phys., 11, 1101–1116, <ext-link xlink:href="https://doi.org/10.5194/acp-11-1101-2011" ext-link-type="DOI">10.5194/acp-11-1101-2011</ext-link>,
2011.</mixed-citation></ref><?xmltex \hack{\newpage}?>
      <ref id="bib1.bibx36"><label>Smith et al.(2008)</label><mixed-citation>
Smith, T. M., Reynolds, R. W., Peterson, T. C., and Lawrimore, J.:
Improvements to NOAA's historical merged land-ocean surface temperature
analysis (1880–2006), J. Climate, 21, 2283–2296, 2008.</mixed-citation></ref>
      <ref id="bib1.bibx37"><label>Sokolov et al.(2005)</label><mixed-citation>
Sokolov, A., Schlosser, C., Dutkiewicz, S., Paltsev, S., Kicklighter, D.,
Jacoby, H., Prinn, R., Forest, C., Reilly, J., Wang, C., Felzer, B., Sarofim,
M., Scott, J., Stone, P., Melillo, J., and Cohen, J.: The MIT Integrated
Global System Model (IGSM) Version 2: Model Description and Baseline
Evaluation, Joint Program Report Series, Report 124, 40 pp., 2005.</mixed-citation></ref>
      <ref id="bib1.bibx38"><label>Sokolov et al.(2018)</label><mixed-citation>Sokolov, A., Kicklighter, D., Schlosser, A., Wang, C., Monier, E.,
Brown-Steiner, B., Prinn, R., Forest, C., Gao, X., Libardoni, A., and
Eastham, S.: Description and evaluation of the MIT Earth System Model (MESM),
J. Adv. Model Earth Sy., accepted, <ext-link xlink:href="https://doi.org/10.1029/2018MS001277" ext-link-type="DOI">10.1029/2018MS001277</ext-link>, 2018.</mixed-citation></ref>
      <ref id="bib1.bibx39"><label>Sokolov(2006)</label><mixed-citation>Sokolov, A. P.: Does model sensitivity to changes in CO<inline-formula><mml:math id="M202" display="inline"><mml:msub><mml:mi/><mml:mn mathvariant="normal">2</mml:mn></mml:msub></mml:math></inline-formula> provide a
measure of sensitivity to other forcings?, J. Climate, 19, 3294–3306, 2006.</mixed-citation></ref>
      <ref id="bib1.bibx40"><label>Sokolov and Monier(2012)</label><mixed-citation>
Sokolov, A. P. and Monier, E.: Changing the climate sensitivity of an
atmospheric general circulation model through cloud radiative adjustment, J.
Climate, 25, 6567–6584, 2012.</mixed-citation></ref>
      <ref id="bib1.bibx41"><label>Sokolov and Stone(1998)</label><mixed-citation>
Sokolov, A. P. and Stone, P. H.: A flexible climate model for use in
integrated assessments, Clim. Dynam., 14, 291–303, 1998.</mixed-citation></ref>
      <ref id="bib1.bibx42"><label>Sokolov et al.(2003)Sokolov, Forest, and Stone</label><mixed-citation>
Sokolov, A. P., Forest, C. E., and Stone, P. H.: Comparing oceanic heat
uptake in AOGCM transient climate change experiments, J. Climate, 16,
1573–1582, 2003.</mixed-citation></ref>
      <ref id="bib1.bibx43"><label>Stevenson et al.(2013)</label><mixed-citation>Stevenson, D. S., Young, P. J., Naik, V., Lamarque, J.-F., Shindell, D. T.,
Voulgarakis, A., Skeie, R. B., Dalsoren, S. B., Myhre, G., Berntsen, T. K.,
Folberth, G. A., Rumbold, S. T., Collins, W. J., MacKenzie, I. A., Doherty,
R. M., Zeng, G., van Noije, T. P. C., Strunk, A., Bergmann, D.,
Cameron-Smith, P., Plummer, D. A., Strode, S. A., Horowitz, L., Lee, Y. H.,
Szopa, S., Sudo, K., Nagashima, T., Josse, B., Cionni, I., Righi, M., Eyring,
V., Conley, A., Bowman, K. W., Wild, O., and Archibald, A.: Tropospheric
ozone changes, radiative forcing and attribution to emissions in the
Atmospheric Chemistry and Climate Model Intercomparison Project (ACCMIP),
Atmos. Chem. Phys., 13, 3063–3085, <ext-link xlink:href="https://doi.org/10.5194/acp-13-3063-2013" ext-link-type="DOI">10.5194/acp-13-3063-2013</ext-link>,
2013</mixed-citation></ref>
      <ref id="bib1.bibx44"><label>Urban and Keller(2009)</label><mixed-citation>Urban, N. M. and Keller, K.: Complementary observational constraints on
climate sensitivity, Geophys. Res. Lett., 36, L04708,
<ext-link xlink:href="https://doi.org/10.1029/2008GL036457" ext-link-type="DOI">10.1029/2008GL036457</ext-link>, 2009.</mixed-citation></ref>

  </ref-list></back>
    <!--<article-title-html>Baseline evaluation of the impact of updates to the MIT Earth System Model on its model parameter estimates</article-title-html>
<abstract-html><p>For over 20 years, the Massachusetts Institute of Technology Earth System
Model (MESM) has been used extensively for climate change research. The model
is under continuous development with components being added and updated. To
provide transparency in the model development, we perform a baseline
evaluation by comparing model behavior and properties in the newest version
to the previous model version. In particular, changes resulting from updates
to the land surface model component and the input forcings used in historical
simulations of climate change are investigated. We run an 1800-member
ensemble of MESM historical climate simulations where the model parameters
that set climate sensitivity, the rate of ocean heat uptake, and the net
anthropogenic aerosol forcing are systematically varied. By comparing model
output to observed patterns of surface temperature changes and the linear
trend in the increase in ocean heat content, we derive probability
distributions for the three model parameters. Furthermore, we run a
372-member ensemble of transient climate simulations where all model forcings
are fixed and carbon dioxide concentrations are increased at the rate of
1&thinsp;%&thinsp;year<sup>−1</sup>. From these runs, we derive response surfaces for
transient climate response and thermosteric sea level rise as a function of
climate sensitivity and ocean heat uptake. We show that the probability
distributions shift towards higher climate sensitivities and weaker aerosol
forcing when using the new model and that the climate response surfaces are
relatively unchanged between model versions. Because the response surfaces
are independent of the changes to the model forcings and similar between
model versions with different land surface models, we suggest that the change
in land surface model has limited impact on the temperature evolution in the
model. Thus, we attribute the shifts in parameter estimates to the updated
model forcings.</p></abstract-html>
<ref-html id="bib1.bib1"><label>Allen and Frame(2007)</label><mixed-citation>
Allen, M. R. and Frame, D. J.: Call off the quest, Science, 318, 582–583,
2007.
</mixed-citation></ref-html>
<ref-html id="bib1.bib2"><label>Andrews and Allen(2008)</label><mixed-citation>
Andrews, D. G. and Allen, M. R.: Diagnosis of climate models in terms of
transient climate response and feedback response time, Atmos. Sci. Lett., 9,
7–12, 2008.
</mixed-citation></ref-html>
<ref-html id="bib1.bib3"><label>Bony et al.(2006)</label><mixed-citation>
Bony, S., Colman, R., Kattsov, V. M., Allan, R. R., Bretherton, C. S.,
Dufresne, J.-L., Hall, A., Hallegatte, S., Holland, M. M., Ingram, W.,
Randall, D. A., Soden, B. J., Tselioudis, G., and Webb, M. J.: How well do we
understand and evaluate climate change feedback processes?, J. Clim., 19,
3445–3482, 2006.
</mixed-citation></ref-html>
<ref-html id="bib1.bib4"><label>Brohan et al.(2006)</label><mixed-citation>
Brohan, P., Kennedy, J. J., Harris, I., Tett, S. F. B., and Jones, P. D.:
Uncertainty estimates in regional and global observed temperature changes: A
new data set from 1850, J. Geophys. Res., 111, D12106, <a href="https://doi.org/10.1029/2005JD006548" target="_blank">https://doi.org/10.1029/2005JD006548</a>,
2006.
</mixed-citation></ref-html>
<ref-html id="bib1.bib5"><label>Cionni et al.(2011)</label><mixed-citation>
Cionni, I., Eyring, V., Lamarque, J. F., Randel, W. J., Stevenson, D. S., Wu,
F., Bodeker, G. E., Shepherd, T. G., Shindell, D. T., and Waugh, D. W.: Ozone
database in support of CMIP5 simulations: results and corresponding radiative
forcing, Atmos. Chem. Phys., 11, 11267–11292,
<a href="https://doi.org/10.5194/acp-11-11267-2011" target="_blank">https://doi.org/10.5194/acp-11-11267-2011</a>, 2011.
</mixed-citation></ref-html>
<ref-html id="bib1.bib6"><label>Conley et al.(2013)</label><mixed-citation>
Conley, A. J., Lamarque, J.-F., Vitt, F., Collins, W. D., and Kiehl, J.:
PORT, a CESM tool for the diagnosis of radiative forcing, Geosci. Model Dev.,
6, 469–476, <a href="https://doi.org/10.5194/gmd-6-469-2013" target="_blank">https://doi.org/10.5194/gmd-6-469-2013</a>, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib7"><label>Forest et al.(2001)</label><mixed-citation>
Forest, C. E., Allen, M. R., Sokolov, A. P., and Stone, P. H.: Constraining
climate model properties using optimal fingerprint detection methods, Clim.
Dynam., 18, 277–295, 2001.
</mixed-citation></ref-html>
<ref-html id="bib1.bib8"><label>Forest et al.(2002)</label><mixed-citation>
Forest, C. E., Stone, P. H., Sokolov, A. P., Allen, M. R., and Webster, M. D.:
Quantifying uncertainties in climate system properties with the use of recent
climate observations, Science, 295, 113–117, 2002.
</mixed-citation></ref-html>
<ref-html id="bib1.bib9"><label>Forest et al.(2006)</label><mixed-citation>
Forest, C. E., Stone, P. H., and Sokolov, A. P.: Estimated PDFs of climate
system properties including natural and anthropogenic forcings, Geophys. Res.
Let., 33, L01705, <a href="https://doi.org/10.1029/2005GL023977" target="_blank">https://doi.org/10.1029/2005GL023977</a>, 2006.
</mixed-citation></ref-html>
<ref-html id="bib1.bib10"><label>Forest et al.(2008)</label><mixed-citation>
Forest, C. E., Stone, P. H., and Sokolov, A. P.: Constraining climate model
parameters from observed 20th century changes, Tellus A, 60, 911–920, 2008.
</mixed-citation></ref-html>
<ref-html id="bib1.bib11"><label>Gregory et al.(2002)</label><mixed-citation>
Gregory, J. M., Stouffer, R. J., Raper, S. C. B., Stott, P. A., and Rayner,
N. A.: An observationally based estimate of the climate sensitivity, J.
Climate, 15, 3117–3121, 2002.
</mixed-citation></ref-html>
<ref-html id="bib1.bib12"><label>Hansen et al.(1984)</label><mixed-citation>
Hansen, J., Lacis, A., Rind, D., Russell, G., Stone, P., Fung, I., Ruedy, R.,
and Lerner, J.: Climate sensitivity: Analysis of feedback mechanisms, in:
Climate Processes and Climate Sensitivity, Geophysical Monograph, edited by:
Hansen, J. E. and Takahashi, T., American Geophysical Union, Washington, DC,
vol. 29, 130–163, 1984.
</mixed-citation></ref-html>
<ref-html id="bib1.bib13"><label>Hansen et al.(1988)</label><mixed-citation>
Hansen, J., Lacis, A., Rind, D., Russell, G., Stone, P., Fung, I., Ruedy, R.,
and Stone, P.: Global climate changes as forecast by Goddard Institute for
Space Studies three-dimensional model, J. Geophys. Res., 93, 9341–9364,
1988.
</mixed-citation></ref-html>
<ref-html id="bib1.bib14"><label>Hansen et al.(2007)</label><mixed-citation>
Hansen, J., Sato, M., Ruedy, R., Kharecha, P., Lacis, A., Miller, R.,
Nazarenko, L., Lo, K., Schmidt, G., Russell, G., Aleinov, I., Bauer, S.,
Baum, E., Cairns, B., Canuto, V., Chandler, M., Cheng, Y., Cohen, A., Genio,
A. D., Faluvegi, G., Fleming, E., Friend, A., Hall, T., Jackman, C., Jonas,
J., Kelley, M., Kiang, N., Koch, D., Labow, G., Lerner, J., Menon, S.,
Novakov, T., Oinas, V., Perlwitz, J., Perlwitz, J., Rind, D., Romanou, A.,
Schmunk, R., Shindell, D., Stone, P., Sun, S., Streets, D., Tausnev, N.,
Thresher, D., Unger, N., Yao, M., and Zhang, S.: Climate simulations for
1880–2003 with GISS modelE, Clim. Dynam., 29, 661–696,
<a href="https://doi.org/10.1007/s00382-007-0255-8" target="_blank">https://doi.org/10.1007/s00382-007-0255-8</a>, 2007.
</mixed-citation></ref-html>
<ref-html id="bib1.bib15"><label>Hansen et al.(2010)</label><mixed-citation>
Hansen, J., Ruedy, R., Sato, M., and Lo, K.: Global surface temperature
change, Rev. Geophys., 48, RG4004, <a href="https://doi.org/10.1029/2010RG000345" target="_blank">https://doi.org/10.1029/2010RG000345</a>, 2010.
</mixed-citation></ref-html>
<ref-html id="bib1.bib16"><label>Johansson et al.(2015)</label><mixed-citation>
Johansson, D. J. A., O'Neill, B. C., Tebaldi, C., and Haggstrom, O.:
Equilibrium climate sensitivity in light of observations over the warming
hiatus, Nat. Clim. Change, 5, 449–453, 2015.
</mixed-citation></ref-html>
<ref-html id="bib1.bib17"><label>Jones and Moberg(2003)</label><mixed-citation>
Jones, P. and Moberg, A.: Hemispheric and large-scale surface air temperature
variations: An extensive revision and an update to 2001, J. Climate, 16,
206–223, 2003.
</mixed-citation></ref-html>
<ref-html id="bib1.bib18"><label>Klimont et al.(2013)</label><mixed-citation>
Klimont, Z., Smith, S. J., and Cofala, J.: The last decade of global
anthropogenic sulfur dioxide: 2000–2011 emissions, Environ. Res. Lett., 8,
014003, <a href="https://doi.org/10.1088/1748-9326/8/1/014003" target="_blank">https://doi.org/10.1088/1748-9326/8/1/014003</a>, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib19"><label>Knutti et al.(2003)</label><mixed-citation>
Knutti, R., Stocker, T. F., Joos, F., and Plattner, G.: Probabilistic climate
change projections using neural networks, Clim. Dynam., 21, 257–272, 2003.
</mixed-citation></ref-html>
<ref-html id="bib1.bib20"><label>Kopp and Lean(2011)</label><mixed-citation>
Kopp, G. and Lean, J. L.: A new, lower value of total solar irradiance:
Evidence and climate significance, Geophys. Res. Lett., 38, L01706,
<a href="https://doi.org/10.1029/2010GL045777" target="_blank">https://doi.org/10.1029/2010GL045777</a>, 2011.
</mixed-citation></ref-html>
<ref-html id="bib1.bib21"><label>Lean(2000)</label><mixed-citation>
Lean, J. L.: Evolution of the sun's spectral irradiance since the Maunder
Minimum, Geophys. Res. Lett., 27, 2425–2428, 2000.
</mixed-citation></ref-html>
<ref-html id="bib1.bib22"><label>Levitus et al.(2005)</label><mixed-citation>
Levitus, S., Antonov, J., and Boyer, T.: Warming of the world ocean,
1955–2003, Geophys. Res. Lett., 32, L02604, <a href="https://doi.org/10.1029/2004GL021592" target="_blank">https://doi.org/10.1029/2004GL021592</a>, 2005.
</mixed-citation></ref-html>
<ref-html id="bib1.bib23"><label>Lewis(2013)</label><mixed-citation>
Lewis, N.: An objective Bayesian improved approach for applying optimal
fingerprint techniques to climate sensitivity, J. Climate, 26, 7414–7429,
<a href="https://doi.org/10.1175/JCLI-D-12-00473.1" target="_blank">https://doi.org/10.1175/JCLI-D-12-00473.1</a>, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib24"><label>Lewis and Curry(2014)</label><mixed-citation>
Lewis, N. and Curry, J. A.: The implications for climate sensitivity of AR5
forcing and heat uptake estimates, Clim. Dynam., 45, 1009–1023,
<a href="https://doi.org/10.1007/s00382-014-2342-y" target="_blank">https://doi.org/10.1007/s00382-014-2342-y</a>, 2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib25"><label>Libardoni and Forest(2011)</label><mixed-citation>
Libardoni, A. G. and Forest, C. E.: Sensitivity of distributions of climate
system properties to the surface temperature dataset, Geophys. Res. Lett.,
38, L22705, <a href="https://doi.org/10.1029/2011GL049431" target="_blank">https://doi.org/10.1029/2011GL049431</a>, 2011.
</mixed-citation></ref-html>
<ref-html id="bib1.bib26"><label>Libardoni and Forest(2013)</label><mixed-citation>
Libardoni, A. G. and Forest, C. E.: Correction to “Sensitivity of
distributions of climate system properties to the surface temperature data
set”, Geophys. Res. Lett., 40, 2309–2311, <a href="https://doi.org/10.1002/grl.50480" target="_blank">https://doi.org/10.1002/grl.50480</a>, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib27"><label>Libardoni et al.(2018)</label><mixed-citation>
Libardoni, A. G., Forest, C. E., Sokolov, A. P., and Monier, E.: Estimates of
climate system properties incorporating recent climate change, Adv. Stat.
Clim. Meteorol. Oceanogr., in review, 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib28"><label>Masters(2014)</label><mixed-citation>
Masters, T.: Observational estimate of climate sensitivity from changes in
the rate of ocean heat uptake and comparison to CMIP5 models, Clim.
Dynam.,42, 2173–2181, <a href="https://doi.org/10.1007/s00382-013-1770-4" target="_blank">https://doi.org/10.1007/s00382-013-1770-4</a>, 2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib29"><label>McKay et al.(1979)</label><mixed-citation>
McKay, M. D., Beckman, R. J., and Conover, W. J.: A comparison of three methods
for selecting values of input variables in the analysis of output from a
computer code, Technometrics, 21, 239–245, 1979.
</mixed-citation></ref-html>
<ref-html id="bib1.bib30"><label>Miller et al.(2014)</label><mixed-citation>
Miller, R. L., Schmidt, G. A., Nazarenko, L. S., Tausnev, N., Bauer, S. E.,
DelGenio, A. D., Kelley, M., Lo, K. K., Ruedy, R., Shindell, D. T., Aleinov,
I., Bauer, M., Bleck, R., Canuto, V., Chen, Y., Cheng, Y., Clune, T. L.,
Faluvegi, G., Hansen, J. E., Healy, R. J., Kiang, N. Y., Koch, D., Lacis,
A. A., LeGrande, A. N., Lerner, J., Menon, S., Oinas, V., Garcia-Pando,
C. P., Perlwitz, J. P., Puma, M. J., Rind, D., Romanou, A., Russell, G. L.,
Sato, M., Sun, S., Tsigaridis, K., Unger, N., Voulgarakis, A., Yao, M.-S.,
and Zhang, J.: CMIP5 historical simulations (1850–2012) with GISS
ModelE2, J. Adv. Model. Earth Syst., 6, 441–477, 2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib31"><label>Oleson et al.(2008)</label><mixed-citation>
Oleson, K. W., Niu, G.-Y., Yang, Z.-L., Lawrence, D. M., Thornton, P. E.,
Lawrence, P. J., Stockli, R., Dickinson, R. E., Bonan, G. B., Levis, S., Dai,
A., and Qian, T.: Improvements to the Community Land Model and their impact
on the hydrological cycle, J. Geophys. Res., 113, G01021,
<a href="https://doi.org/10.1029/2007JG000563" target="_blank">https://doi.org/10.1029/2007JG000563</a>, 2008.
</mixed-citation></ref-html>
<ref-html id="bib1.bib32"><label>Olson et al.(2013)</label><mixed-citation>
Olson, R., Sriver, R., Chang, W., Haran, M., Urban, N. M., and Keller, K.:
What is the effect of unresolved internal climate variability on climate
sensitivity estimates?, J. Geophys. Res.-Atmos., 118, 4348–4358, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib33"><label>Otto et al.(2013)</label><mixed-citation>
Otto, A., Otto, F. E. L., Boucher, O., Church, J., Hegerl, G., Forster,
P. M., Gillett, N. P., Gregory, J., Johnson, G. C., Knutti, R., Lewis, N.,
Lohmann, U., Marotzke, J., Myhre, G., Shindell, D., Stevens, B., and Allen,
M. R.: Energy budget constraints on climate response, Nat. Geosci., 6,
415–416, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib34"><label>Sato et al.(1993)</label><mixed-citation>
Sato, M., Hansen, J. E., McCormick, M. P., and Pollack, J. B.: Stratospheric
aerosol optical depths, J. Geophys. Res., 98, 22987–22944, 1993.
</mixed-citation></ref-html>
<ref-html id="bib1.bib35"><label>Smith et al.(2011)</label><mixed-citation>
Smith, S. J., van Aardenne, J., Klimont, Z., Andres, R. J., Volke, A., and
Delgado Arias, S.: Anthropogenic sulfur dioxide emissions: 1850–2005, Atmos.
Chem. Phys., 11, 1101–1116, <a href="https://doi.org/10.5194/acp-11-1101-2011" target="_blank">https://doi.org/10.5194/acp-11-1101-2011</a>,
2011.
</mixed-citation></ref-html>
<ref-html id="bib1.bib36"><label>Smith et al.(2008)</label><mixed-citation>
Smith, T. M., Reynolds, R. W., Peterson, T. C., and Lawrimore, J.:
Improvements to NOAA's historical merged land-ocean surface temperature
analysis (1880–2006), J. Climate, 21, 2283–2296, 2008.
</mixed-citation></ref-html>
<ref-html id="bib1.bib37"><label>Sokolov et al.(2005)</label><mixed-citation>
Sokolov, A., Schlosser, C., Dutkiewicz, S., Paltsev, S., Kicklighter, D.,
Jacoby, H., Prinn, R., Forest, C., Reilly, J., Wang, C., Felzer, B., Sarofim,
M., Scott, J., Stone, P., Melillo, J., and Cohen, J.: The MIT Integrated
Global System Model (IGSM) Version 2: Model Description and Baseline
Evaluation, Joint Program Report Series, Report 124, 40 pp., 2005.
</mixed-citation></ref-html>
<ref-html id="bib1.bib38"><label>Sokolov et al.(2018)</label><mixed-citation>
Sokolov, A., Kicklighter, D., Schlosser, A., Wang, C., Monier, E.,
Brown-Steiner, B., Prinn, R., Forest, C., Gao, X., Libardoni, A., and
Eastham, S.: Description and evaluation of the MIT Earth System Model (MESM),
J. Adv. Model Earth Sy., accepted, <a href="https://doi.org/10.1029/2018MS001277" target="_blank">https://doi.org/10.1029/2018MS001277</a>, 2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib39"><label>Sokolov(2006)</label><mixed-citation>
Sokolov, A. P.: Does model sensitivity to changes in CO<sub>2</sub> provide a
measure of sensitivity to other forcings?, J. Climate, 19, 3294–3306, 2006.
</mixed-citation></ref-html>
<ref-html id="bib1.bib40"><label>Sokolov and Monier(2012)</label><mixed-citation>
Sokolov, A. P. and Monier, E.: Changing the climate sensitivity of an
atmospheric general circulation model through cloud radiative adjustment, J.
Climate, 25, 6567–6584, 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib41"><label>Sokolov and Stone(1998)</label><mixed-citation>
Sokolov, A. P. and Stone, P. H.: A flexible climate model for use in
integrated assessments, Clim. Dynam., 14, 291–303, 1998.
</mixed-citation></ref-html>
<ref-html id="bib1.bib42"><label>Sokolov et al.(2003)Sokolov, Forest, and Stone</label><mixed-citation>
Sokolov, A. P., Forest, C. E., and Stone, P. H.: Comparing oceanic heat
uptake in AOGCM transient climate change experiments, J. Climate, 16,
1573–1582, 2003.
</mixed-citation></ref-html>
<ref-html id="bib1.bib43"><label>Stevenson et al.(2013)</label><mixed-citation>
Stevenson, D. S., Young, P. J., Naik, V., Lamarque, J.-F., Shindell, D. T.,
Voulgarakis, A., Skeie, R. B., Dalsoren, S. B., Myhre, G., Berntsen, T. K.,
Folberth, G. A., Rumbold, S. T., Collins, W. J., MacKenzie, I. A., Doherty,
R. M., Zeng, G., van Noije, T. P. C., Strunk, A., Bergmann, D.,
Cameron-Smith, P., Plummer, D. A., Strode, S. A., Horowitz, L., Lee, Y. H.,
Szopa, S., Sudo, K., Nagashima, T., Josse, B., Cionni, I., Righi, M., Eyring,
V., Conley, A., Bowman, K. W., Wild, O., and Archibald, A.: Tropospheric
ozone changes, radiative forcing and attribution to emissions in the
Atmospheric Chemistry and Climate Model Intercomparison Project (ACCMIP),
Atmos. Chem. Phys., 13, 3063–3085, <a href="https://doi.org/10.5194/acp-13-3063-2013" target="_blank">https://doi.org/10.5194/acp-13-3063-2013</a>,
2013
</mixed-citation></ref-html>
<ref-html id="bib1.bib44"><label>Urban and Keller(2009)</label><mixed-citation>
Urban, N. M. and Keller, K.: Complementary observational constraints on
climate sensitivity, Geophys. Res. Lett., 36, L04708,
<a href="https://doi.org/10.1029/2008GL036457" target="_blank">https://doi.org/10.1029/2008GL036457</a>, 2009.
</mixed-citation></ref-html>--></article>
