<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "https://jats.nlm.nih.gov/nlm-dtd/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="3.0" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher">GMD</journal-id>
<journal-title-group>
<journal-title>Geoscientific Model Development</journal-title>
<abbrev-journal-title abbrev-type="publisher">GMD</abbrev-journal-title>
<abbrev-journal-title abbrev-type="nlm-ta">Geosci. Model Dev.</abbrev-journal-title>
</journal-title-group>
<issn pub-type="epub">1991-9603</issn>
<publisher><publisher-name>Copernicus Publications</publisher-name>
<publisher-loc>Göttingen, Germany</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.5194/gmd-6-583-2013</article-id>
<title-group>
<article-title>Improving computational efficiency in large linear inverse problems: an example from carbon dioxide flux estimation</article-title>
</title-group>
<contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Yadav</surname>
<given-names>V.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Michalak</surname>
<given-names>A. M.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
</contrib-group><aff id="aff1">
<label>1</label>
<addr-line>Department of Global Ecology, Carnegie Institution for Science, Stanford, California, 94305, USA</addr-line>
</aff>
<pub-date pub-type="epub">
<day>03</day>
<month>05</month>
<year>2013</year>
</pub-date>
<volume>6</volume>
<issue>3</issue>
<fpage>583</fpage>
<lpage>590</lpage>
<permissions>
<copyright-statement>Copyright: &#x000a9; 2013 V. Yadav</copyright-statement>
<copyright-year>2013</copyright-year>
<license license-type="open-access">
<license-p>This work is licensed under the Creative Commons Attribution 3.0 Unported License. To view a copy of this licence, visit <ext-link ext-link-type="uri"  xlink:href="https://creativecommons.org/licenses/by/3.0/">https://creativecommons.org/licenses/by/3.0/</ext-link></license-p>
</license>
</permissions>
<self-uri xlink:href="https://gmd.copernicus.org/articles/6/583/2013/gmd-6-583-2013.html">This article is available from https://gmd.copernicus.org/articles/6/583/2013/gmd-6-583-2013.html</self-uri>
<self-uri xlink:href="https://gmd.copernicus.org/articles/6/583/2013/gmd-6-583-2013.pdf">The full text article is available as a PDF file from https://gmd.copernicus.org/articles/6/583/2013/gmd-6-583-2013.pdf</self-uri>
<abstract>
<p>Addressing a variety of questions within Earth science disciplines entails
the inference of the spatiotemporal distribution of parameters of interest
based on observations of related quantities. Such estimation problems often
represent inverse problems that are formulated as linear optimization
problems. Computational limitations arise when the number of observations
and/or the size of the discretized state space becomes large, especially if
the inverse problem is formulated in a probabilistic framework and therefore
aims to assess the uncertainty associated with the estimates. This work
proposes two approaches to lower the computational costs and memory
requirements for large linear space–time inverse problems, taking the
Bayesian approach for estimating carbon dioxide (CO&lt;sub&gt;2&lt;/sub&gt;) emissions and uptake
(a.k.a. fluxes) as a prototypical example. The first algorithm can be used
to efficiently multiply two matrices, as long as one can be expressed as a
Kronecker product of two smaller matrices, a condition that is typical when
multiplying a sensitivity matrix by a covariance matrix in the solution of
inverse problems. The second algorithm can be used to compute a posteriori uncertainties
directly at aggregated spatiotemporal scales, which are the scales of most
interest in many inverse problems. Both algorithms have significantly lower
memory requirements and computational complexity relative to direct
computation of the same quantities (O(&lt;i&gt;n&lt;/i&gt;&lt;sup&gt;2.5&lt;/sup&gt;) vs. O(&lt;i&gt;n&lt;/i&gt;&lt;sup&gt;3&lt;/sup&gt;)). For an
examined benchmark problem, the two algorithms yielded massive savings in
floating point operations relative to direct computation of the same
quantities. Sample computer codes are provided for assessing the
computational and memory efficiency of the proposed algorithms for matrices
of different dimensions.</p>
</abstract>
<counts><page-count count="8"/></counts>
</article-meta>
</front>
<body/>
<back>
<ref-list>
<title>References</title>
<ref id="ref1">
<label>1</label><mixed-citation publication-type="other" xlink:type="simple">Aster, R. C., Borchers, B., and Thurber, C. H.: Parameter estimation and inverse problems, Academic Press, 376 pp., 2013.</mixed-citation>
</ref>
<ref id="ref2">
<label>2</label><mixed-citation publication-type="other" xlink:type="simple">Atmadja, J. and Bagtzoglou, A. C.: State of the art report on mathematical methods for groundwater pollution source identification, Environ. Forensics, 2, 205–214, 2001.</mixed-citation>
</ref>
<ref id="ref3">
<label>3</label><mixed-citation publication-type="other" xlink:type="simple">Bennett, A. F.: Inverse modeling of the ocean and atmosphere, Cambridge University Press, Cambridge, UK, 2002.</mixed-citation>
</ref>
<ref id="ref4">
<label>4</label><mixed-citation publication-type="other" xlink:type="simple">Bini, D. and Lotti, G.: Stability of Fast Algorithms for Matrix Multiplication, Numer. Math., 36, 63–72, &lt;a href=&quot;http://dx.doi.org/10.1007/bf01395989&quot;&gt;https://doi.org/10.1007/bf01395989&lt;/a&gt;, 1980.</mixed-citation>
</ref>
<ref id="ref5">
<label>5</label><mixed-citation publication-type="other" xlink:type="simple">Bini, D.: Fast Matrix Multiplication, in: Handbook of Linear Algebra, edited by: Hogben, L., Discrete Mathematics and its Applications, Chapman &amp; Hall/CRC, Boca Raton, 47–41 to 47–12, 2010.</mixed-citation>
</ref>
<ref id="ref6">
<label>6</label><mixed-citation publication-type="other" xlink:type="simple">Blackford, L. S., Demmel, J., Dongarra, J., Duff, I., Hammarling, S., Henry, G., Heroux, M., Kaufman, L., Lumsdaine, A., Petitet, A., Pozo, R., Remington, K., and Whaley, R. C.: An updated set of Basic Linear Algebra Subprograms (BLAS), ACM Trans. Math. Softw., 28, 135–151, &lt;a href=&quot;http://dx.doi.org/10.1145/567806.567807&quot;&gt;https://doi.org/10.1145/567806.567807&lt;/a&gt;, 2002.</mixed-citation>
</ref>
<ref id="ref7">
<label>7</label><mixed-citation publication-type="other" xlink:type="simple">Ciais, P., Rayner, P., Chevallier, F., Bousquet, P., Logan, M., Peylin, P., and Ramonet, M.: Atmospheric inversions for estimating CO&lt;sub&gt;2&lt;/sub&gt; fluxes: methods and perspectives, Greenhouse Gas Inventories, 69–92, 2011.</mixed-citation>
</ref>
<ref id="ref8">
<label>8</label><mixed-citation publication-type="other" xlink:type="simple">Coppersmith, D. and Winograd, S.: Matrix Multiplication via Arithmetic Progressions, J. Symb. Comput., 9, 251–280, &lt;a href=&quot;http://dx.doi.org/10.1016/s0747-7171(08)80013-2&quot;&gt;https://doi.org/10.1016/s0747-7171(08)80013-2&lt;/a&gt;, 1990.</mixed-citation>
</ref>
<ref id="ref9">
<label>9</label><mixed-citation publication-type="other" xlink:type="simple">Dongarra, J. J., Ducroz, J., Hammarling, S., and Hanson, R. J.: An Extended Set of Fortran Basic Linear Algebra Subprograms, ACM Trans. Math. Softw., 14, 1–17, &lt;a href=&quot;http://dx.doi.org/10.1145/42288.42291&quot;&gt;https://doi.org/10.1145/42288.42291&lt;/a&gt;, 1988.</mixed-citation>
</ref>
<ref id="ref10">
<label>10</label><mixed-citation publication-type="other" xlink:type="simple">Engelen, R. J., Denning, A. S., and Gurney, K. R.: On error estimation in atmospheric CO&lt;sub&gt;2&lt;/sub&gt; inversions, J. Geophys. Res., 107, 4635, https://doi.org/10.1029/2002JD002195, 2002.</mixed-citation>
</ref>
<ref id="ref11">
<label>11</label><mixed-citation publication-type="other" xlink:type="simple">Enting, I. G.: Inverse problems in atmospheric constituent transport, Cambridge Univ Press, 408 pp., 2002.</mixed-citation>
</ref>
<ref id="ref12">
<label>12</label><mixed-citation publication-type="other" xlink:type="simple">Eve, J.: On O(n&lt;sup&gt;2&lt;/sup&gt; log n) algorithms for $n \times n$ matrix operations, University of Newcastle upon Tyne, Technical Report Series, Newcastle upon Tyne, No.&amp;nbsp;CS-TR1169, 2009.</mixed-citation>
</ref>
<ref id="ref13">
<label>13</label><mixed-citation publication-type="other" xlink:type="simple">Gohberg, I. and Olshevsky, V.: Fast algorithms with preprocessing for matrix-vector multiplication problems, J. Complex., 10, 411–427, 1994.</mixed-citation>
</ref>
<ref id="ref14">
<label>14</label><mixed-citation publication-type="other" xlink:type="simple">Golub, G. H. and Van Loan, C. F.: Matrix Computations, 3rd ed., The Johns Hopkins University Press, London, 1996.</mixed-citation>
</ref>
<ref id="ref15">
<label>15</label><mixed-citation publication-type="other" xlink:type="simple">Gourdji, S. M., Mueller, K. L., Yadav, V., Huntzinger, D. N., Andrews, A. E., Trudeau, M., Petron, G., Nehrkorn, T., Eluszkiewicz, J., Henderson, J., Wen, D., Lin, J., Fischer, M., Sweeney, C., and Michalak, A. M.: North American CO&lt;sub&gt;2&lt;/sub&gt; exchange: inter-comparison of modeled estimates with results from a fine-scale atmospheric inversion, Biogeosciences, 9, 457–475, &lt;a href=&quot;http://dx.doi.org/10.5194/bg-9-457-2012&quot;&gt;https://doi.org/10.5194/bg-9-457-2012&lt;/a&gt;, 2012.</mixed-citation>
</ref>
<ref id="ref16">
<label>16</label><mixed-citation publication-type="other" xlink:type="simple">Harville, D. A.: Matrix Algebra From a Statistician&apos;s Perspective, 2nd ed., Springer, Dodrecht, Netherlands, 2008.</mixed-citation>
</ref>
<ref id="ref17">
<label>17</label><mixed-citation publication-type="other" xlink:type="simple">Horn, R. A. and Johnson, C. R.: Matrix analysis, Cambridge University Press, 1990.</mixed-citation>
</ref>
<ref id="ref18">
<label>18</label><mixed-citation publication-type="other" xlink:type="simple">Hyndman, D. W., Day-Lewis, F. D., Singha, K., and Union, A. G.: Subsurface Hydrology: Data Integration for Properties and Processes, American Geophysical Union, 253 pp., 2007.</mixed-citation>
</ref>
<ref id="ref19">
<label>19</label><mixed-citation publication-type="other" xlink:type="simple">Kitanidis, P. K.: Quasi-linear geostatistical theory for inversing, Water Resour. Res., 31, 2411–2419, 1995.</mixed-citation>
</ref>
<ref id="ref20">
<label>20</label><mixed-citation publication-type="other" xlink:type="simple">Laderman, J. D.: A noncommutative algorithm for multiplying 33 matrices using 23 multiplications, Bull. Amer. Math. Soc, 82, 126–128, 1976.</mixed-citation>
</ref>
<ref id="ref21">
<label>21</label><mixed-citation publication-type="other" xlink:type="simple">Lawson, C. L., Hanson, R. J., Kincaid, D. R., and Krogh, F. T.: Basic linear algebra subprograms for Fortran usage, ACM Trans. Math. Softw., 5, 308–325, &lt;a href=&quot;http://dx.doi.org/10.1145/355841.355847&quot;&gt;https://doi.org/10.1145/355841.355847&lt;/a&gt;, 1979.</mixed-citation>
</ref>
<ref id="ref22">
<label>22</label><mixed-citation publication-type="other" xlink:type="simple">Li, J., Ranka, S., and Sahni, S.: Strassen&apos;s Matrix Multiplication on GPUs, Parallel and Distributed Systems (ICPADS), 2011 IEEE 17th International Conference on, 2011, 157–164, 2011.</mixed-citation>
</ref>
<ref id="ref23">
<label>23</label><mixed-citation publication-type="other" xlink:type="simple">Liu, X. and Zhai, Z.: Inverse modeling methods for indoor airborne pollutant tracking: literature review and fundamentals, Indoor air, 17, 419–438, 2007.</mixed-citation>
</ref>
<ref id="ref24">
<label>24</label><mixed-citation publication-type="other" xlink:type="simple">Meirink, J. F., Bergamaschi, P., and Krol, M. C.: Four-dimensional variational data assimilation for inverse modelling of atmospheric methane emissions: method and comparison with synthesis inversion, Atmos. Chem. Phys., 8, 6341–6353, &lt;a href=&quot;http://dx.doi.org/10.5194/acp-8-6341-2008&quot;&gt;https://doi.org/10.5194/acp-8-6341-2008&lt;/a&gt;, 2008.</mixed-citation>
</ref>
<ref id="ref25">
<label>25</label><mixed-citation publication-type="other" xlink:type="simple">Michalak, A. M. and Kitanidis, P. K.: A method for enforcing parameter nonnegativity in Bayesian inverse problems with an application to contaminant source identification, Water Resour. Res., 39, 1033, &lt;a href=&quot;http://dx.doi.org/10.1029/2002WR001480&quot;&gt;https://doi.org/10.1029/2002WR001480&lt;/a&gt;, 2003.</mixed-citation>
</ref>
<ref id="ref26">
<label>26</label><mixed-citation publication-type="other" xlink:type="simple">Mouilleron, C.: Efficient computation with structured matrices and arithmetic expressions, Ecole normale supérieure de lyon-ENS LYON, 2011.</mixed-citation>
</ref>
<ref id="ref27">
<label>27</label><mixed-citation publication-type="other" xlink:type="simple">Nowak, W., Tenkleve, S., and Cirpka, O. A.: Efficient computation of linearized cross-covariance and auto-covariance matrices of interdependent quantities, Math. Geol., 35, 53–66, 2003.</mixed-citation>
</ref>
<ref id="ref28">
<label>28</label><mixed-citation publication-type="other" xlink:type="simple">Saibaba, A. K. and Kitanidis, P. K.: Efficient methods for large-scale linear inversion using a geostatistical approach, Water Resour. Res., 48, W05522, &lt;a href=&quot;http://dx.doi.org/10.1029/2011WR011778&quot;&gt;https://doi.org/10.1029/2011WR011778&lt;/a&gt;, 2012.</mixed-citation>
</ref>
<ref id="ref29">
<label>29</label><mixed-citation publication-type="other" xlink:type="simple">Singh, K., Jardak, M., Sandu, A., Bowman, K., Lee, M., and Jones, D.: Construction of non-diagonal background error covariance matrices for global chemical data assimilation, Geosci. Model Dev., 4, 299–316, &lt;a href=&quot;http://dx.doi.org/10.5194/gmd-4-299-2011&quot;&gt;https://doi.org/10.5194/gmd-4-299-2011&lt;/a&gt;, 2011.</mixed-citation>
</ref>
<ref id="ref30">
<label>30</label><mixed-citation publication-type="other" xlink:type="simple">Strassen, V.: Gaussian Elimination is not Optimal, Numer. Math., 13, 354–356, &lt;a href=&quot;http://dx.doi.org/10.1007/bf02165411&quot;&gt;https://doi.org/10.1007/bf02165411&lt;/a&gt;, 1969.</mixed-citation>
</ref>
<ref id="ref31">
<label>31</label><mixed-citation publication-type="other" xlink:type="simple">Thompson, R. L., Gerbig, C., and Rödenbeck, C.: A Bayesian inversion estimate of N&lt;sub&gt;2&lt;/sub&gt;O emissions for western and central Europe and the assessment of aggregation errors, Atmos. Chem. Phys., 11, 3443–3458, &lt;a href=&quot;http://dx.doi.org/10.5194/acp-11-3443-2011&quot;&gt;https://doi.org/10.5194/acp-11-3443-2011&lt;/a&gt;, 2011.</mixed-citation>
</ref>
<ref id="ref32">
<label>32</label><mixed-citation publication-type="other" xlink:type="simple">Van Loan, C. F.: The ubiquitous Kronecker product, Journal of Computational and Applied Mathematics, 123, 85–100, &lt;a href=&quot;http://dx.doi.org/10.1016/s0377-0427(00)00393-9&quot;&gt;https://doi.org/10.1016/s0377-0427(00)00393-9&lt;/a&gt;, 2000.</mixed-citation>
</ref>
<ref id="ref33">
<label>33</label><mixed-citation publication-type="other" xlink:type="simple">Zhang, T. and Chen, Q.: Identification of contaminant sources in enclosed environments by inverse CFD modeling, Indoor air, 17, 167–177, 2007.</mixed-citation>
</ref>
</ref-list>
</back>
</article>