×

Shapley effects for sensitivity analysis with dependent inputs: bootstrap and kriging-based algorithms. (English) Zbl 1421.62043

Summary: In global sensitivity analysis, the well-known Sobol’ sensitivity indices aim to quantify how the variance in the output of a mathematical model can be apportioned to the different variances of its input random variables. These indices are based on the functional variance decomposition and their interpretation becomes difficult in the presence of statistical dependence between the inputs. However, as there are dependencies in many application studies, this drawback enhances the development of interpretable sensitivity indices. Recently, the Shapley values that were developed in the field of cooperative games theory have been connected to global sensitivity analysis and present good properties in the presence of dependencies. Nevertheless, the available estimation methods do not always provide confidence intervals and require a large number of model evaluations. In this paper, a bootstrap resampling is implemented in existing algorithms to assess confidence intervals. We also propose to consider a metamodel in substitution of a costly numerical model. The estimation error from the Monte-Carlo sampling is combined with the metamodel error in order to have confidence intervals on the Shapley effects. Furthermore, we compare the Shapley effects with existing extensions of the Sobol’ indices in different examples of dependent random variables.

MSC:

62G09 Nonparametric statistical resampling methods
62G15 Nonparametric tolerance and confidence regions
91A12 Cooperative games
PDFBibTeX XMLCite
Full Text: DOI arXiv

References:

[1] J. Castro, D. Gómez, and J. Tejada. Polynomial calculation of the shapley value based on sampling. Computers & Operations Research, 36(5):1726-1730, 2009. · Zbl 1177.91021
[2] G. Chastaing, F. Gamboa, C. Prieur, et al. Generalized hoeffding-sobol decomposition for dependent variables-application to sensitivity analysis. Electronic Journal of Statistics, 6:2420-2448, 2012. · Zbl 1334.62098
[3] T. Crestaux, O. Le MaıËĘtre, and J.-M. Martinez. Polynomial chaos expansion for sensitivity analysis. Reliability Engineering & System Safety, 94(7):1161-1172, 2009.
[4] B. Efron. Nonparametric standard errors and confidence intervals. canadian Journal of Statistics, 9(2):139-158, 1981. · Zbl 0482.62034
[5] K.-T. Fang, R. Li, and A. Sudjianto. Design and modeling for computer experiments. CRC Press, 2005.
[6] W. Hoeffding. A class of statistics with asymptotically normal distribution. Annals of Mathematical Statistics, 19(3):293-325, Sept. 1948. · Zbl 0032.04101
[7] T. Homma and A. Saltelli. Importance measures in global sensitivity analysis of nonlinear models. Reliability Engineering & System Safety, 52(1):1-17, 1996.
[8] B. Iooss and P. Lemaître. A review on global sensitivity analysis methods. In Uncertainty Management in Simulation- Optimization of Complex Systems, pages 101-122. Springer, 2015.
[9] B. Iooss and C. Prieur. Shapley effects for sensitivity analysis with dependent inputs: comparisons with sobol’indices, numerical estimation and applications. arXiv preprint arXiv:1707.01334, 2017. · Zbl 1498.62143
[10] T. Ishigami and T. Homma. An importance quantification technique in uncertainty analysis for computer models. In Uncer- tainty Modeling and Analysis, 1990. Proceedings., First International Symposium on, pages 398-403. IEEE, 1990.
[11] A. Janon, T. Klein, A. Lagnoux, M. Nodet, and C. Prieur. Asymptotic normality and efficiency of two sobol index estimators. ESAIM: Probability and Statistics, 18:342-364, 2014. · Zbl 1305.62147
[12] M. J. Jansen, W. A. Rossing, and R. A. Daamen. Monte carlo estimation of uncertainty contributions from several independent multivariate sources. In Predictability and Nonlinear Modelling in Natural Sciences and Economics, pages 334-343. Springer, 1994. · Zbl 0875.65019
[13] S. Kucherenko, S. Tarantola, and P. Annoni. Estimation of global sensitivity indices for models with dependent variables. Computer Physics Communications, 183(4):937-946, 2012. · Zbl 1261.62062
[14] L. Le Gratiet, C. Cannamela, and B. Iooss. A bayesian approach for global sensitivity analysis of (multifidelity) computer codes. SIAM/ASA Journal on Uncertainty Quantification, 2(1):336-363, 2014. · Zbl 1308.62107
[15] G. Li, S.-W. Wang, C. Rosenthal, and H. Rabitz. High dimensional model representations generated from low dimensional data samples. i. mp-cut-hdmr. Journal of Mathematical Chemistry, 30(1):1-30, 2001. · Zbl 1023.81521
[16] T. A. Mara and S. Tarantola. Variance-based sensitivity indices for models with dependent inputs. Reliability Engineering & System Safety, 107:115-121, 2012.
[17] T. A. Mara, S. Tarantola, and P. Annoni. Non-parametric methods for global sensitivity analysis of model output with dependent inputs. Environmental Modelling & Software, 72:173-183, 2015.
[18] J. D. Martin and T. W. Simpson. On the use of kriging models to approximate deterministic computer models. In ASME 2004 international design engineering technical conferences and computers and information in engineering conference, pages 481-492. American Society of Mechanical Engineers, 2004.
[19] A. B. Owen. Sobol’indices and shapley value. SIAM/ASA Journal on Uncertainty Quantification, 2(1):245-251, 2014. · Zbl 1308.91129
[20] A. B. Owen and C. Prieur. On shapley value for measuring importance of dependent inputs. SIAM/ASA Journal on Uncertainty Quantification, 5(1):986-1002, 2017. ESAIM: PROCEEDINGS AND SURVEYS293 · Zbl 1386.65064
[21] M. Rosenblatt. Remarks on a multivariate transformation. The annals of mathematical statistics, 23(3):470-472, 1952. · Zbl 0047.13104
[22] J. Sacks, W. J. Welch, T. J. Mitchell, and H. P. Wynn. Design and analysis of computer experiments. Statistical science, pages 409-423, 1989.
[23] A. Saltelli, P. Annoni, I. Azzini, F. Campolongo, M. Ratto, and S. Tarantola. Variance based sensitivity analysis of model output. design and estimator for the total sensitivity index. Computer Physics Communications, 181(2):259-270, 2010. · Zbl 1219.93116
[24] A. Saltelli and S. Tarantola. On the relative importance of input factors in mathematical models: safety assessment for nuclear waste disposal. Journal of the American Statistical Association, 97(459):702-709, 2002. · Zbl 1073.62602
[25] A. Saltelli, S. Tarantola, F. Campolongo, and M. Ratto. Sensitivity analysis in practice: a guide to assessing scientific models. John Wiley & Sons, 2004. · Zbl 1049.62112
[26] L. S. Shapley. A value for n-person games. Contributions to the Theory of Games, 2(28):307-317, 1953.
[27] L. S. Shapley and M. Shubik. A method for evaluating the distribution of power in a committee system. American political science review, 48(3):787-792, 1954.
[28] M. Sklar. Fonctions de répartition à n dimensions et leurs marges. Institut de Statistique de l’Université de Paris, 1959.
[29] I. M. Sobol. Sensitivity estimates for nonlinear mathematical models. Mathematical Modelling and Computational Experiments, 1(4):407-414, 1993. · Zbl 1039.65505
[30] E. Song, B. L. Nelson, and J. Staum. Shapley effects for global sensitivity analysis: Theory and computation. SIAM/ASA Journal on Uncertainty Quantification, 4(1):1060-1083, 2016. · Zbl 1403.62226
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.