Skip to main content

Local Robustness in Bayesian Analysis

  • Chapter
Robust Bayesian Analysis

Part of the book series: Lecture Notes in Statistics ((LNS,volume 152))

  • 1529 Accesses

  • 26 Citations

Abstract

Whereas a global approach to prior robustness focusses on the range of inferences arising from a range of priors, the local approach is concerned with derivatives of posterior quantities with respect to the prior. The local approach has several advantages. First, in contrast to the linearization algorithm used for global robustness, an iterative scheme is not required. Second, it is typically straightforward to obtain a local analysis from Markov chain Monte Carlo posterior output. Third, local sensitivity analysis can be implemented in situations where the linearization algorithm for global analysis is not applicable because the posterior quantity of interest is not a ratio-linear functional of the distribution being perturbed. On the downside, however, it is hard to assess the accuracy of a local sensitivity analysis viewed as an approximation to a global analysis. In particular, summaries of local sensitivity often have nonsensical asymptotic behaviour, raising thorny questions about their calibration. In this article the local approach is broadly defined, ranging from differentiation of functions (e.g., assessing sensitivity to hyperparameters) to differentiation of functionals (e.g., assessing sensitivity to the prior distribution as a whole). In this article we review some of the basic formulations for local assessment of prior influence. We then discuss the use of local analysis to study sensitivity in contexts broader than merely prior uncertainty. Finally, we try to summarize the merits and demerits of local analysis as a robustness tool.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  • Basu, S. (1996). Local sensitivity, functional derivatives and nonlinear posterior quantities. Statistics and Decisions, 14, 405–418.

    MathSciNet  MATH  Google Scholar 

  • Basu, S., Jammalamadaka, S.R. and Liu, W. (1996). Local posterior robustness with parametric priors: maximum and average sensitivity. In Maximum Entropy and Bayesian Methods (G. Heidlbreder, ed.), 97–106. Netherlands: Kluwer.

    Google Scholar 

  • Basu, S., Jammalamadaka, S.R. and Liu, W. (1998). Qualitative robustness and stability of posterior distributions and posterior quantities. Journal of Statistical Planning and Inference 71 151–162.

    Article  MathSciNet  MATH  Google Scholar 

  • Birmiwal, L.R. and Dey, D.K. (1993). Measuring local influence of posterior features under contaminated classes of priors. Statistics and Decisions, 11, 377–390.

    MathSciNet  MATH  Google Scholar 

  • Carota, C. (1996). Local robustness of Bayes factors for nonparametric alternatives. In Bayesian Robustness (J.O. Berger, B. Betrâ, E. Moreno, L.R. Pericchi, F. Ruggeri, G. Salinetti and L. Wasserman, eds.), 283–291. IMS Lecture Notes — Monograph Series Volume 29. Hayward, CA: Institute of Mathematical Statistics.

    Chapter  Google Scholar 

  • Clarke, B. and Gustafson, P. (1998). On the overall sensitivity of the posterior distribution to its inputs. Journal of Statistical Planning and Inference, 71, 137–150.

    Article  MathSciNet  MATH  Google Scholar 

  • Cuevas, A. and Sanz, P. (1988). On differentiability properties of Bayes operators. In Bayesian Statistics 3 (J.M. Bernardo, M.H. DeGroot, D.V. Lindley and A.F.M. Smith, eds.), 569–577. Oxford: Oxford University Press.

    Google Scholar 

  • Delampady, M. and Dey, D.K. (1994). Bayesian robustness for multiparameter problems. Journal of Statistical Planning and Inference, 40, 375–382.

    Article  MathSciNet  MATH  Google Scholar 

  • Dey, D.K. and Birmiwal, L.R. (1994). Robust Bayesian analysis using entropy and divergence measures. Statistics and Probability Letters, 20, 287–294.

    Article  MathSciNet  MATH  Google Scholar 

  • Dey, D.K., Ghosh, S.K. and Lou, K.R. (1996). On local sensitivity measures in Bayesian analysis (with discussion). In Bayesian Robustness (J.O. Berger, B. Betrâ, E. Moreno, L.R. Pericchi, F. Ruggeri, G. Salinetti and L. Wasserman, eds.), 21–39. IMS Lecture Notes — Monograph Series Volume 29. Hayward, CA: Institute of Mathematical Statistics.

    Chapter  Google Scholar 

  • Diaconis, P. and Freedman, D. (1986). On the consistency of Bayes estimates. Annals of Statistics, 14, 1–26.

    Article  MathSciNet  MATH  Google Scholar 

  • Fortini, S. and Ruggeri, F. (1994). Concentration functions and Bayesian robustness (with discussion). Journal of Statistical Planning and Inference, 40, 205–220.

    Article  MathSciNet  MATH  Google Scholar 

  • Fortini, S. and Ruggeri, F. (2000). On the use of the concentration function in Bayesian robustness. In Robust Bayesian Analysis (D. Ríos Insua and F. Ruggeri, eds.). New York: Springer-Verlag.

    Google Scholar 

  • Gelfand, A.E. and Dey, D.K. (1991). On Bayesian robustness of contaminated classes of priors. Statistics and Decisions, 9, 63–80.

    MathSciNet  MATH  Google Scholar 

  • Gustafson, P. and Wasserman, L. (1995). Local sensitivity diagnostics for Bayesian inference. Annals of Statistics, 23, 2153–2167.

    Article  MathSciNet  MATH  Google Scholar 

  • Gustafson, P. (1996a). Local sensitivity of inferences to prior marginals. Journal of the American Statistical Association, 91, 774–781.

    Article  MathSciNet  MATH  Google Scholar 

  • Gustafson, P. (1996b). Local sensitivity of posterior expectations. Annals of Statistics, 24, 174–195.

    Article  MathSciNet  MATH  Google Scholar 

  • Gustafson, P. (1996c). Aspects of Bayesian robustness in hierarchical models (with discussion). In Bayesian Robustness (J.O. Berger, B. Betrâ, E. Moreno, L.R. Pericchi, F. Ruggeri, G. Salinetti and L. Wasserman, eds.), 63–80. IMS Lecture Notes — Monograph Series Volume 29. Hayward, CA: Institute of Mathematical Statistics.

    Chapter  Google Scholar 

  • Gustafson, P. (1996d). Model influence functions based on mixtures. Canadian Journal of Statistics, 24, 535–548.

    Article  MathSciNet  MATH  Google Scholar 

  • Gustafson, P. (1996e). The effect of mixing-distribution misspecification in conjugate mixture models. Canadian Journal of Statistics, 24, 307–318.

    Article  MathSciNet  MATH  Google Scholar 

  • Gustafson, P. (1996f). Robustness considerations in Bayesian analysis. Statistical Methods in Medical Research, 5, 357–373.

    Article  Google Scholar 

  • Hampel, F.R., Ronchetti, E.M., Rousseeuw, P.J. and Stahel, W.A. (1986). Robust Statistics: The Approach Based on Influence Functions. New York: Wiley.

    Google Scholar 

  • Kadane, J.B. and Chuang, D.T. (1978). Stable decision problems. Annals of Statistics, 6, 1095–1110.

    Article  MathSciNet  MATH  Google Scholar 

  • Kadane, J.B., Salinetti, G. and Srinivasan, C. (2000). Stability of Bayes decisions and applications. In Robust Bayesian Analysis (D. Ríos Insua and F. Ruggeri, eds.). New York: Springer-Verlag.

    Google Scholar 

  • Kadane, J.B. and Srinivasan, C. (1996). Bayesian robustness and stability (with discussion). In Bayesian Robustness (J.O. Berger, B. Betrâ, E. Moreno, L.R. Pericchi, F. Ruggeri, G. Salinetti and L. Wasserman, eds.), 81–99. IMS Lecture Notes-Monograph Series Volume 29. Hayward, CA: Institute of Mathematical Statistics.

    Chapter  Google Scholar 

  • Lavine, M. (1991). Sensitivity in Bayesian statistics: the prior and the likelihood. Journal of the American Statistical Association, 86, 396–399.

    Article  MathSciNet  MATH  Google Scholar 

  • Lavine, M., Wasserman, L. and Wolpert, R. (1993). Linearization of Bayesian robustness problems. Journal of Statistical Planning and Inference, 37, 307–316.

    Article  MathSciNet  MATH  Google Scholar 

  • Martin, J. and Ríos Insua, D. (1996). Local sensitivity analysis in Bayesian decision theory (with discussion). In Bayesian Robustness (J.O. Berger, B. Betrâ, E. Moreno, L.R. Pericchi, F. Ruggeri, G. Salinetti and L. Wasserman, eds.), 119–135. IMS Lecture Notes — Monograph Series Volume 29. Hayward, CA: Institute of Mathematical Statistics.

    Chapter  Google Scholar 

  • Mcculloch, R.E. (1989). Local model influence. Journal of the American Statistical Association, 84, 473–478.

    Article  Google Scholar 

  • Meng, Q. and Sivaganesan, S. (1996). Local sensitivity of densitybounded priors. Statistics and Probability Letters, 27, 163–169.

    Article  MathSciNet  MATH  Google Scholar 

  • Moreno, E., Martinez, C. and Cano, J.A. (1996). Local robustness and influence for contamination classes of prior distributions (with discussion). In Bayesian Robustness (J.O. Berger, B. Betrâ, E. Moreno, L.R. Pericchi, F. Ruggeri, G. Salinetti and L. Wasserman, eds.), 137–152. IMS Lecture Notes — Monograph Series Volume 29. Hayward, CA: Institute of Mathematical Statistics.

    Chapter  Google Scholar 

  • Pena, D. and Zamar, R. (1997). A simple diagnostic tool for local prior sensitivity. Statistics and Probability Letters, 36, 205–212.

    Article  MathSciNet  MATH  Google Scholar 

  • Ramsay, J.O. and Novick, M.R. (1980). PLU robust Bayesian decision theory: point estimation. Journal of the American Statistical Association, 75, 901–907.

    Article  MathSciNet  MATH  Google Scholar 

  • Ruggeri, F. and Wasserman, L. (1993). Infinitesimal sensitivity of posterior distributions. Canadian Journal of Statistics, 21, 195–203.

    Article  MathSciNet  MATH  Google Scholar 

  • Ruggeri, F. and Wasserman, L. (1995). Density based classes of priors: infinitesimal properties and approximations. Journal of Statistical Planning and Inference, 46, 311–324.

    Article  MathSciNet  MATH  Google Scholar 

  • Rukhin, A. L. (1993). Influence of the prior distribution on the risk of a Bayes rule. Journal of Theoretical Probability, 6, 71–87.

    Article  MathSciNet  MATH  Google Scholar 

  • Salinetti, G. (1994). Stability of Bayesian decisions. Journal of Statistical Planning and Inference, 40, 313–320.

    Article  MathSciNet  MATH  Google Scholar 

  • Sivaganesan, S. (1993). Robust Bayesian diagnostics. Journal of Statistical Planning and Inference, 35, 171–188.

    Article  MathSciNet  MATH  Google Scholar 

  • Sivaganesan, S. (1996). Asymptotics of some local and global robustness measures (with discussion). In Bayesian Robustness (J.O. Berger, B. Betrâ, E. Moreno, L.R. Pericchi, F. Ruggeri, G. Salinetti and L. Wasserman, eds.), 195–209. IMS Lecture Notes — Monograph Series, Volume 29. Hayward, CA: Institute of Mathematical Statistics.

    Chapter  Google Scholar 

  • Sivaganesan, S. (2000). Global and local robustness approaches: uses and limitations. In Robust Bayesian Analysis (D. Ríos Insua and F. Ruggeri eds.). New York: Springer-Verlag

    Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Springer Science+Business Media New York

About this chapter

Cite this chapter

Gustafson, P. (2000). Local Robustness in Bayesian Analysis. In: Insua, D.R., Ruggeri, F. (eds) Robust Bayesian Analysis. Lecture Notes in Statistics, vol 152. Springer, New York, NY. https://doi.org/10.1007/978-1-4612-1306-2_4

Download citation

  • DOI: https://doi.org/10.1007/978-1-4612-1306-2_4

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-0-387-98866-5

  • Online ISBN: 978-1-4612-1306-2

  • eBook Packages: Springer Book Archive

Key words

Publish with us

Policies and ethics