{"id":396312,"date":"2025-10-24T16:25:19","date_gmt":"2025-10-24T22:25:19","guid":{"rendered":"http:\/\/xianblog.wordpress.com\/?p=61206"},"modified":"2025-10-24T16:25:19","modified_gmt":"2025-10-24T22:25:19","slug":"approximating-evidence-via-bounded-harmonic-means-and-hpd-regions-with-known-volumes","status":"publish","type":"post","link":"https:\/\/www.r-bloggers.com\/2025\/10\/approximating-evidence-via-bounded-harmonic-means-and-hpd-regions-with-known-volumes\/","title":{"rendered":"Approximating evidence via bounded harmonic means (and HPD regions with known volumes)"},"content":{"rendered":"<!-- \r\n<div style=\"min-height: 30px;\">\r\n[social4i size=\"small\" align=\"align-left\"]\r\n<\/div>\r\n-->\r\n\r\n<div style=\"border: 1px solid; background: none repeat scroll 0 0 #EDEDED; margin: 1px; font-size: 12px;\">\r\n[This article was first published on  <strong><a href=\"https:\/\/xianblog.wordpress.com\/2025\/10\/25\/approximating-evidence-via-bounded-harmonic-means-and-hpd-regions-with-known-volumes\/\"> R \u2013 Xi&#039;an&#039;s Og<\/a><\/strong>, and kindly contributed to <a href=\"https:\/\/www.r-bloggers.com\/\" rel=\"nofollow\">R-bloggers<\/a>].  (You can report issue about the content on this page <a href=\"https:\/\/www.r-bloggers.com\/contact-us\/\">here<\/a>)\r\n<hr>Want to share your content on R-bloggers?<a href=\"https:\/\/www.r-bloggers.com\/add-your-blog\/\" rel=\"nofollow\"> click here<\/a> if you have a blog, or <a href=\"http:\/\/r-posts.com\/\" rel=\"nofollow\"> here<\/a> if you don't.\r\n<\/div>\n<p><img loading=\"lazy\" data-attachment-id=\"61208\" data-permalink=\"https:\/\/xianblog.wordpress.com\/2025\/10\/25\/approximating-evidence-via-bounded-harmonic-means-and-hpd-regions-with-known-volumes\/k8_ecmle\/\" data-orig-file=\"https:\/\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/k8_ecmle.png\" data-orig-size=\"1494,1572\" data-comments-opened=\"1\" data-image-meta=\"{\"aperture\":\"0\",\"credit\":\"\",\"camera\":\"\",\"caption\":\"\",\"created_timestamp\":\"0\",\"copyright\":\"\",\"focal_length\":\"0\",\"iso\":\"0\",\"shutter_speed\":\"0\",\"title\":\"\",\"orientation\":\"0\"}\" data-image-title=\"k8_ecmle\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/k8_ecmle.png?w=285\" data-large-file=\"https:\/\/i0.wp.com\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/k8_ecmle.png?resize=450%2C473&#038;ssl=1\" class=\"aligncenter size-large wp-image-61208\" src=\"https:\/\/i0.wp.com\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/k8_ecmle.png?resize=450%2C473&#038;ssl=1\" alt=\"\" width=\"450\" height=\"473\" srcset_temp=\"https:\/\/i0.wp.com\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/k8_ecmle.png?resize=450%2C473&#038;ssl=1 450w, https:\/\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/k8_ecmle.png?w=900 900w, https:\/\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/k8_ecmle.png?w=91 91w, https:\/\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/k8_ecmle.png?w=285 285w, https:\/\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/k8_ecmle.png?w=768 768w\" sizes=\"(max-width: 450px) 100vw, 450px\" data-recalc-dims=\"1\" \/><\/p>\n<p style=\"text-align: justify\">Following a suggestion by <a href=\"https:\/\/xianblog.wordpress.com\/2017\/04\/17\/rss-read-paper\/\" rel=\"nofollow\" target=\"_blank\">Christian Hennig<\/a> at <a href=\"https:\/\/xianblog.wordpress.com\/2024\/08\/04\/jsm-2024-portland-is-off\/\" rel=\"nofollow\" target=\"_blank\">JSM 2024<\/a>, I started working with my PhD student Dana Naderi on a detailed assessment of the method we proposed in 2009 with Darren Wraith for <a href=\"https:\/\/xianblog.wordpress.com\/2009\/08\/01\/jsm-2009\/\" rel=\"nofollow\" target=\"_blank\">evidence approximation<\/a>. (The method was briefly mentioned in a <a href=\"https:\/\/journals.aps.org\/prd\/abstract\/10.1103\/PhysRevD.80.023507#references\" rel=\"nofollow\" target=\"_blank\">Physical Review paper<\/a> and also briefly illustrated in our 2010 <a href=\"https:\/\/xianblog.wordpress.com\/2009\/10\/14\/bayes-factor-approximations\/\" rel=\"nofollow\" target=\"_blank\">San Antonio<\/a> survey of <a href=\"https:\/\/xianblog.wordpress.com\/2009\/10\/14\/bayes-factor-approximations\/\" rel=\"nofollow\" target=\"_blank\">evidence approximation methods<\/a> with Jean-Michel Marin.) Well,\u00a0 it took longer than expected but we eventually <a href=\"https:\/\/arxiv.org\/abs\/2510.20617\" rel=\"nofollow\" target=\"_blank\">completed our paper<\/a> on the approximation of evidence by bounded harmonic means, exploiting the <a href=\"https:\/\/www.researchgate.net\/profile\/Dipak-Dey-2\/publication\/239655370_Bayesian_Model_Choice_Asymptotics_and_Exact_Calculations\/links\/543c23340cf24a6ddb97fc7a\/Bayesian-Model-Choice-Asymptotics-and-Exact-Calculations.pdf?_tp=eyJjb250ZXh0Ijp7ImZpcnN0UGFnZSI6InB1YmxpY2F0aW9uIiwicGFnZSI6InB1YmxpY2F0aW9uIn19\" rel=\"nofollow\" target=\"_blank\">general identity<\/a> of Alan Gelfand and Dipak Dey (1994). Following our 2009 idea, the free function in Gelfand &#038; Dey representation is chosen as a Uniform distribution on an HPD region, since this insures boundedness (and hence finite variance) for the resulting estimator. This followed a revival of the method, renamed THAMES, by <a href=\"https:\/\/xianblog.wordpress.com\/2023\/05\/30\/reciprocal-importance-sampling\/\" rel=\"nofollow\" target=\"_blank\">Metodiev et al. in 2023<\/a>, where the authors approximate the HPD region with an ellipsoid derived from a Normal distribution centred at the highest of the HPD points, whose covariance matrix is estimated from the posterior sample. With the drawback that this ellipsoid may as well include low probability regions. Our approach (ECMLE, standing for <em>elliptical coverings for marginal likelihood estimation<\/em>) is aiming at staying within the actual and targeted HPD region by creating non-overlapping ellipsoids from simulations from the posterior and by using a Uniform density on that collection as the reverse importance function. The resulting estimator is unbiased, since the volume of the set is known (when based on a second, independent, sample of simulations from the posterior, a requirement that was not clearly explicated in our <a href=\"https:\/\/xianblog.wordpress.com\/2009\/10\/14\/bayes-factor-approximations\/\" rel=\"nofollow\" target=\"_blank\">earlier survey<\/a>). In the meanwhile, that is, while we were close to conclude our paper, <a href=\"https:\/\/xianblog.wordpress.com\/2025\/05\/25\/easily-computed-marginal-likelihoods-for-multivariate-mixture-models-using-the-thames-estimator\/\" rel=\"nofollow\" target=\"_blank\">Metodiev et al.<\/a> produced a modified version of THAMES, where they truncate the original ellipsoid to intersect with the HPD region of interest, as discussed in an <a href=\"https:\/\/xianblog.wordpress.com\/2025\/05\/25\/easily-computed-marginal-likelihoods-for-multivariate-mixture-models-using-the-thames-estimator\/\" rel=\"nofollow\" target=\"_blank\">earlier \u2018Og entry<\/a> (with a <a href=\"https:\/\/xianblog.wordpress.com\/2025\/06\/23\/thames-for-mixtures-a-reply-from-the-authors\/\" rel=\"nofollow\" target=\"_blank\">reply from the authors<\/a>). While their paper is more focussed on mixture inference and include other aspects on Bayesian inference for mixture, we rewrote ours to include a comparison between the methods, which proves satisfactory, especially in larger dimensions.<\/p>\n<p style=\"text-align: justify\"><img loading=\"lazy\" data-attachment-id=\"61216\" data-permalink=\"https:\/\/xianblog.wordpress.com\/2025\/10\/25\/approximating-evidence-via-bounded-harmonic-means-and-hpd-regions-with-known-volumes\/ex3_all\/\" data-orig-file=\"https:\/\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/ex3_all.png\" data-orig-size=\"2306,1338\" data-comments-opened=\"1\" data-image-meta=\"{\"aperture\":\"0\",\"credit\":\"\",\"camera\":\"\",\"caption\":\"\",\"created_timestamp\":\"0\",\"copyright\":\"\",\"focal_length\":\"0\",\"iso\":\"0\",\"shutter_speed\":\"0\",\"title\":\"\",\"orientation\":\"0\"}\" data-image-title=\"ex3_all\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/ex3_all.png?w=300\" data-large-file=\"https:\/\/i2.wp.com\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/ex3_all.png?resize=450%2C261&#038;ssl=1\" class=\"aligncenter size-large wp-image-61216\" src=\"https:\/\/i2.wp.com\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/ex3_all.png?resize=450%2C261&#038;ssl=1\" alt=\"\" width=\"450\" height=\"261\" srcset_temp=\"https:\/\/i2.wp.com\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/ex3_all.png?resize=450%2C261&#038;ssl=1 450w, https:\/\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/ex3_all.png?w=900 900w, https:\/\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/ex3_all.png?w=128 128w, https:\/\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/ex3_all.png?w=300 300w, https:\/\/xianblog.wordpress.com\/wp-content\/uploads\/2025\/10\/ex3_all.png?w=768 768w\" sizes=\"(max-width: 450px) 100vw, 450px\" data-recalc-dims=\"1\" \/><\/p>\n\n<div style=\"border: 1px solid; background: none repeat scroll 0 0 #EDEDED; margin: 1px; font-size: 13px;\">\r\n<div style=\"text-align: center;\">To <strong>leave a comment<\/strong> for the author, please follow the link and comment on their blog: <strong><a href=\"https:\/\/xianblog.wordpress.com\/2025\/10\/25\/approximating-evidence-via-bounded-harmonic-means-and-hpd-regions-with-known-volumes\/\"> R \u2013 Xi&#039;an&#039;s Og<\/a><\/strong>.<\/div>\r\n<hr \/>\r\n<a href=\"https:\/\/www.r-bloggers.com\/\" rel=\"nofollow\">R-bloggers.com<\/a> offers <strong><a href=\"https:\/\/feedburner.google.com\/fb\/a\/mailverify?uri=RBloggers\" rel=\"nofollow\">daily e-mail updates<\/a><\/strong> about <a title=\"The R Project for Statistical Computing\" href=\"https:\/\/www.r-project.org\/\" rel=\"nofollow\">R<\/a> news and tutorials about <a title=\"R tutorials\" href=\"https:\/\/www.r-bloggers.com\/how-to-learn-r-2\/\" rel=\"nofollow\">learning R<\/a> and many other topics. <a title=\"Data science jobs\" href=\"https:\/\/www.r-users.com\/\" rel=\"nofollow\">Click here if you're looking to post or find an R\/data-science job<\/a>.\r\n\r\n<hr>Want to share your content on R-bloggers?<a href=\"https:\/\/www.r-bloggers.com\/add-your-blog\/\" rel=\"nofollow\"> click here<\/a> if you have a blog, or <a href=\"http:\/\/r-posts.com\/\" rel=\"nofollow\"> here<\/a> if you don't.\r\n<\/div>","protected":false},"excerpt":{"rendered":"<div style = \"width:60%; display: inline-block; float:left; \"> Following a suggestion by Christian Hennig at JSM 2024, I started working with my PhD student Dana Naderi on a detailed assessment of the method we proposed in 2009 with Darren Wraith for evidence approximation. (The method was briefly mentioned in a Physical Review paper and also briefly illustrated in our 2010 San &#8230;<\/div>\n<div style = \"width: 40%; display: inline-block; float:right;\"><\/div>\n<div style=\"clear: both;\"><\/div>\n","protected":false},"author":56,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"aioseo_notices":[],"jetpack-related-posts":[],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/www.r-bloggers.com\/wp-json\/wp\/v2\/posts\/396312"}],"collection":[{"href":"https:\/\/www.r-bloggers.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.r-bloggers.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.r-bloggers.com\/wp-json\/wp\/v2\/users\/56"}],"replies":[{"embeddable":true,"href":"https:\/\/www.r-bloggers.com\/wp-json\/wp\/v2\/comments?post=396312"}],"version-history":[{"count":4,"href":"https:\/\/www.r-bloggers.com\/wp-json\/wp\/v2\/posts\/396312\/revisions"}],"predecessor-version":[{"id":400755,"href":"https:\/\/www.r-bloggers.com\/wp-json\/wp\/v2\/posts\/396312\/revisions\/400755"}],"wp:attachment":[{"href":"https:\/\/www.r-bloggers.com\/wp-json\/wp\/v2\/media?parent=396312"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.r-bloggers.com\/wp-json\/wp\/v2\/categories?post=396312"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.r-bloggers.com\/wp-json\/wp\/v2\/tags?post=396312"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}