Skip to content

Commit cd10556

Browse files
add [bf-tran]
1 parent 46e668c commit cd10556

1 file changed

Lines changed: 49 additions & 0 deletions

File tree

P/bf-tran.md

Lines changed: 49 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,49 @@
1+
---
2+
layout: proof
3+
mathjax: true
4+
5+
author: "Thomas J. Faulkenberry"
6+
affiliation: "Tarleton State University"
7+
e_mail: "faulkenberry@tarleton.edu"
8+
date: 2020-09-07 12:00:00
9+
10+
title: "Transitivity of Bayes Factors"
11+
chapter: "Model Selection"
12+
section: "Bayesian model selection"
13+
topic: "Bayes factor"
14+
theorem: "Transitivity of Bayes Factors"
15+
16+
sources:
17+
18+
proof_id: "P163"
19+
shortcut: "bf-tran"
20+
username: "tomfaulkenberry"
21+
---
22+
23+
24+
**Theorem:** Consider three competing [models](/D/gm) $m_1$, $m_2$, and $m3$ for observed data $y$. Then the [Bayes factor](/D/bf) for $m_1$ over $m_3$ can be written as:
25+
26+
$$ \label{eq:bf-tran}
27+
\text{BF}_{13} = \text{BF}_{12}\cdot \text{BF}_{23}.
28+
$$
29+
30+
**Proof:** By [definition](/D/bf), the Bayes factor $\text{BF}_{13}$ is the ratio of marginal likelihoods of data $y$ over $m_1$ and $m_3$, respectively. That is,
31+
32+
$$ \label{eq:bf}
33+
\text{BF}_{13}=\frac{p(y \mid m_1)}{p(y \mid m_3)}.
34+
$$
35+
36+
We can equivlently write
37+
38+
$$
39+
\begin{split}
40+
\text{BF}_{13} &\overset{\eqref{eq:bf}}{=} \frac{p(y \mid m_1)}{p(y \mid m_3)}\\
41+
&= \frac{p(y \mid m_1)}{p(y \mid m_3)} \cdot \frac{p(y \mid m_2)}{p(y \mid m_2)}\\
42+
&= \frac{p(y \mid m_1) \cdot p(y \mid m_2)}{p(y \mid m_3)\cdot p(y \mid m_2)}\\
43+
&= \frac{p(y \mid m_1) \cdot p(y \mid m_2)}{p(y \mid m_2)\cdot p(y \mid m_3)}\\
44+
&=\frac{p(y \mid m_1)}{p(y \mid m_2)} \cdot \frac{p(y \mid m_2)}{p(y \mid m_3)}\\
45+
&\overset{\eqref{eq:bf}}{=}\text{BF}_{12} \cdot \text{BF}_{23},
46+
\end{split}
47+
$$
48+
49+
which completes the proof of \eqref{eq:tran}.

0 commit comments

Comments
 (0)