Skip to content

Commit a496f78

Browse files
authored
Merge pull request #42 from StatProofBook/master
update to master
2 parents 6b25601 + 95a56d2 commit a496f78

10 files changed

Lines changed: 32 additions & 6 deletions

D/cvlme.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -48,16 +48,16 @@ username: "JoramSoch"
4848
---
4949

5050

51-
**Definition:** Let there be a [data set](/D/data) $y$ with mutually exclusive and collectively exhaustive subsets $y_1, \ldots, y_S$. Assume a [generative model](/D/gm) $m$ with model parameters $\theta$ implying a [likelihood function](/D/lf) $p(y \vert \theta, m)$ and a [non-informative](/D/prior-inf) [prior density](/D/prior) $p(\theta \vert m)$.
51+
**Definition:** Let there be a [data set](/D/data) $y$ with mutually exclusive and collectively exhaustive subsets $y_1, \ldots, y_S$. Assume a [generative model](/D/gm) $m$ with model parameters $\theta$ implying a [likelihood function](/D/lf) $p(y \vert \theta, m)$ and a [non-informative](/D/prior-inf) [prior density](/D/prior) $p_{\mathrm{ni}}(\theta \vert m)$.
5252

5353
Then, the cross-validated log model evidence of $m$ is given by
5454

5555
$$ \label{eq:cvLME}
5656
\mathrm{cvLME}(m) = \sum_{i=1}^{S} \log \int p( y_i \vert \theta, m ) \, p( \theta \vert y_{\neg i}, m ) \, \mathrm{d}\theta
5757
$$
5858

59-
where $y_{\neg i} = \bigcup_{j \neq i} y_j$ is the union of all data subsets except $y_i$ and $p( \theta \vert y_{\neg i}, m )$ is the [posterior distribution](/D/post) obtained from $y_{\neg i}$ when using the [prior distribution](/D/prior) $p(\theta \vert m)$:
59+
where $y_{\neg i} = \bigcup_{j \neq i} y_j$ is the union of all data subsets except $y_i$ and $p( \theta \vert y_{\neg i}, m )$ is the [posterior distribution](/D/post) obtained from $y_{\neg i}$ when using the [prior distribution](/D/prior) $p_{\mathrm{ni}}(\theta \vert m)$:
6060

6161
$$ \label{eq:post}
62-
p( \theta \vert y_{\neg i}, m ) = \frac{p( y_{\neg i} \vert \theta, m ) \, p(\theta \vert m)}{p( y_{\neg i} \vert m )} \; .
62+
p( \theta \vert y_{\neg i}, m ) = \frac{p( y_{\neg i} \vert \theta, m ) \, p_{\mathrm{ni}}(\theta \vert m)}{p( y_{\neg i} \vert m )} \; .
6363
$$

D/rvar-uni.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -29,6 +29,8 @@ username: "JoramSoch"
2929

3030
**Definition:** Let $X$ be a [random variable](/D/rvar) with possible outcomes $\mathcal{X}$. Then,
3131

32+
* $X$ is called a two-valued random variable or [random event](/D/reve), if $\mathcal{X}$ has exactly two elements, e.g. $\mathcal{X} = \left\lbrace \mathrm{true}, \mathrm{false} \right\rbrace$ or $\mathcal{X} = \left\lbrace 1, 0 \right\rbrace$;
33+
3234
* $X$ is called a univariate random variable or [random scalar](/D/rvar), if $\mathcal{X}$ is one-dimensional, i.e. (a subset of) the real numbers $\mathbb{R}$;
3335

3436
* $X$ is called a multivariate random variable or [random vector](/D/rvec), if $\mathcal{X}$ is multi-dimensional, e.g. (a subset of) the $n$-dimensional Euclidean space $\mathbb{R}^n$;

I/Definition_by_Author.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ title: "Definition by Author"
44
---
55

66

7-
### JoramSoch (108 definitions)
7+
### JoramSoch (111 definitions)
88

99
- [Akaike information criterion](/D/aic)
1010
- [Bayesian information criterion](/D/bic)
@@ -38,6 +38,7 @@ title: "Definition by Author"
3838
- [Dirichlet-distributed data](/D/dir-data)
3939
- [Discrete and continuous random variable](/D/rvar-disc)
4040
- [Discrete uniform distribution](/D/duni)
41+
- [Empirical Bayesian log model evidence](/D/eblme)
4142
- [Estimation matrix](/D/emat)
4243
- [Exceedance probability](/D/prob-exc)
4344
- [Expected value](/D/mean)
@@ -111,8 +112,10 @@ title: "Definition by Author"
111112
- [Standardized moment](/D/mom-stand)
112113
- [Statistical independence](/D/ind)
113114
- [Total sum of squares](/D/tss)
115+
- [Uniform-prior log model evidence](/D/uplme)
114116
- [Univariate and multivariate random variable](/D/rvar-uni)
115117
- [Variance](/D/var)
118+
- [Variational Bayesian log model evidence](/D/vblme)
116119
- [Wishart distribution](/D/wish)
117120

118121
### StatProofBook (1 definition)

I/Definition_by_Number.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -119,3 +119,6 @@ title: "Definition by Number"
119119
| D110 | reve | [Random event](/D/reve) | JoramSoch | 2020-11-19 |
120120
| D111 | cvlme | [Cross-validated log model evidence](/D/cvlme) | JoramSoch | 2020-11-19 |
121121
| D112 | ind-cond | [Conditional independence](/D/ind-cond) | JoramSoch | 2020-11-19 |
122+
| D113 | uplme | [Uniform-prior log model evidence](/D/uplme) | JoramSoch | 2020-11-25 |
123+
| D114 | eblme | [Empirical Bayesian log model evidence](/D/eblme) | JoramSoch | 2020-11-25 |
124+
| D115 | vblme | [Variational Bayesian log model evidence](/D/vblme) | JoramSoch | 2020-11-25 |

I/Definition_by_Topic.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -53,6 +53,7 @@ title: "Definition by Topic"
5353

5454
### E
5555

56+
- [Empirical Bayesian log model evidence](/D/eblme)
5657
- [Encompassing model](/D/encm)
5758
- [Estimation matrix](/D/emat)
5859
- [Exceedance probability](/D/prob-exc)
@@ -166,11 +167,13 @@ title: "Definition by Topic"
166167

167168
### U
168169

170+
- [Uniform-prior log model evidence](/D/uplme)
169171
- [Univariate and multivariate random variable](/D/rvar-uni)
170172

171173
### V
172174

173175
- [Variance](/D/var)
176+
- [Variational Bayesian log model evidence](/D/vblme)
174177

175178
### W
176179

I/Proof_by_Author.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ title: "Proof by Author"
44
---
55

66

7-
### JoramSoch (186 proofs)
7+
### JoramSoch (189 proofs)
88

99
- [(Non-)Multiplicativity of the expected value](/P/mean-mult)
1010
- [Additivity of the Kullback-Leibler divergence for independent distributions](/P/kl-add)
@@ -55,6 +55,7 @@ title: "Proof by Author"
5555
- [First central moment is zero](/P/momcent-1st)
5656
- [First raw moment is mean](/P/momraw-1st)
5757
- [Full width at half maximum for the normal distribution](/P/norm-fwhm)
58+
- [Gaussian integral](/P/norm-gi)
5859
- [Gibbs' inequality](/P/gibbs-ineq)
5960
- [Invariance of the Kullback-Leibler divergence under parameter transformation](/P/kl-inv)
6061
- [Invariance of the variance under addition of a constant](/P/var-inv)
@@ -104,6 +105,7 @@ title: "Proof by Author"
104105
- [Mode of the normal distribution](/P/norm-mode)
105106
- [Moment in terms of moment-generating function](/P/mom-mgf)
106107
- [Moment-generating function of linear combination of independent random variables](/P/mgf-lincomb)
108+
- [Moment-generating function of the beta distribution](/P/beta-mgf)
107109
- [Moment-generating function of the normal distribution](/P/norm-mgf)
108110
- [Monotonicity of the expected value](/P/mean-mono)
109111
- [Non-negativity of the Kullback-Leibler divergence](/P/kl-nonneg)
@@ -138,6 +140,7 @@ title: "Proof by Author"
138140
- [Probability density function of a strictly increasing function of a continuous random variable](/P/pdf-sifct)
139141
- [Probability density function of the Dirichlet distribution](/P/dir-pdf)
140142
- [Probability density function of the beta distribution](/P/beta-pdf)
143+
- [Probability density function of the chi-square distribution](/P/chi2-pdf)
141144
- [Probability density function of the continuous uniform distribution](/P/cuni-pdf)
142145
- [Probability density function of the exponential distribution](/P/exp-pdf)
143146
- [Probability density function of the gamma distribution](/P/gam-pdf)

I/Proof_by_Number.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -202,3 +202,6 @@ title: "Proof by Number"
202202
| P193 | norm-kl | [Kullback-Leibler divergence for the normal distribution](/P/norm-kl) | JoramSoch | 2020-11-19 |
203203
| P194 | gam-qf | [Quantile function of the gamma distribution](/P/gam-qf) | JoramSoch | 2020-11-19 |
204204
| P195 | beta-cdf | [Cumulative distribution function of the beta distribution](/P/beta-cdf) | JoramSoch | 2020-11-19 |
205+
| P196 | norm-gi | [Gaussian integral](/P/norm-gi) | JoramSoch | 2020-11-25 |
206+
| P197 | chi2-pdf | [Probability density function of the chi-square distribution](/P/chi2-pdf) | JoramSoch | 2020-11-25 |
207+
| P198 | beta-mgf | [Moment-generating function of the beta distribution](/P/beta-mgf) | JoramSoch | 2020-11-25 |

I/Proof_by_Topic.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -78,6 +78,7 @@ title: "Proof by Topic"
7878

7979
### G
8080

81+
- [Gaussian integral](/P/norm-gi)
8182
- [Gibbs' inequality](/P/gibbs-ineq)
8283

8384
### I
@@ -144,6 +145,7 @@ title: "Proof by Topic"
144145
- [Moment in terms of moment-generating function](/P/mom-mgf)
145146
- [Moment-generating function of linear combination of independent random variables](/P/mgf-lincomb)
146147
- [Moment-generating function of the Wald distribution](/P/wald-mgf)
148+
- [Moment-generating function of the beta distribution](/P/beta-mgf)
147149
- [Moment-generating function of the normal distribution](/P/norm-mgf)
148150
- [Moments of the chi-square distribution](/P/chi2-mom)
149151
- [Monotonicity of the expected value](/P/mean-mono)
@@ -189,6 +191,7 @@ title: "Proof by Topic"
189191
- [Probability density function of the Dirichlet distribution](/P/dir-pdf)
190192
- [Probability density function of the Wald distribution](/P/wald-pdf)
191193
- [Probability density function of the beta distribution](/P/beta-pdf)
194+
- [Probability density function of the chi-square distribution](/P/chi2-pdf)
192195
- [Probability density function of the continuous uniform distribution](/P/cuni-pdf)
193196
- [Probability density function of the exponential distribution](/P/exp-pdf)
194197
- [Probability density function of the gamma distribution](/P/gam-pdf)

P/beta-cdf.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,12 @@ topic: "Beta distribution"
1414
theorem: "Cumulative distribution function"
1515

1616
sources:
17+
- authors: "Wikipedia"
18+
year: 2020
19+
title: "Beta distribution"
20+
in: "Wikipedia, the free encyclopedia"
21+
pages: "retrieved on 2020-11-19"
22+
url: "https://en.wikipedia.org/wiki/Beta_distribution#Cumulative_distribution_function"
1723
- authors: "Wikipedia"
1824
year: 2020
1925
title: "Beta function"

P/chi2-pdf.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ $$ \label{eq:chi2}
3939
Y \sim \chi^{2}(k) \; .
4040
$$
4141

42-
Then, the [probability density function](/D/pdf) of $X$ is
42+
Then, the [probability density function](/D/pdf) of $Y$ is
4343

4444
$$ \label{eq:chi2-pdf}
4545
f_Y(y) = \frac{1}{2^{k/2} \, \Gamma (k/2)} \, y^{k/2-1} \, e^{-y/2} \; .

0 commit comments

Comments
 (0)