Skip to content

Commit d74f5cc

Browse files
committed
corrected some pages
Several small mistakes/errors were corrected in several proofs/definitions.
1 parent b9bcfed commit d74f5cc

File tree

10 files changed

+21
-21
lines changed

10 files changed

+21
-21
lines changed

D/chi2.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,7 @@ $$\label{eq:chi2}
4545
Y = \sum_{i=1}^{k} X_{i}^{2} \sim \chi^{2}(k) \quad \text{where} \quad k > 0 \; .
4646
$$
4747

48-
A [random variable](/D/rvar) $Y$ is said said to follow a chi-square distribution with $k$ number of degress of freedom, if and only if its [probability density function](/D/pdf) is given by
48+
The [probability density function of the chi-square distribution](/P/chi2-pdf) with $k$ degress of freedom is
4949

5050
$$ \label{eq:chi2-pdf}
5151
\chi^{2}(x; k) = \frac{1}{2^{k/2}\Gamma (k/2)} \, x^{k/2-1} \, e^{-x/2}

D/eblme.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ $$ \label{eq:ML}
3939
p(y \vert \lambda, m) = \int p(y \vert \theta, \lambda, m) \, (\theta \vert \lambda, m) \, \mathrm{d}\theta
4040
$$
4141

42-
and
42+
[and](/D/prior-eb)
4343

4444
$$ \label{eq:EB}
4545
\hat{\lambda} = \operatorname*{arg\,max}_{\lambda} \log p(y \vert \lambda, m) \; .

D/prior-emp.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ username: "JoramSoch"
2828
---
2929

3030

31-
**Definition:** Let $p(\theta \vert m)$ a [prior distribution](/D/prior) for the parameter $\theta$ of a [generative model](/D/gm) $m$. Then,
31+
**Definition:** Let $p(\theta \vert m)$ be a [prior distribution](/D/prior) for the parameter $\theta$ of a [generative model](/D/gm) $m$. Then,
3232

3333
* the distribution is called an "empirical prior", if it has been [derived from empirical data](/P/post-jl);
3434

D/prior-flat.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -27,15 +27,15 @@ sources:
2727
in: "NeuroImage"
2828
pages: "vol. 16, iss. 2, pp. 484-512, fn. 10"
2929
url: "https://www.sciencedirect.com/science/article/pii/S1053811902910918"
30-
doi: "10.1006/nimg.2002.1091"^
30+
doi: "10.1006/nimg.2002.1091"
3131

3232
def_id: "D116"
3333
shortcut: "prior-flat"
3434
username: "JoramSoch"
3535
---
3636

3737

38-
**Definition:** Let $p(\theta \vert m)$ a [prior distribution](/D/prior) for the parameter $\theta$ of a [generative model](/D/gm) $m$. Then,
38+
**Definition:** Let $p(\theta \vert m)$ be a [prior distribution](/D/prior) for the parameter $\theta$ of a [generative model](/D/gm) $m$. Then,
3939

4040
* the distribution is called a "flat prior", if its [precision](/D/prec) is zero or [variance](/D/var) is infinite;
4141

D/prior-inf.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,10 +28,10 @@ username: "JoramSoch"
2828
---
2929

3030

31-
**Definition:** Let $p(\theta \vert m)$ a [prior distribution](/D/prior) for the parameter $\theta$ of a [generative model](/D/gm) $m$. Then,
31+
**Definition:** Let $p(\theta \vert m)$ be a [prior distribution](/D/prior) for the parameter $\theta$ of a [generative model](/D/gm) $m$. Then,
3232

3333
* the distribution is called an "informative prior", if it biases the parameter towards particular values;
3434

3535
* the distribution is called a "weakly informative prior", if it mildly [influences the posterior distribution](/P/post-jl);
3636

37-
* the distribution is called a "non-informative prior", if it does not influence the [posterior hyperparameters](/D/post).
37+
* the distribution is called a "non-informative prior", if it does not [influence](/P/post-jl) the [posterior hyperparameters](/D/post).

D/prior-ref.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -30,5 +30,5 @@ username: "JoramSoch"
3030
**Definition:** Let $m$ be a [generative model](/D/gm) with [likelihood function](/D/lf) $p(y \vert \theta, m)$ and [prior distribution](/D/prior) $p(\theta \vert \lambda, m)$ using [prior hyperparameters](/D/prior) $\lambda$. Let $p(\theta \vert y, \lambda, m)$ be the [posterior distribution](/D/post) that is [proportional to the the joint likelihood](/P/post-jl). Then, the prior distribution is called a "reference prior", if it maximizes the [expected](/D/mean) [Kullback-Leibler divergence](/D/kl) of the posterior distribution relative to the prior distribution:
3131

3232
$$ \label{eq:prior-ref}
33-
\lambda_{\mathrm{ref}} = \operatorname*{arg\,max}_{\lambda} \mathrm{KL} \left[ p(\theta \vert y, \lambda, m) \, || \, p(\theta \vert \lambda, m) \right] \; .
33+
\lambda_{\mathrm{ref}} = \operatorname*{arg\,max}_{\lambda} \left\langle \mathrm{KL} \left[ p(\theta \vert y, \lambda, m) \, || \, p(\theta \vert \lambda, m) \right] \right\rangle \; .
3434
$$

D/prior-uni.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -27,8 +27,8 @@ username: "JoramSoch"
2727
---
2828

2929

30-
**Definition:** Let $p(\theta \vert m)$ a [prior distribution](/D/prior) for the parameter $\theta \in \Theta$ of a [generative model](/D/gm) $m$. Then,
30+
**Definition:** Let $p(\theta \vert m)$ be a [prior distribution](/D/prior) for the parameter $\theta$ of a [generative model](/D/gm) $m$ where $\theta$ belongs to the parameter space $\Theta$. Then,
3131

32-
* the distribution is called a "uniform prior", if its [density](/D/pdf) is constant over the entire parameter space $\Theta$;
32+
* the distribution is called a "uniform prior", if its [density](/D/pdf) or [mass](/D/pmf) is constant over $\Theta$;
3333

34-
* the distribution is called a "non-uniform prior", if its [density](/D/pdf) is not constant over the parameter space $\Theta$.
34+
* the distribution is called a "non-uniform prior", if its [density](/D/pdf) or [mass](/D/pmf) is not constant over $\Theta$.

D/rvar-uni.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ username: "JoramSoch"
2929

3030
**Definition:** Let $X$ be a [random variable](/D/rvar) with possible outcomes $\mathcal{X}$. Then,
3131

32-
* $X$ is called a two-valued random variable or [random event](/D/reve), if $\mathcal{X}$ has exactly two elements, e.g. $\mathcal{X} = \left\lbrace \mathrm{true}, \mathrm{false} \right\rbrace$ or $\mathcal{X} = \left\lbrace 1, 0 \right\rbrace$;
32+
* $X$ is called a two-valued random variable or [random event](/D/reve), if $\mathcal{X}$ has exactly two elements, e.g. $\mathcal{X} = \left\lbrace E, \overline{E} \right\rbrace$ or $\mathcal{X} = \left\lbrace \mathrm{true}, \mathrm{false} \right\rbrace$ or $\mathcal{X} = \left\lbrace 1, 0 \right\rbrace$;
3333

3434
* $X$ is called a univariate random variable or [random scalar](/D/rvar), if $\mathcal{X}$ is one-dimensional, i.e. (a subset of) the real numbers $\mathbb{R}$;
3535

P/dent-add.md

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -51,36 +51,36 @@ $$
5151
If $a > 0$, then $g(X)$ is a [strictly increasing function, such that the probability density function](/P/pdf-sifct) of $Y$ is
5252

5353
$$ \label{eq:Y-pdf-c1}
54-
f_Y(y) = f_X(g^{-1}(y)) \, \frac{\mathrm{d}g^{-1}(y)}{\mathrm{d}y} \overset{\eqref{eq:X-Y}}{=} \frac{1}{a} \, f_X\left(\frac{y}{a}\right) \; ,
54+
f_Y(y) = f_X(g^{-1}(y)) \, \frac{\mathrm{d}g^{-1}(y)}{\mathrm{d}y} \overset{\eqref{eq:X-Y}}{=} \frac{1}{a} \, f_X\left(\frac{y}{a}\right) \; ;
5555
$$
5656

57-
and if $a < 0$, then $g(X)$ is a [strictly decreasing function, such that the probability density function](/P/pdf-sifct) of $Y$ is
57+
if $a < 0$, then $g(X)$ is a [strictly decreasing function, such that the probability density function](/P/pdf-sdfct) of $Y$ is
5858

5959
$$ \label{eq:Y-pdf-c2}
60-
f_Y(y) = - f_X(g^{-1}(y)) \, \frac{\mathrm{d}g^{-1}(y)}{\mathrm{d}y} \overset{\eqref{eq:X-Y}}{=} -\frac{1}{a} \, f_X\left(\frac{y}{a}\right) \; ,
60+
f_Y(y) = - f_X(g^{-1}(y)) \, \frac{\mathrm{d}g^{-1}(y)}{\mathrm{d}y} \overset{\eqref{eq:X-Y}}{=} -\frac{1}{a} \, f_X\left(\frac{y}{a}\right) \; ;
6161
$$
6262

63-
such that we can write
63+
thus, we can write
6464

6565
$$ \label{eq:Y-pdf}
66-
f_Y(y) = \left| \frac{1}{a} \right| \, f_X\left(\frac{y}{a}\right) \; .
66+
f_Y(y) = \frac{1}{|a|} \, f_X\left(\frac{y}{a}\right) \; .
6767
$$
6868

6969
Writing down the differential entropy for $Y$, we have:
7070

7171
$$ \label{eq:Y-dent-s1}
7272
\begin{split}
7373
\mathrm{h}(Y) &= - \int_{\mathcal{Y}} f_Y(y) \log f_Y(y) \, \mathrm{d}y \\
74-
&\overset{\eqref{eq:Y-pdf}}{=} - \int_{\mathcal{Y}} \left| \frac{1}{a} \right| \, f_X\left(\frac{y}{a}\right) \log \left[ \left| \frac{1}{a} \right| \, f_X\left(\frac{y}{a}\right) \right] \, \mathrm{d}y
74+
&\overset{\eqref{eq:Y-pdf}}{=} - \int_{\mathcal{Y}} \frac{1}{|a|} \, f_X\left(\frac{y}{a}\right) \log \left[ \frac{1}{|a|} \, f_X\left(\frac{y}{a}\right) \right] \, \mathrm{d}y
7575
\end{split}
7676
$$
7777

7878
Substituting $x = y/a$, such that $y = ax$, this yields:
7979

8080
$$ \label{eq:Y-dent-s2}
8181
\begin{split}
82-
\mathrm{h}(Y) &= - \int_{\left\lbrace y/a \,|\, y \in {\mathcal{Y}} \right\rbrace} \left| \frac{1}{a} \right| \, f_X\left(\frac{ax}{a}\right) \log \left[ \left| \frac{1}{a} \right| \, f_X\left(\frac{ax}{a}\right) \right] \, \mathrm{d}(ax) \\
83-
&= - \int_{\mathcal{X}} f_X(x) \log \left[ \left| \frac{1}{a} \right| \, f_X(x) \right] \, \mathrm{d}x \\
82+
\mathrm{h}(Y) &= - \int_{\left\lbrace y/a \,|\, y \in {\mathcal{Y}} \right\rbrace} \frac{1}{|a|} \, f_X\left(\frac{ax}{a}\right) \log \left[ \frac{1}{|a|} \, f_X\left(\frac{ax}{a}\right) \right] \, \mathrm{d}(ax) \\
83+
&= - \int_{\mathcal{X}} f_X(x) \log \left[ \frac{1}{|a|} \, f_X(x) \right] \, \mathrm{d}x \\
8484
&= - \int_{\mathcal{X}} f_X(x) \left[ \log f_X(x) - \log |a| \right] \, \mathrm{d}x \\
8585
&= - \int_{\mathcal{X}} f_X(x) \log f_X(x) \, \mathrm{d}x + \log |a| \int_{\mathcal{X}} f_X(x) \, \mathrm{d}x \\
8686
&\overset{\eqref{eq:X-dent}}{=} \mathrm{h}(X) + \log |a| \; .

P/dent-inv.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,7 @@ where $p(x) = f_X(x)$ is the [probability density function](/D/pdf) of $X$.
4545
Define the mappings between $X$ and $Y = X + c$ as
4646

4747
$$ \label{eq:X-Y}
48-
Y = g(X) = X + c \quad \Leftrightarrow \quad X = g^{-1}(Y) = X - c \; .
48+
Y = g(X) = X + c \quad \Leftrightarrow \quad X = g^{-1}(Y) = Y - c \; .
4949
$$
5050

5151
Note that $g(X)$ is a [strictly increasing function, such that the probability density function](/P/pdf-sifct) of $Y$ is

0 commit comments

Comments
 (0)