Skip to content

Commit 6a71e73

Browse files
committed
corrected some pages
Several small corrections were done to several proofs and definitions.
1 parent ce4faa5 commit 6a71e73

10 files changed

Lines changed: 22 additions & 22 deletions

File tree

P/beta-mode.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -217,12 +217,12 @@ $$ \label{eq:beta-mode-p2b-s6}
217217
\end{split}
218218
$$
219219

220-
Thus, $f''_X(x)$ is negative for $x = \frac{\alpha-1}{\alpha+\beta-2}$, demonstrating that this is a maximum. To summarize:
220+
Thus, $f'\'\_X(x)$ is negative for $x = \frac{\alpha-1}{\alpha+\beta-2}$, demonstrating that this is a maximum. To summarize:
221221

222222
* If $\alpha < 1$ and $\beta < 1$, then $f_X(x)$ diverges at both ends and both values from the set $\left\lbrace 0, 1 \right\rbrace$ can be seen as the mode of $X$.
223223

224224
* If $\alpha < 1$ or $\beta < 1$ (but not $\alpha < 1$ and $\beta < 1$), then the mode of $X$ is 0 or 1, because $f_X(x)$ tends towards infinity at $x = 0$ or $x = 1$.
225225

226226
* If $\alpha = 1$ and $\beta = 1$, then $f_X(x)$ is constant and any value in the interval $\left[ 0,1 \right]$ can be seen as the mode of $X$.
227227

228-
* If $\alpha \geq 1$ and $\beta \geq 1$ (but not $\alpha = 1$ and $\beta = 1$), then $0 < x = < 1$ and $f'_X(x) = 0$ and $f''_X(x) < 0$, such that $f_X(x)$ reaches its machimum at $\mathrm{mode}(X) = \frac{\alpha-1}{\alpha+\beta-2}$.
228+
* If $\alpha \geq 1$ and $\beta \geq 1$ (but not $\alpha = 1$ and $\beta = 1$), then $0 < x = < 1$ and $f'_X(x) = 0$ and $f'\'\_X(x) < 0$, such that $f_X(x)$ reaches its machimum at $\mathrm{mode}(X) = \frac{\alpha-1}{\alpha+\beta-2}$.

P/betabin-mome.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -108,15 +108,15 @@ m_2 &= \frac{\alpha \left( n + n m_1 - m_1 \right) + n m_1}{\alpha \frac{n}{m_1}
108108
m_2 \left( \frac{\alpha n}{m_1} + 1 \right) &= \alpha \left( n + n m_1 - m_1 \right) + n m_1 \\
109109
\alpha \left( n \frac{m_2}{m_1} - (n + n m_1 - m_1) \right) &= n m_1 - m_2 \\
110110
\alpha \left( n \left( \frac{m_2}{m_1} - m_1 - 1 \right) + m_1 \right) &= n m_1 - m_2 \\
111-
\alpha &= \frac{n m_1 - m_2}{n \left( \frac{m_2}{m_1} - m_1 - 1 \right) + m_1} \; .
111+
\hat{\alpha} &= \frac{n m_1 - m_2}{n \left( \frac{m_2}{m_1} - m_1 - 1 \right) + m_1} \; .
112112
\end{split}
113113
$$
114114

115115
Plugging this into equation \eqref{eq:beta-as-alpha}, one obtains for $\beta$:
116116

117117
$$ \label{eq:binbeta-mome-beta}
118118
\begin{split}
119-
\beta &= \alpha \left( \frac{n}{m_1} - 1 \right) \\
119+
\beta &= \hat{\alpha} \left( \frac{n}{m_1} - 1 \right) \\
120120
\beta &= \left( \frac{n m_1 - m_2}{n \left( \frac{m_2}{m_1} - m_1 - 1 \right) + m_1} \right) \left( \frac{n}{m_1} - 1 \right) \\
121121
\beta &= \frac{n^2 - n m_1 - n \frac{m_2}{m_1} + m_2}{n \left( \frac{m_2}{m_1} - m_1 - 1 \right) + m_1} \\
122122
\hat{\beta} &= \frac{\left( n - m_1 \right)\left( n - \frac{m_2}{m_1} \right)}{n \left( \frac{m_2}{m_1} - m_1 - 1 \right) + m_1} \; .

P/blr-map.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,7 @@ $$
4545
where $n$ is the [number of data points](/D/mlr).
4646

4747

48-
**Proof:** Given the [prior distribution](/D/prior) in \eqref{eq:GLM-NG-prior}, the [posterior distribution](/D/post) for [multiple linear regression](/D/mlr) [is also a normal-gamma distribution](/P/blr-post)
48+
**Proof:** Given the [generative model](/D/gm) in \eqref{eq:GLM} and the [prior distribution](/D/prior) in \eqref{eq:GLM-NG-prior}, the [posterior distribution](/D/post) for [multiple linear regression](/D/mlr) [is also a normal-gamma distribution](/P/blr-post)
4949

5050
$$ \label{eq:GLM-NG-post}
5151
p(\beta,\tau|y) = \mathcal{N}(\beta; \mu_n, (\tau \Lambda_n)^{-1}) \cdot \mathrm{Gam}(\tau; a_n, b_n)

P/chi2-mom.md renamed to P/chi2-momraw.md

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -7,11 +7,11 @@ affiliation: "KU Leuven"
77
e_mail: "kenneth.petrykowski@gmail.com"
88
date: 2020-10-13 01:30:00
99

10-
title: "Moments of the chi-squared distribution"
10+
title: "Raw moments of the chi-squared distribution"
1111
chapter: "Probability Distributions"
1212
section: "Univariate continuous distributions"
1313
topic: "Chi-squared distribution"
14-
theorem: "Moments"
14+
theorem: "Raw moments"
1515

1616
sources:
1717
- authors: "Robert V. Hogg, Joseph W. McKean, Allen T. Craig"
@@ -22,7 +22,7 @@ sources:
2222
url: "https://www.pearson.com/store/p/introduction-to-mathematical-statistics/P100000843744"
2323

2424
proof_id: "P175"
25-
shortcut: "chi2-mom"
25+
shortcut: "chi2-momraw"
2626
username: "kjpetrykowski"
2727
---
2828

@@ -33,16 +33,16 @@ $$ \label{eq:chi2}
3333
X \sim \chi^{2}(k) \; .
3434
$$
3535

36-
Then, if $m > -k/2$, the moment $\mathrm{E}(X^{m})$ exists and is equal to:
36+
Then, if $m > -k/2$, the [raw moment](/D/mom-raw) $\mathrm{E}(X^{m})$ exists and is equal to:
3737

38-
$$ \label{eq:chi2-mom}
38+
$$ \label{eq:chi2-momraw}
3939
\mathrm{E}(X^{m}) = 2^m \frac{\Gamma\left( \frac{k}{2}+m \right)}{\Gamma\left( \frac{k}{2} \right)} \; .
4040
$$
4141

4242

4343
**Proof:** Combining the [definition of the raw moment](/D/mom-raw) with the [probability density function of the chi-squared distribution](/P/chi2-pdf), we have:
4444

45-
$$ \label{eq:chi2-mom-int}
45+
$$ \label{eq:chi2-momraw-int}
4646
\begin{split}
4747
\mathrm{E}(X^{m}) &= \int_{0}^{\infty} x^m \frac{1}{2^{k/2} \Gamma\left( \frac{k}{2} \right)} \, x^{k/2-1} \, e^{-x/2} \, \mathrm{d}x \\
4848
&= \frac{1}{2^{k/2} \Gamma\left( \frac{k}{2} \right)} \int_{0}^{\infty} x^{(k/2)+m-1} \, e^{-x/2} \, \mathrm{d}x \; .
@@ -51,7 +51,7 @@ $$
5151

5252
Now, we substitute $u = x/2$, such that $x = 2u$. As a result, we obtain:
5353

54-
$$ \label{eq:chi2-mom-int-u}
54+
$$ \label{eq:chi2-momraw-int-u}
5555
\begin{split}
5656
\mathrm{E}(X^{m}) &= \frac{1}{2^{k/2} \Gamma\left( \frac{k}{2} \right)} \int_{0}^{\infty} 2^{(k/2)+m-1} \, u^{(k/2)+m-1} \, e^{-u} \, \mathrm{d}(2u) \\
5757
&= \frac{2^{(k/2)+m}}{2^{k/2} \Gamma\left( \frac{k}{2} \right)} \int_{0}^{\infty} u^{(k/2)+m-1} \, e^{-u} \, \mathrm{d}u \\
@@ -65,4 +65,4 @@ $$ \label{eq:gam-fct}
6565
\Gamma(x) = \int_{0}^{\infty} t^{x-1} \, e^{-t} \, \mathrm{d}t, \; z > 0 \; ,
6666
$$
6767

68-
this leads to the desired result when $m > -k/2$. Observe that, if $m$ is a nonnegative integer, then $m > -k/2$ is always true. Therefore, all [moments](/D/mom) of a [chi-squared distribution](/D/chi2) exist and the $m$-th raw moment is given by the equation above.
68+
this leads to the desired result when $m > -k/2$. Observe that, if $m$ is a non-negative integer, then $m > -k/2$ is always true. Therefore, all [moments](/D/mom) of a [chi-squared distribution](/D/chi2) exist and the $m$-th raw moment is given by the equation above.

P/dir-kl.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -27,12 +27,12 @@ username: "JoramSoch"
2727
---
2828

2929

30-
**Theorem:** Let $x$ be an $1 \times k$ [random vector](/D/rvec). Assume two [Dirichlet distributions](/D/dir) $P$ and $Q$ specifying the probability distribution of $x$ as
30+
**Theorem:** Let $X$ be an $1 \times k$ [random vector](/D/rvec). Assume two [Dirichlet distributions](/D/dir) $P$ and $Q$ specifying the probability distribution of $X$ as
3131

3232
$$ \label{eq:dirs}
3333
\begin{split}
34-
P: \; x &\sim \mathrm{Dir}(\alpha_1) \\
35-
Q: \; x &\sim \mathrm{Dir}(\alpha_2) \; .
34+
P: \; X &\sim \mathrm{Dir}(\alpha_1) \\
35+
Q: \; X &\sim \mathrm{Dir}(\alpha_2) \; .
3636
\end{split}
3737
$$
3838

@@ -74,7 +74,7 @@ $$
7474
Using the [expected value of a logarithmized Dirichlet variate](/P/dir-logmean)
7575

7676
$$ \label{eq:dir-logmean}
77-
x \sim \mathrm{Dir}(\alpha) \quad \Rightarrow \quad \left\langle \ln x_i \right\rangle = \psi(\alpha_i) - \psi\left(\sum_{i=1}^{k} \alpha_i\right) \; ,
77+
X \sim \mathrm{Dir}(\alpha) \quad \Rightarrow \quad \left\langle \ln x_i \right\rangle = \psi(\alpha_i) - \psi\left(\sum_{i=1}^{k} \alpha_i\right) \; ,
7878
$$
7979

8080
the Kullback-Leibler divergence from \eqref{eq:dir-KL-s2} becomes:

P/dir-mle.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -108,7 +108,7 @@ $$ \label{eq:Dir-dLLdaj-0}
108108
\end{split}
109109
$$
110110

111-
In the following, we will use a fixed-point iteration to maximize $\mathrm{LL}(\alpha)$. Given an initial guess for $\alpha$, we construct a lower bound on the likelihood function \eqref{eq:Dir-LL-der} which is tight at $\alpha$. The maximum of this bound is computed and it becomes the new guess. Because the [Dirichlet distribution](/D/dir) belongs to the [exponential family](/D/dist-expfam), the log-likelihood function is convex in $\alpha$ ánd the maximum is the only stationary point, such that the procedure is guaranteed to converge to the maximum.
111+
In the following, we will use a fixed-point iteration to maximize $\mathrm{LL}(\alpha)$. Given an initial guess for $\alpha$, we construct a lower bound on the likelihood function \eqref{eq:Dir-LL-der} which is tight at $\alpha$. The maximum of this bound is computed and it becomes the new guess. Because the [Dirichlet distribution](/D/dir) belongs to the [exponential family](/D/dist-expfam), the log-likelihood function is convex in $\alpha$ and the maximum is the only stationary point, such that the procedure is guaranteed to converge to the maximum.
112112

113113
In our case, we use a bound on the gamma function
114114

P/lognorm-med.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -52,7 +52,7 @@ $$ \label{eq:erf}
5252
\mathrm{erf}(x) = \frac{2}{\sqrt{\pi}} \int_{0}^{x} \exp(-t^2) \, \mathrm{d}t \; .
5353
$$
5454

55-
Thus, the inverse CDF is
55+
Thus, the inverse cumulative distribution function is
5656

5757
$$ \label{eq:lognorm-cdf-inv}
5858
\begin{split}

P/lognorm-var.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -84,7 +84,7 @@ $$ \label{eq:second-moment-2}
8484
\end{split}
8585
$$
8686

87-
Now multiplying by $\exp \left( 2 \sigma^2 \right)$ and $\exp \left(- 2 \sigma^2 \right)$, this becomes:
87+
Now multiplying the integrand by $\exp \left( 2 \sigma^2 \right)$ and $\exp \left(- 2 \sigma^2 \right)$, this becomes:
8888

8989
$$ \label{eq:second-moment-3}
9090
\begin{split}

P/mom-mgf.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ where $n$ is a positive integer and $M_X^{(n)}(t)$ is the $n$-th derivative of $
3939
**Proof:** Using the [definition of the moment-generating function](/D/mgf), we can write:
4040

4141
$$ \label{eq:mom-mgf-s1}
42-
M_X^{(n)}(t) = \frac{\mathrm{d}^n}{\mathrm{d}t^n} \mathrm{E}(e^{tX}) \; .
42+
M_X^{(n)}(t) = \frac{\mathrm{d}^n}{\mathrm{d}t^n} \mathrm{E}\left( e^{tX} \right) \; .
4343
$$
4444

4545
Using the power series expansion of the exponential function

P/poiss-lme.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ $$ \label{eq:Poiss-LME}
3939
\log p(y|m) = - \sum_{i=1}^n \log y_i ! + \log \Gamma(a_n) - \log \Gamma(a_0) + a_0 \log b_0 - a_n \log b_n \; .
4040
$$
4141

42-
and the [posterior hyperparameters](/D/post) are given by
42+
where the [posterior hyperparameters](/D/post) are given by
4343

4444
$$ \label{eq:Poiss-post-par}
4545
\begin{split}

0 commit comments

Comments
 (0)