Skip to content

Commit 01f147c

Browse files
authored
Merge pull request #276 from JoramSoch/master
added 1 definition and 1 proof
2 parents 4a638f4 + 655ff2a commit 01f147c

3 files changed

Lines changed: 142 additions & 14 deletions

File tree

D/dist-uni.md

Lines changed: 46 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,46 @@
1+
---
2+
layout: definition
3+
mathjax: true
4+
5+
author: "Joram Soch"
6+
affiliation: "BCCN Berlin"
7+
e_mail: "joram.soch@bccn-berlin.de"
8+
date: 2024-10-25 12:04:40
9+
10+
title: "Unimodal and multimodal probability distribution"
11+
chapter: "General Theorems"
12+
section: "Probability theory"
13+
topic: "Probability distributions"
14+
definition: "Unimodal vs. multimodal"
15+
16+
sources:
17+
- authors: "Weisstein, Eric W."
18+
year: 2024
19+
title: "Mode"
20+
in: "Wolfram MathWorld"
21+
pages: "retrieved on 2024-10-25"
22+
url: "https://mathworld.wolfram.com/Mode.html"
23+
- authors: "Wikipedia"
24+
year: 2024
25+
title: "Unimodality"
26+
in: "Wikipedia, the free encyclopedia"
27+
pages: "retrieved on 2024-10-25"
28+
url: "https://en.wikipedia.org/wiki/Unimodality#Unimodal_probability_distribution"
29+
30+
def_id: "D207"
31+
shortcut: "dist-uni"
32+
username: "JoramSoch"
33+
---
34+
35+
36+
**Definition:** Let $X$ be a [continuous](/D/rvar-disc) [random variable](/D/rvar) with some [probability distribution](/D/dist) $P$ characterized by [probability density function](/P/pdf) $f_X(x)$. Then,
37+
38+
* $P$ is called a unimodal probability distribution, if $f_X(x)$ has exactly one maximum;
39+
40+
* $P$ is called a bimodal probability distribution, if $f_X(x)$ has exactly two maxima;
41+
42+
* $P$ is called a trimodal probability distribution, if $f_X(x)$ has exactly three maxima;
43+
44+
* $P$ is called a multimodal probability distribution, if $f_X(x)$ has more than one maximum.
45+
46+
Note that this definition of multimodality differs from the [strict definition of the mode](/D/mode) in which only the global maximum of $f_X(x)$ [would be considered the single mode](/D/mode).

I/ToC.md

Lines changed: 16 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -68,9 +68,10 @@ title: "Table of Contents"
6868
&emsp;&ensp; 1.5.2. *[Joint distribution](/D/dist-joint)* <br>
6969
&emsp;&ensp; 1.5.3. *[Marginal distribution](/D/dist-marg)* <br>
7070
&emsp;&ensp; 1.5.4. *[Conditional distribution](/D/dist-cond)* <br>
71-
&emsp;&ensp; 1.5.5. *[Sampling distribution](/D/dist-samp)* <br>
72-
&emsp;&ensp; 1.5.6. *[Statistical parameter](/D/para)* <br>
73-
&emsp;&ensp; 1.5.7. *[Degrees of freedom](/D/dof)* <br>
71+
&emsp;&ensp; 1.5.5. *[Unimodal vs. multimodal distribution](/D/dist-uni)* <br>
72+
&emsp;&ensp; 1.5.6. *[Sampling distribution](/D/dist-samp)* <br>
73+
&emsp;&ensp; 1.5.7. *[Statistical parameter](/D/para)* <br>
74+
&emsp;&ensp; 1.5.8. *[Degrees of freedom](/D/dof)* <br>
7475

7576
<p id="Probability mass function"></p>
7677
1.6. Probability mass function <br>
@@ -591,17 +592,18 @@ title: "Table of Contents"
591592
&emsp;&ensp; 4.1.4. *[Bivariate normal distribution](/D/bvn)* <br>
592593
&emsp;&ensp; 4.1.5. **[Probability density function of the bivariate normal distribution](/P/bvn-pdf)** <br>
593594
&emsp;&ensp; 4.1.6. **[Probability density function in terms of correlation coefficient](/P/bvn-pdfcorr)** <br>
594-
&emsp;&ensp; 4.1.7. **[Probability density function](/P/mvn-pdf)** <br>
595-
&emsp;&ensp; 4.1.8. **[Moment-generating function](/P/mvn-mgf)** <br>
596-
&emsp;&ensp; 4.1.9. **[Mean](/P/mvn-mean)** <br>
597-
&emsp;&ensp; 4.1.10. **[Covariance](/P/mvn-cov)** <br>
598-
&emsp;&ensp; 4.1.11. **[Differential entropy](/P/mvn-dent)** <br>
599-
&emsp;&ensp; 4.1.12. **[Kullback-Leibler divergence](/P/mvn-kl)** <br>
600-
&emsp;&ensp; 4.1.13. **[Linear transformation](/P/mvn-ltt)** <br>
601-
&emsp;&ensp; 4.1.14. **[Marginal distributions](/P/mvn-marg)** <br>
602-
&emsp;&ensp; 4.1.15. **[Conditional distributions](/P/mvn-cond)** <br>
603-
&emsp;&ensp; 4.1.16. **[Conditions for independence](/P/mvn-ind)** <br>
604-
&emsp;&ensp; 4.1.17. **[Independence of products](/P/mvn-indprod)** <br>
595+
&emsp;&ensp; 4.1.7. **[Linear combination of bivariate normal random variables](/P/bvn-lincomb)** <br>
596+
&emsp;&ensp; 4.1.8. **[Probability density function](/P/mvn-pdf)** <br>
597+
&emsp;&ensp; 4.1.9. **[Moment-generating function](/P/mvn-mgf)** <br>
598+
&emsp;&ensp; 4.1.10. **[Mean](/P/mvn-mean)** <br>
599+
&emsp;&ensp; 4.1.11. **[Covariance](/P/mvn-cov)** <br>
600+
&emsp;&ensp; 4.1.12. **[Differential entropy](/P/mvn-dent)** <br>
601+
&emsp;&ensp; 4.1.13. **[Kullback-Leibler divergence](/P/mvn-kl)** <br>
602+
&emsp;&ensp; 4.1.14. **[Linear transformation](/P/mvn-ltt)** <br>
603+
&emsp;&ensp; 4.1.15. **[Marginal distributions](/P/mvn-marg)** <br>
604+
&emsp;&ensp; 4.1.16. **[Conditional distributions](/P/mvn-cond)** <br>
605+
&emsp;&ensp; 4.1.17. **[Conditions for independence](/P/mvn-ind)** <br>
606+
&emsp;&ensp; 4.1.18. **[Independence of products](/P/mvn-indprod)** <br>
605607

606608
<p id="Multivariate t-distribution"></p>
607609
4.2. Multivariate t-distribution <br>

P/bvn-lincomb.md

Lines changed: 80 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,80 @@
1+
---
2+
layout: proof
3+
mathjax: true
4+
5+
author: "Joram Soch"
6+
affiliation: "BCCN Berlin"
7+
e_mail: "joram.soch@bccn-berlin.de"
8+
date: 2024-10-25 11:59:37
9+
10+
title: "Linear combination of bivariate normal random variables"
11+
chapter: "Probability Distributions"
12+
section: "Multivariate continuous distributions"
13+
topic: "Multivariate normal distribution"
14+
theorem: "Linear combination of bivariate normal random variables"
15+
16+
sources:
17+
- authors: "Wikipedia"
18+
year: 2024
19+
title: "Misconceptions about the normal distribution"
20+
in: "Wikipedia, the free encyclopedia"
21+
pages: "retrieved on 2024-10-25"
22+
url: "https://en.wikipedia.org/wiki/Misconceptions_about_the_normal_distribution"
23+
24+
proof_id: "P475"
25+
shortcut: "bvn-lincomb"
26+
username: "JoramSoch"
27+
---
28+
29+
30+
**Theorem:** Let $X$ and $Y$ follow a [bivariate normal distribution](/D/bvn):
31+
32+
$$ \label{eq:bvn}
33+
\left[ \begin{matrix} X \\ Y \end{matrix} \right] \sim
34+
\mathcal{N}\left( \left[ \begin{matrix} \mu_1 \\ \mu_2 \end{matrix} \right], \left[ \begin{matrix} \sigma_1^2 & \sigma_{12} \\ \sigma_{12} & \sigma_2^2 \end{matrix} \right] \right) \; .
35+
$$
36+
37+
Then, any linear combination of $X$ and $Y$ follows a [univariate normal distribution](/D/norm):
38+
39+
$$ \label{eq:bvn-lincomb}
40+
Z = a X + b Y \sim
41+
\mathcal{N}\left( a \mu_1 + b \mu_2, a^2 \sigma_1^2 + 2ab \sigma_{12} + b^2 \sigma_2^2 \right) \; .
42+
$$
43+
44+
45+
**Proof:** The [linear transformation theorem for the multivariate normal distribution](/P/mvn-ltt) states that
46+
47+
$$ \label{eq:mvn-ltt}
48+
X \sim \mathcal{N}(\mu, \Sigma) \quad \Rightarrow \quad Y = AX + c \sim \mathcal{N}(A\mu + c, A \Sigma A^\mathrm{T})
49+
$$
50+
51+
where $X \in \mathbb{R}^n$, $A \in \mathbb{R}^{n \times n}$ and $c \in \mathbb{R}^n$. In the present case, we have
52+
53+
$$ \label{eq:X-A-a}
54+
X \in \mathbb{R}^2
55+
\quad \text{and} \quad
56+
A = \left[ \begin{matrix} a & b \end{matrix} \right] \in \mathbb{R}^{1 \times 2}
57+
\quad \text{and} \quad
58+
c = 0 \in \mathbb{R} \; ,
59+
$$
60+
61+
such that
62+
63+
$$ \label{eq:Z-X-Y}
64+
Z
65+
= A \left[ \begin{matrix} X \\ Y \end{matrix} \right] + c
66+
= \left[ \begin{matrix} a & b \end{matrix} \right] \left[ \begin{matrix} X \\ Y \end{matrix} \right] + 0
67+
= a X + b Y \; .
68+
$$
69+
70+
Combining \eqref{eq:mvn-ltt}, \eqref{eq:bvn} and \eqref{eq:Z-X-Y}, it follows that
71+
72+
$$ \label{eq:bvn-lincomb-qed}
73+
\begin{split}
74+
Z
75+
&\sim \mathcal{N}\left( \left[ \begin{matrix} a & b \end{matrix} \right] \left[ \begin{matrix} \mu_1 \\ \mu_2 \end{matrix} \right], \left[ \begin{matrix} a & b \end{matrix} \right] \left[ \begin{matrix} \sigma_1^2 & \sigma_{12} \\ \sigma_{12} & \sigma_2^2 \end{matrix} \right] \left[ \begin{matrix} a \\ b \end{matrix} \right] \right) \\
76+
&\sim \mathcal{N}\left( a \mu_1 + b \mu_2, \left[ \begin{matrix} a \sigma_1^2 + b \sigma_{12} & a \sigma_{12} + b \sigma_2^2 \end{matrix} \right] \left[ \begin{matrix} a \\ b \end{matrix} \right] \right) \\
77+
&\sim \mathcal{N}\left( a \mu_1 + b \mu_2, (a^2 \sigma_1^2 + ab \sigma_{12}) + (ab \sigma_{12} + b^2 \sigma_2^2) \right) \\
78+
&\sim \mathcal{N}\left( a \mu_1 + b \mu_2, a^2 \sigma_1^2 + 2ab \sigma_{12} + b^2 \sigma_2^2 \right) \; .
79+
\end{split}
80+
$$

0 commit comments

Comments
 (0)