Skip to content

Commit 21938a0

Browse files
committed
corrected some pages
Several small corrections were done to several proofs and definitions.
1 parent 02acf59 commit 21938a0

4 files changed

Lines changed: 46 additions & 8 deletions

File tree

D/para.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,6 @@ username: "JoramSoch"
2727
---
2828

2929

30-
**Definition:** A parameter, also "statistical parameter", is any fixed quantity, i.e. [constant](/D/const) scalar, vector or matrix, that describes a parametrized [probability distribution](/D/dist).
30+
**Definition:** A parameter, also "statistical parameter", is any fixed quantity, i.e. [constant](/D/const) scalar, vector or matrix, that describes a parametrized [probability distribution](/D/dist) by influencing its [probability mass function](/D/pmf) or [probability density function](/D/pdf).
3131

3232
Examples of parameters include the mean and variance parameters of a [normal distribution](/D/norm), covariance parameters in a [multivariate](/D/mvn) or [matrix](/D/matn)-normal distribution, shape and rate parameters of the [gamma distribution](/D/gam) or the vector of category probabilities in a [multinomial distribution](/D/mult).

P/anova1-repara.md

Lines changed: 42 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -90,12 +90,50 @@ y_{ij} = \mu + \delta_i + \varepsilon_{ij} &= \mu_i + \varepsilon_{ij} = y_{ij}
9090
\end{split}
9191
$$
9292

93-
2) Equation \eqref{eq:anova1-repara} is a special case of the [two-way analysis of variance](/D/anova2) with (i) just one factor $A$ and (ii) no interaction term. Thus, OLS estimates are identical to [that of two-way ANOVA](/P/anova2-ols), i.e. given by
93+
2) The [residual sum of squares](/D/rss) for the reparametrized model is
9494

95-
$$ \label{eq:anova1-repara-c2-qed}
95+
$$ \label{eq:anova1-repara-rss}
96+
\mathrm{RSS}(\mu,\delta) = \sum_{i=1}^{k} \sum_{j=1}^{n_i} \varepsilon_{ijk}^2 = \sum_{i=1}^{k} \sum_{j=1}^{n_i} (y_{ij} - \mu - \delta_i)^2
97+
$$
98+
99+
and the derivatives of $\mathrm{RSS}$ with respect to $\mu$, $\delta$ are
100+
101+
$$ \label{eq:anova1-repara-rss-der-mu}
102+
\begin{split}
103+
\frac{\mathrm{d}\mathrm{RSS}}{\mathrm{d}\mu}
104+
&= \sum_{i=1}^{k} \sum_{j=1}^{n_i} \frac{\mathrm{d}}{\mathrm{d}\mu} (y_{ij} - \mu - \delta_i)^2 \\
105+
&= \sum_{i=1}^{k} \sum_{j=1}^{n_i} -2 (y_{ij} - \mu - \delta_i) \\
106+
&= \sum_{i=1}^{k} \left( 2 n_i \mu + 2 n_i \delta_i - 2 \sum_{j=1}^{n_i} y_{ij} \right) \\
107+
&= 2 n \mu + 2 \sum_{i=1}^{k} n_i \delta_i - 2 \sum_{i=1}^{k} \sum_{j=1}^{n_i} y_{ij}
108+
\end{split}
109+
$$
110+
111+
$$ \label{eq:anova1-repara-rss-der-delta}
112+
\begin{split}
113+
\frac{\mathrm{d}\mathrm{RSS}}{\mathrm{d}\delta_i}
114+
&= \sum_{j=1}^{n_i} \frac{\mathrm{d}}{\mathrm{d}\delta_i} (y_{ij} - \mu - \delta_i)^2 \\
115+
&= \sum_{j=1}^{n_i} -2 (y_{ij} - \mu - \delta_i) \\
116+
&= 2 n_i \mu + 2 n_i \delta_i - 2 \sum_{j=1}^{n_i} y_{ij} \; .
117+
\end{split}
118+
$$
119+
120+
Setting these derivatives to zero, we obtain the estimates of $\mu$ and $\delta_i$:
121+
122+
$$ \label{eq:anova1-repara-rss-der-mu-zero}
123+
\begin{split}
124+
0 &= 2 n \hat{\mu} + 2 \sum_{i=1}^{k} n_i \delta_i - 2 \sum_{i=1}^{k} \sum_{j=1}^{n_i} y_{ij} \\
125+
\hat{\mu} &= \frac{1}{n} \sum_{i=1}^{k} \sum_{j=1}^{n_i} y_{ij} - \sum_{i=1}^{k} \frac{n_i}{n} \delta_i \\
126+
&\overset{\eqref{eq:anova1-constr}}{=} \frac{1}{n} \sum_{i=1}^{k} \sum_{j=1}^{n_i} y_{ij} \\
127+
&= \bar{y}
128+
\end{split}
129+
$$
130+
131+
$$ \label{eq:anova1-repara-rss-der-delta-zero}
96132
\begin{split}
97-
\hat{\mu} &= \bar{y}_{\bullet \bullet} = \frac{1}{n} \sum_{i=1}^{k} \sum_{j=1}^{n_i} y_{ij} \\
98-
\hat{\delta}_i &= \bar{y}_{i \bullet} - \bar{y}_{\bullet \bullet} = \frac{1}{n_i} \sum_{j=1}^{n_i} y_{ij} - \frac{1}{n} \sum_{i=1}^{k} \sum_{j=1}^{n_i} y_{ij} \; .
133+
0 &= 2 n_i \hat{\mu} + 2 n_i \hat{\delta}_i - 2 \sum_{j=1}^{n_i} y_{ij} \\
134+
\hat{\delta}_i &= \frac{1}{n_i} \sum_{j=1}^{n_i} y_{ij} - \hat{\mu} \\
135+
&\overset{\eqref{eq:rss-der-mu-zero}}{=} \frac{1}{n_i} \sum_{j=1}^{n_i} y_{ij} - \frac{1}{n} \sum_{i=1}^{k} \sum_{j=1}^{n_i} y_{ij} \\
136+
&= \bar{y}_i - \bar{y} \; .
99137
\end{split}
100138
$$
101139

P/anova2-ols.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -122,7 +122,7 @@ $$ \label{eq:rss-der-gamma}
122122
\end{split}
123123
$$
124124

125-
Setting these derivatives to zero, we obtain the estimates of $\mu_i$, $\alpha_i$, $\beta_j$ and $\gamma_{ij}$:
125+
Setting these derivatives to zero, we obtain the estimates of $\mu$, $\alpha_i$, $\beta_j$ and $\gamma_{ij}$:
126126

127127
$$ \label{eq:rss-der-mu-zero}
128128
\begin{split}

P/med-mae.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -64,8 +64,8 @@ Applying Leibniz's rule, we can differentiate the objective function as follows:
6464

6565
$$ \label{eq:med-mae-s2}
6666
\begin{split}
67-
& \frac{\partial}{\partial a} \left( \int_{-\infty}^a (a - x) f(x) \, \mathrm{d}x + \int_{a}^\infty (x - a) f(x) \, \mathrm{d}x \right) \\
68-
= & (a - x) f(x) + \int_{-\infty}^a f(x) \, \mathrm{d}x - (x - a) f(x) - \int_{a}^\infty f(x) \, \mathrm{d}x \; .
67+
&\frac{\partial}{\partial a} \left( \int_{-\infty}^a (a - x) f(x) \, \mathrm{d}x + \int_{a}^\infty (x - a) f(x) \, \mathrm{d}x \right) \\
68+
=\; &(a - x) f(x) + \int_{-\infty}^a f(x) \, \mathrm{d}x - (x - a) f(x) - \int_{a}^\infty f(x) \, \mathrm{d}x \; .
6969
\end{split}
7070
$$
7171

0 commit comments

Comments
 (0)