|
51 | 51 | If $a > 0$, then $g(X)$ is a [strictly increasing function, such that the probability density function](/P/pdf-sifct) of $Y$ is |
52 | 52 |
|
53 | 53 | $$ \label{eq:Y-pdf-c1} |
54 | | -f_Y(y) = f_X(g^{-1}(y)) \, \frac{\mathrm{d}g^{-1}(y)}{\mathrm{d}y} \overset{\eqref{eq:X-Y}}{=} \frac{1}{a} \, f_X\left(\frac{y}{a}\right) \; , |
| 54 | +f_Y(y) = f_X(g^{-1}(y)) \, \frac{\mathrm{d}g^{-1}(y)}{\mathrm{d}y} \overset{\eqref{eq:X-Y}}{=} \frac{1}{a} \, f_X\left(\frac{y}{a}\right) \; ; |
55 | 55 | $$ |
56 | 56 |
|
57 | | -and if $a < 0$, then $g(X)$ is a [strictly decreasing function, such that the probability density function](/P/pdf-sifct) of $Y$ is |
| 57 | +if $a < 0$, then $g(X)$ is a [strictly decreasing function, such that the probability density function](/P/pdf-sdfct) of $Y$ is |
58 | 58 |
|
59 | 59 | $$ \label{eq:Y-pdf-c2} |
60 | | -f_Y(y) = - f_X(g^{-1}(y)) \, \frac{\mathrm{d}g^{-1}(y)}{\mathrm{d}y} \overset{\eqref{eq:X-Y}}{=} -\frac{1}{a} \, f_X\left(\frac{y}{a}\right) \; , |
| 60 | +f_Y(y) = - f_X(g^{-1}(y)) \, \frac{\mathrm{d}g^{-1}(y)}{\mathrm{d}y} \overset{\eqref{eq:X-Y}}{=} -\frac{1}{a} \, f_X\left(\frac{y}{a}\right) \; ; |
61 | 61 | $$ |
62 | 62 |
|
63 | | -such that we can write |
| 63 | +thus, we can write |
64 | 64 |
|
65 | 65 | $$ \label{eq:Y-pdf} |
66 | | -f_Y(y) = \left| \frac{1}{a} \right| \, f_X\left(\frac{y}{a}\right) \; . |
| 66 | +f_Y(y) = \frac{1}{|a|} \, f_X\left(\frac{y}{a}\right) \; . |
67 | 67 | $$ |
68 | 68 |
|
69 | 69 | Writing down the differential entropy for $Y$, we have: |
70 | 70 |
|
71 | 71 | $$ \label{eq:Y-dent-s1} |
72 | 72 | \begin{split} |
73 | 73 | \mathrm{h}(Y) &= - \int_{\mathcal{Y}} f_Y(y) \log f_Y(y) \, \mathrm{d}y \\ |
74 | | -&\overset{\eqref{eq:Y-pdf}}{=} - \int_{\mathcal{Y}} \left| \frac{1}{a} \right| \, f_X\left(\frac{y}{a}\right) \log \left[ \left| \frac{1}{a} \right| \, f_X\left(\frac{y}{a}\right) \right] \, \mathrm{d}y |
| 74 | +&\overset{\eqref{eq:Y-pdf}}{=} - \int_{\mathcal{Y}} \frac{1}{|a|} \, f_X\left(\frac{y}{a}\right) \log \left[ \frac{1}{|a|} \, f_X\left(\frac{y}{a}\right) \right] \, \mathrm{d}y |
75 | 75 | \end{split} |
76 | 76 | $$ |
77 | 77 |
|
78 | 78 | Substituting $x = y/a$, such that $y = ax$, this yields: |
79 | 79 |
|
80 | 80 | $$ \label{eq:Y-dent-s2} |
81 | 81 | \begin{split} |
82 | | -\mathrm{h}(Y) &= - \int_{\left\lbrace y/a \,|\, y \in {\mathcal{Y}} \right\rbrace} \left| \frac{1}{a} \right| \, f_X\left(\frac{ax}{a}\right) \log \left[ \left| \frac{1}{a} \right| \, f_X\left(\frac{ax}{a}\right) \right] \, \mathrm{d}(ax) \\ |
83 | | -&= - \int_{\mathcal{X}} f_X(x) \log \left[ \left| \frac{1}{a} \right| \, f_X(x) \right] \, \mathrm{d}x \\ |
| 82 | +\mathrm{h}(Y) &= - \int_{\left\lbrace y/a \,|\, y \in {\mathcal{Y}} \right\rbrace} \frac{1}{|a|} \, f_X\left(\frac{ax}{a}\right) \log \left[ \frac{1}{|a|} \, f_X\left(\frac{ax}{a}\right) \right] \, \mathrm{d}(ax) \\ |
| 83 | +&= - \int_{\mathcal{X}} f_X(x) \log \left[ \frac{1}{|a|} \, f_X(x) \right] \, \mathrm{d}x \\ |
84 | 84 | &= - \int_{\mathcal{X}} f_X(x) \left[ \log f_X(x) - \log |a| \right] \, \mathrm{d}x \\ |
85 | 85 | &= - \int_{\mathcal{X}} f_X(x) \log f_X(x) \, \mathrm{d}x + \log |a| \int_{\mathcal{X}} f_X(x) \, \mathrm{d}x \\ |
86 | 86 | &\overset{\eqref{eq:X-dent}}{=} \mathrm{h}(X) + \log |a| \; . |
|
0 commit comments