-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathcopiedfromoverleaf.txt
More file actions
23 lines (19 loc) · 1.59 KB
/
Copy pathcopiedfromoverleaf.txt
File metadata and controls
23 lines (19 loc) · 1.59 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
$(\Omega, \mathcal{F}, \mu)$
$f(x)$ is the PDF (Probability Density Function) w.r.t. the measure $\mu : \mathcal{F} \rightarrow \mathbb{R}_{\geq 0} $
\( \forall x \in \mathcal{X} \quad f(x) := e^{\sum_{i=1}^m \tau_i \phi_i(x) - \psi_m(\tau)} \)
\( \forall x \not\in \mathcal{X} \quad f(x) := 0 \)
where:
\( \psi_m(\tau) = \psi_m(\tau_1, \dots, \tau_m) := \ln( \int_{\mathcal{X}} e^{\sum_{i=1}^m \tau_i\phi_i(x)} d\mu )\) because it is "defined by the relation" \( e^{\psi_m(\tau)} = \int_{\mathcal{X}} e^{\sum_{i=1}^m \tau_i\phi_i(x)} d\mu\)
$\tau \in \mathbb{R}^m$
$\phi(x) := [\phi_1(x), \dots, \phi_m(x)]^T $ for $x \in \mathcal{X}$
$\phi_0(x) := 1$
and $g(x) := [\phi_0(x), \phi_1(x), \dots, \phi_m(x) ]^T $ for $x \in \mathcal{X}$
So we have \( f(x) = e^{\sum_{i=1}^m \tau_i \phi_i(x) - \ln( \int_{\mathcal{X}} e^{\sum_{i=1}^m \tau_i\phi_i(x)} d\mu ) } =e^{\sum_{i=1}^m \tau_i \phi_i(x) + \ln( (\int_{\mathcal{X}} e^{\sum_{i=1}^m \tau_i\phi_i(x)} d\mu )^{-1} ) }
=e^{\sum_{i=1}^m \tau_i \phi_i(x)}e^{\ln( (\int_{\mathcal{X}} e^{\sum_{i=1}^m \tau_i\phi_i(x)} d\mu )^{-1} ) }
=e^{\sum_{i=1}^m \tau_i \phi_i(x)}(\int_{\mathcal{X}} e^{\sum_{i=1}^m \tau_i\phi_i(x)} d\mu )^{-1}
\)
Which means that \(\ln(f(x)) = \ln(e^{\sum_{i=1}^m \tau_i \phi_i(x)}(\int_{\mathcal{X}} e^{\sum_{i=1}^m \tau_i\phi_i(x)} d\mu )^{-1} )
= \ln(e^{\sum_{i=1}^m \tau_i\phi_i(x)}) - \ln( \int_{\mathcal{X}} e^{\sum_{i=1}^m \tau_i\phi_i(x)} d\mu )
= \sum_{i=1}^m \tau_i\phi_i(x) - \ln( \int_{\mathcal{X}} e^{\sum_{i=1}^m \tau_i\phi_i(x)} d\mu )
\)
So \( f(x) = e^{\ln(f(x))} \implies \frac{d}{dx} f(x) = \frac{d}{dx} e^{\ln(f(x))} \implies \)