dm.cs.tu-dortmund.de/mlbits/topic-modeling-lda-variational-inference/
Variational Inference for LDA – Lecture Notes
min}_{\theta _{1\ldots d}, z_{1\ldots d,1\ldots L}, \beta _{1\ldots k}} KL(Q(\theta _{1\ldots d}, z_{1\ldots d,1\ldots L}, \beta _{1\ldots k})\| P(\theta _{1\ldots d}, z_{1\ldots d,1\ldots L}, \beta _{1\ldots k}\vert [...] ion:
The resulting variational posterior now is:
\[\begin{align*} Q(\theta _{1\ldots d}, z_{1\ldots d,1\ldots L}, \beta _{1\ldots k}) =& \prod \nolimits _k Q(\beta _k\vert \lambda _k) \prod \nolimits _d [...] .
Optimizing Variational LDA
Using the posterior
\[\begin{align*} Q(\theta _{1\ldots d}, z_{1\ldots d,1\ldots L}, \beta _{1\ldots k}) =& \prod \nolimits _k Q(\beta _k\vert \lambda _k) \prod \nolimits _d …