dm.cs.tu-dortmund.de/en/mlbits/neural-nlp-networks/
Deep Neural Network Embeddings – Lecture Notes
otherwise noted.
Basic Multi-Layer Perceptron (MLP)
Quick recap of neural networks:
\(X = (x_1, x_2, x_3, x_4)^T\)
\(h_1 = \sigma(\textcolor[RGB]{132,184,24}{W_1} \cdot X + b_1)\)
\(o = \textcolor[RGB]{0,155,170}{W_2} …