anton/mlpractical
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Fixing typo in description of back-propagation.

Browse Source
This commit is contained in:
Matt Graham 2016-10-11 13:40:29 +01:00
parent a6fcdc2894
commit cafed216d7
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
notebooks/03_Multiple_layer_models.ipynb
View File

@ -103,7 +103,7 @@
" \\pd{\\bar{E}}{x^{(b)}_d} = \\sum_{k=1}^K \\lpa \\pd{\\bar{E}}{y^{(b)}_k} \\pd{y^{(b)}_k}{x^{(b)}_d} \\rpa.\n",
"\\end{equation}\n",
"\n",
"Mathematically therefore the `bprop` method takes an array of gradients with respect to the outputs $\\pd{y^{(b)}_k}{x^{(b)}_d}$ and applies a sum-product operation with the partial derivatives of each output with respect to each input $\\pd{y^{(b)}_k}{x^{(b)}_d}$ to produce gradients with respect to the inputs of the layer $\\pd{\\bar{E}}{x^{(b)}_d}$.\n",
"Mathematically therefore the `bprop` method takes an array of gradients with respect to the outputs $\\pd{\\bar{E}}{y^{(b)}_k}$ and applies a sum-product operation with the partial derivatives of each output with respect to each input $\\pd{y^{(b)}_k}{x^{(b)}_d}$ to produce gradients with respect to the inputs of the layer $\\pd{\\bar{E}}{x^{(b)}_d}$.\n",
"\n",
"For the affine transformation used in the `AffineLayer` implemented last week, i.e a forwards propagation corresponding to \n",
"\n",