Chapter 8: Optimization
Figures
| Figure No. | Notebook | Figure |
|---|---|---|
| 8.1 | fig_8_1.ipynb | - |
| 8.2 | - | Figure_8.2.png |
| 8.3 | - | Figure_8.3.png |
| 8.4 | - | Figure_8.4_B.png Figure_8.4_A.pdf |
| 8.5 | - | Figure_8.5_A.png Figure_8.5_B.png |
| 8.6 | - | Figure_8.6.png |
| 8.7 | smooth-vs-nonsmooth-1d.ipynb | - |
| 8.8 | - | Figure_8.8.png |
| 8.9 | - | Figure_8.9.png |
| 8.10 | - | Figure_8.10.png |
| 8.11 | steepestDescentDemo.ipynb | - |
| 8.12 | lineSearchConditionNum.ipynb | - |
| 8.13 | - | Figure_8.13.pdf |
| 8.14 | fig_8_14.ipynb | - |
| 8.15 | - | Figure_8.15.png |
| 8.16 | lms_demo.ipynb | - |
| 8.17 | lrschedule_tf.ipynb | Figure_8.17.png |
| 8.18 | learning_rate_plot.ipynb | - |
| 8.19 | - | Figure_8.19_B.png Figure_8.19_A.png |
| 8.20 | - | Figure_8.20_A.png |
| 8.21 | - | Figure_8.21.png |
| 8.22 | - | Figure_8.22.png |
| 8.23 | emLogLikelihoodMax.ipynb | - |
| 8.24 | - | Figure_8.24.png |
| 8.25 | mix_gauss_demo_faithful.ipynb | - |
| 8.26 | fig_8_26.ipynb | - |
| 8.27 | gmm_lik_surface_plot.ipynb | - |
Supplementary material
| Title | Software | Link |
|---|---|---|
| Optimization using JAX | JAX | opt_jax.ipynb |
| Optimization using Flax | JAX,Flax | opt_flax.ipynb |
| Automatic differentiation with tensorflow | TF2 | autodiff_tf.ipynb |
| Automatic differentiation with JAX | JAX | autodiff_jax.ipynb |
| Automatic differentiation with PyTorch | PyTorch | autodiff_pytorch.ipynb |
| Comparison of different optimizers | PyTorch | External |