• Optimization Algorithms
  • SGD, Momentum, NAG, Adagrad, Adadelta , RMSprop, Adam
  • Batch Normalization
  • Exploding and Vanishing Gradients
  • Hyperparameter Tuning
  • Interpretability