Course 2: Week 3: Hyperparameter tuning, Batch Normalization and Programming Frameworks

[mbhushan]

Tensor Flow Code Example:

Deep Learning Frameworks

Gradient Descent with softmax

Softmax Loss function

Understanding Softmax

Multiclass classification

Softmax Layer

Batch Norm at test time

Batch norm as regularization

Batch norm help in neural networks: part1

Implementing Gradient Descent with Batch Norm

Working with mini batches

Adding batch norm to function

Implementing Batch Norm

Normalizing inputs to speed up learning

Hyperparameters tuning in practice - Panda vs Caviar

Appropriate scale for hyperparameters:

Searching for right hyperparameters

Hyperparameters importance while tuning