How gradient checking works

Purpose: Verify that your backpropagation implementation is correct by comparing analytical gradients with numerical gradients.

Gradient Checking: Essential for debugging; use numerical gradients to verify analytical gradients

For the equations and tolerances, see the gradient checking reference. To apply the check, see Run a gradient check.