- proper initialization of weights (should have been obvious, but no one really saw it)
- rectified linear units and dropout
- proper initialization of weights (should have been obvious, but no one really saw it)
- rectified linear units and dropout