Skip to main content.
Advanced search >
Print

<< Week of June 18 >>

Monday, June 19, 2017

A Deeper Understating of Deep Learning - Why Deep Neural Networks work so well?

Seminar: Redwood Seminar | June 19 | 12-1:30 p.m. | 560 Evans Hall


Naftali Tishby, The Hebrew University of Jerusalem

Neuroscience Institute, Helen Wills


Through analytical and numerical studies of Deep Neural Networks (using standard TensorFlow) in the ""Information Plane"" - the Mutual Information the network layers preserve on the input and the output variables - we obtain the following new insights:

1. The training epochs, for each layer, are divided into two phases: (1) fitting the training data - increasing the mutual information on the...   More >