Synapse Open Synapse
AI

Anatomize Deep Learning with Information Theory

Lil'Log · · 8 min read

Professor Naftali Tishby passed away in 2021. Hope the post can introduce his cool idea of information bottleneck to more people. Recently I watched the talk “Information Theory in Deep Learning” by Prof Naftali Tishby and found it very interesting.

Latest from Lil'Log