Categories Data Science Information Theory Concepts for Machine Learning Post author By Asif Rehan Post date December 6, 2020 Entropy is the fundamental unit of information in Information Theory and is extensively useful in Machine Learning. Let us introduce the concepts: Entropy, Joint Entropy, Mutual Information. Tags Entropy, Information Theory, Machine Learning