[IP3-2-2] Information theory

Information theory answers two fundamental questions in communication theory: what is the ultimate data compression (answer: the entropy H) and what is the ultimate transmission rate of communication (answer: the channel capacity, C). For this reason, it is considered that information theory is a subset of communication theory.

External resources

• Chakrabarti, S., Bongiovanni, T., Judge, J., Nagarajan, K., & Principe, J. C. (2015). Downscaling Satellite-Based Soil Moisture in Heterogeneous Regions Using High-Resolution Remote Sensing Products and Information Theory: A Synthetic Study. Ieee Transactions on Geoscience and Remote Sensing, 53(1), 85-101. doi:10.1109/TGRS.2014.2318699
• Cover, T.M., Thomas, J.A., 2012. Elements of information theory. John Wiley & Sons.

Learning outcomes

• 2303 - Understand how the entropy represents the the average level of information contained in an image pixel

  Understand how the entropy represents the the average level of information contained in an image pixel

Self assessment

Outgoing relations

• [IP3-2-2] Information theory subclassof [IP3-2] Computer vision in EO