Mathematics of Information

The book delves into mathematical information theory, beginning with the Shannon-Wiener framework to quantify information through probability. It defines key concepts like message and information, progressing to countable probability spaces and Shannon entropy, illustrated through applications in statistical physics, mathematical statistics, and communication engineering. Additionally, it offers an introduction to quantum information and examines general probability spaces, emphasizing the information-theoretical analysis of dynamic systems.