What is information and how do we measure it? Information theory provides a way to quantify information, i.e., the magnitude of an update from one set of beliefs to another.