Mark Johnson’s Improvisation Blog: Information Loss and Conservation


Source: Improvisation Blog: Information Loss and Conservation

Saturday, 7 September 2019

Information Loss and Conservation

One of the ironies of any “information system” is that they discard information. Quite simply, anything which processes large amounts of data to produce an “answer”, which is then acted on by humans, is attenuating those large amounts of data in various ways. Often this is done according to some latent biases within either the humans requesting the information, bias within the datasets that are processed, or bias within the algorithms themselves. Bias is also a form of attenuation, and the biases which have recently been exposed around racial prejudice in machine learning highlight the fundamentally dangerous problem of loss of information in organisations and society.

In his book “The human use of human beings” Norbert Wiener worried that our use of technology sat on a knife-edge between it either being used to destroy us, or to save us from ourselves. I want to be more specific about this “knife edge”. It is whether we learn how to conserve information within our society and institutions, and avoid using technology to accelerate the process of information destruction. With the information technologies which we have had for the last 50 years, with their latency (which means all news is old news) and emphasis on databases and information processing, loss of information has appeared inevitable.