Complexity Rising: From Human Beings to Human Civilization, a Complexity Profile — New England Complex Systems Institute, Yaneer Bar-Yam (2002)

(This reminds me of A Systems Holistic Interpretation of the
Present State of the Contemporary Society
and its Possible Futures
Eric Schwarz
Autogenesis, Université de Neuchâtel, Switzerland – http://afscet.asso.fr/resSystemica/Crete02/Schwarz%20B.pdf and key diagram http://www.afscet.asso.fr/halfsetkafe/textes-2006/schwarz-3.pdf)

 

 

 

Source: Complexity Rising: From Human Beings to Human Civilization, a Complexity Profile — New England Complex Systems Institute

 

COMPLEXITY RISING: FROM HUMAN BEINGS TO HUMAN CIVILIZATION, A COMPLEXITY PROFILE

Cite as:

Y. Bar-Yam, Complexity Rising: From Human Beings to Human Civilization, a Complexity Profile, in Encyclopedia of Life Support Systems (EOLSS), developed under the Auspices of the UNESCO, EOLSS Publishers, Oxford, UK, 2002.


Since time immemorial humans have complained that life is becoming more complex, but it is only now that we have a hope to analyze formally and verify this lament. This article analyzes the human social environment using the “complexity profile,” a mathematical tool for characterizing the collective behavior of a system. The analysis is used to justify the qualitative observation that complexity of existence has increased and is increasing. The increase in complexity is directly related to sweeping changes in the structure and dynamics of human civilizationthe increasing interdependence of the global economic and social system and the instabilities of dictatorships, communism and corporate hierarchies. Our complex social environment is consistent with identifying global human civilization as an organism capable of complex behavior that protects its components (us) and which should be capable of responding effectively to complex environmental demands.

How often have we been told by various philosophers and universalistic religions about unseen connections between human beings and the collective identity of humanity? Today, global connections are manifest in the economy, in transportation and communication systems, and in responses to political, social and environmental crises. Sometime during this century a transition to global conflict, and thence to global cooperation, took place. Along the way the conditions of life changed, driven by technological, medical, communication, education and governmental changes, which themselves involved global cooperation and collective actions.

What is generally not recognized is that the relationship between collective global behavior and the internal structure of human civilization can be characterized through mathematical concepts that apply to all complex systems. An analysis based upon these mathematical concepts suggests that human civilization itself is an organism capable of behaviors that are of greater complexity than those of an individual human being. In order to understand the significance of this statement, one must recognize that collective behaviors are typically simpler than the behavior of components. Only when the components are connected in networks of specialized function can complex collective behaviors arise. The history of civilization can be characterized through the progressive (though non-monotonic) appearance of collective behaviors of larger groups of human beings of greater complexity. However, the transition to a collective behavior of complexity greater than an individual human being has become apparent from events occuring during the most recent decades.

Human civilization continues to face internal and environmental challenges. In this context it is important to recognize that the complexity of a system’s behavior is fundamentally related to the complexity of challenges that it can effectively overcome. Historic changes in the structure of human organizations are self-consistently related to an increasing complexity of their social and economic contexts. Further, the collective complexity of human civilization is directly relevant to its ability to effectively respond to large scale environmental challenges.

We, each of us, are parts of a greater whole. This relationship is shaping and will continue to shape much of our existence. It has implications for our lives as individuals and those of our children. For individuals this complexity is reflected in the diversity of professional and social environments. On a global scale, human civilization is a single organism capable of remarkable complex collective actions in response to environmental challenges.

INDIVIDUAL AND COLLECTIVE BEHAVIOR

Building a model of society based upon physical forces between atoms, or cellular physical and chemical interactions, would be quite difficult. Even constructing a model based upon social interactions is too difficult. To consider the collective behavior of human civilization, one must develop concepts that describe the relationship of individual to collective behavior in a more general way. The goal of this article is to extend the systematic understanding of collective or cooperative behavior so as to characterize such behavior in physical, biological and social systems.

All macroscopic systems, whether their behavior is simple or complex, are formed out of a large number of parts. The following examples suggest insights into how and in what way simple or complex behaviors arise.

Inanimate objects generally do not have complex behaviors. Notable exceptions include water flowing in a stream or boiling in a pot, and the atmospheric dynamics of weather. However, if water or air are not subject to external force or heat variations, their behavior is simple. Nevertheless, by looking very closely, it is possible to see the rapid and random thermal motion of atoms. Describing the motion of all of the atoms in a cubic centimeter of water would require a volume of writing which is more than ten billion times the number of books in the Library of Congress. Though this would be a remarkably large amount of information, it is all irrelevant to the macroscopic behavior of a cup of water.

Thermodynamics and statistical mechanics explained this paradox at the end of the 19th century. The generally independent and random motion of atoms means that small regions of equal size contain essentially the same number of atoms. At any time the number of atoms leaving a region and the number of atoms entering it are also essentially the same. Thus, the water is uniform and unchanging.

While biological organisms generally behave in a more complex way than inanimate objects, independent and randomly moving biological microorganisms also have simple collective behavior. Consider the behavior of microorganisms that cause diseases. What is the difference between the microorganisms and the cells that form a human being? From a macroscopic perspective, the primary difference is that a large collection of microorganisms do not result in complex collective behavior. Each of the microorganisms follows an essentially independent course. The independence of their microscopic actions results in an average behavior on a large scale which is simple. This is true even though, like the human being, all of the microorganisms may originate from a single cell.

There is a way in which the microorganisms do act in a coherent waythey damage or consume the cells of the body they are in. This coherent action is what enables them to have an impact on a large scale. It is only because many of them perform this action together that makes them relevant to human health.

The notion of coherence also applies to physical systems. Atoms at room temperature in a gas, liquid or solid, move randomly at speeds of 1000 km/hr but have less large scale impact than an object thrown at much slower speed of 50 km/hr. It is the collective coherent motion of all of the atoms in the object that enables them to have impact on a large scale.

Thus, there are two paradigms for simple collective behavior. When the parts of a system have behaviors that are independent of each other, the collective behavior of the system is simple. Close observation reveals complex behavior of the parts, but this behavior is irrelevant to the collective behavior. On the other hand if all parts act in exactly the same way, then their collective behavior is simple even though it is visible on a very large scale.

These examples of behavior can also be seen in the historical progression of human civilization. Primitive tribal or agrarian cultures involved largely independent individuals or small groups. Military systems involved large coherent motions of many individuals performing similar and relatively simple actions. These coherent actions enabled impact at a scale much larger than the size of the military force itself.

By contrast, civilization today involves diverse and specialized individual behaviors that are nevertheless coordinated. This specialization and coordination allow for highly complex collective behaviors capable of influencing the environment on many scales. Thus the collective behavior of human civilization arises from the coordinated behavior of many individuals in various groupings.

COMPLEXITY PROFILE

It is much easier to think about the problem of understanding collective behavior using the concept of a complexity profile. The complexity profile focuses attention on the scale at which a certain behavior of a system is visible to an observer, or the extent of the impact it can have on its environment. Both of these are relevant to interactions of a system with its environmentan observer can see the behavior only when the behavior is sufficiently large to affect the observer.

A formal definition of scale considers the spatial extent, time duration, momentum and energy of a behavior. More intuitively, when many parts of a system act together to make a single behavior happen, that behavior is on a large scale, and when few parts of a system act together, that behavior is on a small scale. The energy of different actions of the system is also relevant. When the amount of energy devoted to an action is large, then it is a large scale action. In essence, the units of energy are working together to make a large scale behavior. A more systematic treatment of the scale of particular behaviors leads to the complexity profile.

The complexity profile counts the number of independent behaviors that are visible at a particular scale and includes all of the behaviors that have impact at larger scales. The use of the term “complexity” reflects a quantitative theory of the degree of difficulty of describing a system’s behavior. In its most basic form, this theory simply counts the number of independent behaviors as a measure of the complexity of a system. The complexity profile characterizes the system behavior by describing the complexity as a function of scale.

The central point is: When the independence of the components is reduced, scale of behavior is increased. To make a large collective behavior, the individual parts that make up this behavior must be correlated and not independent. This reduction of independence means that describing the collective behavior includes part or all of the behavior of the parts and therefore our description of the parts is simpler. When the behaviors of parts are coupled in subgroups, their behavior is manifest at the scale corresponding to the size of the group.

Thus, fixing the material composition and the energy of the system, there are various ways the system can be organized. Each way of organizing the system and distributing the energy through the system results in tradeoffs between the complexity of their microscopic description against the complexity of their description at progressively larger scales.

To illustrate the complexity profile, consider a system in which the parts behave independently. The system behavior at a small scale requires specifying what each of the parts is doing. However, when observing on a larger scale, it is not possible to distinguish the individual parts even in a small region of the system, only the aggregate effect of their behavior is observable. Since their behaviors are independent, they cancel each other in their impact on the environment. Thus, the description of the system behavior is simple. The behavior of each individual part disappears upon averaging the behavior of the local group. Examples of this include microorganisms swimming randomly in a pond or people moving around in a crowd that does not move as a whole. When one person goes one way, another person fills his place and together there is no collective movement.

Independent behavior is to be contrasted with coherent motion. In coherent motion all of the parts of the system move in the same direction. This is the largest scale behavior possible for the system. Since the behaviors of the parts of the system are all the same, they are simple to describe on the largest scale. Moreover, once the largest scale behavior is described, the behavior of each of the parts is also known.

Neither of these two examples corresponds to complex collective behavior. Unlike the coherent motion case, complex behavior must include many different behaviors. Unlike the independent action case, many of these behaviors are visible on a large scale. In order for such visibility to occur various subgroups of the system must have coordinated behaviors. The resulting dynamic correlations are distributed at different scales. Some of them are found at a microscopic scale in the coupled motion or positions of molecules, and others appear in the collective motion of, for example, muscle cells and the motion of the body as a whole. Thus, the complexity profile of a complex system like a human being involves a distribution of scales at which behavior manifests itself. This balance between highly random and highly ordered motion is characteristic of the behavior of complex systems.

The discussion of independent, coherent and complex behavior can be applied to physical, biological or social systems. Think about the gas molecules that bounce independently in a room, or the coherent alignment of magnetic regions of a magnet. In the former case, all of the parts of the system act independently and the complexity profile resembles the independent component example. In the latter, the parts of the system are all aligned, and there is a large scale behavior.

In biological systems a collection of microorganisms may act essentially independently, and a disease microorganism by multiplying and acting coherently in attacking the human body can have impact on a much larger scale. Finally, the cells of the body are interdependent and have collective complex behavior.

The application of these concepts to human organizations and social systems will take us further in our understanding of various ways collective and coherent behaviors can arise. In this context, one of the main mechanisms for achieving coordinated behavior is the exercise of control by one individual over the behavior of others. Thus, it is particularly interesting to consider how control affects the collective behavior of human beings.

CONTROL IN HUMAN ORGANIZATIONS

The discussion of the complexity profile did not address the mechanisms that cause correlations in the behavior of the parts. This section focuses on internal interactions that at any one time give rise to collective behaviors. In human organizations coordination occurs because individuals influence each others’ behavior. The influence is often called control. It is not necessarily coercive control, though coercion may be an aspect of control. The objective of this section is to understand the relationship between control structure and the complexity of collective behavior.

Real human hierarchical organizations are not strict hierarchies, they contain lateral interactions that enable control to bypass the hierarchy. However, by focusing on an idealized control hierarchy it is possible to understand the nature of this structure. Such a focus will help in understanding the nature of dictatorships and hierarchical corporationsthe relationship between these control structures and complex collective behavior. In an idealized hierarchy all communication, and thus coordination of activities, is performed through the hierarchy.

To concretize the discussion, consider two paradigmatic examples: military force and factory production. Conventional military behavior is closer to our discussion of coherent behavior. Similar to coherent motion, in the military the behavior of an individual is simplified to a limited set of patterns. The behavior patternssuch as long marcheshave a high degree of repetition and thus can have impact on a large scale. Then, many individuals perform the large-scale behaviors coherently. While this model continues to apply to some examples of modern military activity, the diversity of actions of a modern military makes this model better suited to understanding ancient armiesRoman legions, or even U. S. Civil War armies.

While the actions of the military are designed to have impact on a large scale, they must still be performed in response to specific external conditions. As the conditions change, the actions must also be changed. There is need for a response mechanism that involves communications that can control the collective behaviors. Such a response generally involves direct action by the control hierarchy.

A conventional industrial production line also simplifies the behavior of an individual. Each individual performs a particular repetitive task. The effect of many individuals performing repetitive tasks results in a large number of copies of a particular product. This repetition increases the scale of impact of an individual’s behavior. However, unlike coherent behavior, the behavior of different individuals is not the same. Instead, the activities of the individual are coordinated to those of othersthe coordination exists so that the larger-scale behavior can arise. The coordination means that the behaviors of different individuals, while not the same, are related to each other. When compared to the coherent motion, this increases the complexity and decreases the scale, but much less so than would be the case for fully independent individuals.

The need to ensure coordination of different individuals when the collective actions being performed have an inherently higher complexity increases the demands upon the control hierarchy. In particular, it is significant that the behaviors of all parts of a production line must be coordinated, even though actions being performed are different.

The similarities and differences between the factory and the military models are relevant to an understanding of the role of hierarchical control. A military force, a corporation, or a country have behaviors on various scales. At larger scales, many of the details of the behavior of individuals are not apparent. Intuitively, a control hierarchy is designed to enable a single individual (the controller) to control the collective behavior, but not directly the behavior of each individual. Indeed, the behavior of an individual need not be known to the controller. What is necessary is a mechanism for ensuring that control over the collective behavior be translated into controls that are exercised over each individual. This is the purpose of the control hierarchy.

A hierarchy, however, imposes a limitation on the degree of complexity of collective behaviors of the system. This can be understood by considering more carefully the processes of coordination. The hierarchy is responsible for ensuring coordination of various parts of the system. Lower levels of the hierarchy are responsible for locally coordinating smaller parts of the system and higher levels of the hierarchy are responsible for coordinating the larger parts of the system. At each level of the hierarchy the actions to be coordinated must be transferred through the controller. Thus, the controller’s behavior must itself reflect all of the impacts that different parts of the system have on other parts of the system. This implies that the collective actions of the system in which the parts of the system affect other parts of the system must be no more complex than the controller. In human hierarchies the collective behavior must be simple enough to be represented by a single human being.

In summary, the complexity of the collective behavior must be smaller than the complexity of the controlling individual. A group of individuals whose collective behavior is controlled by a single individual cannot behave in a more complex way than the individual who is exercising the control. Hierarchical control structures are symptomatic of collective behavior that is no more complex than one individual. Comparing an individual human being with the hierarchy as an entirety, the hierarchy amplifies the scale of the behavior of an individual, but does not increase its complexity.

The existence of lateral influences counters these conclusions with respect to real human organizations. These lateral controls are similar to the conceptual networks that are used to model the interactions between neurons in the brain. Distributed control over collective behaviors can result in larger complexity of the collective behavior than the behavior of any single individual. Networks are also quite distinct from independent individuals. Networks require that coordination of the behavior of groups of individuals are achieved by mutual influences.

ENVIRONMENTAL DEMANDS AND COMPLEXITY

The discussion of the complexity of the behavior of a system at different scales does not explain, in itself, why systems should be simple or complex. According to thermodynamics, an isolated system will always increase its entropy. Since the entropy is a measure of disorder, it corresponds to microscopically random behavior and simple collective behavior. Fortunately for us, the world is not an isolated system. The high temperature of the sun causes it to illuminate us with light. The energy of this light is reemited into space at a much lower effective temperature. This energy flow from high to low temperature, combined with physical properties of the earth, enables all of the complex patterns of weather and of biological and social life on earth. While it enables, the energy flow does not explain how complex systems arise. In terms of the individual physical, biological or social systems, the overall energy flow is translated into a selection of entities that “survive” sustaining themselves or similar offspring by obtaining resources that preserve their structure over time. In its most basic form, this concept (usually applied to biological organisms) applies to non-equilibrium physical, biological and social systems whose behavior is preserved by the flow of energy. There is still much to be understood about this process.

The demands that environmental conditions place on the organism’s pattern of behavior create the necessity of complex behavior. In order to survive, the organism behavior must reflect in some way the nature of the environment. Some behavior patterns will result in obtaining the needed resources while others will not. The environment is not a static system, and over time, the organism responds to the environment in a manner that is dictated by the organism’s internal structure. The response of an organism at a particular scale is implicit in its behavior patterns at that scale. The complexity of an organism’s response is given by the complexity of its behaviors. More directly, the number of independent behaviors is related to the number of independent environmental factors/conditions that the organism can effectively respond to.

To quantify the demands that the environment places on an organism, consider the minimum complexity of a system which achieves a target objective (e.g. survival) with some specified probability of success. As the probability of success increases the minimum organism complexity increases. Note that for many types of biological organism, the typical number of organisms remains relatively constant over many generations. However, the number of offspring per parent varies widely from one to millions. This suggests that the probability of successful survival of an organism is a measure of the relative complexity of the environmental demands to the complexity of the organism. Organisms that are less complex than the demands of the environment have a lower probability of survival, even if well adapted.

From this argument it is possible to begin to understand processes of historical change in human organizational structures. Human organizations exist within an environment that places demands upon them. If the complexity of these demands exceeds the complexity of an organization, the organization will be likely to fail. Thus, those organizations that survive must have a complexity sufficiently large to respond to the complexity of environmental demands at the scale of these demands. As a result, a form of evolutionary change occurs due to competition. Competition is relevant because for human organizations, the environment itself is formed in part out of organizations of human beings. According to this argument, one can expect a self-consistent process of complexity increase where competition between organizations causes the behavior of one organization to serve as part of the environment in which others must survive.

HISTORICAL PROGRESSION

In recent years human organizations that emphasized central control have changed or given way to other structures with greater distribution of control. This includes political organizationsthe systematic conversion of dictatorships in Central and South America to more democratic systems, the fragmentation of the soviet bloc and replacement of government controlled economies in communist countries with market based economiesand the restructuring of hierarchical corporations in western economies to involve decision teams and process based managerial strategies. Many of these changes result in systems where collective behaviors arise from partially independent subgroups of the system and lateral “networked” influences. Even when control hierarchies continue to exist, the lateral interactions through group decision making processes have become more prominent. To understand this more fully, consider the history of civilization and the complexity of environmental demands upon each civilization and the individuals that comprise it. The progressive historical increase of complexity means that organizations that do not change do not survive. This is descriptive of the nature of the transition that is under way. The complexity of demands upon collective human systems have recently become larger than an individual human being. Once this is true, hierarchical mechanisms are no longer able to impose the necessary coordination of individual behaviors. Instead, interactions characteristic of networks are necessary.

In a review of history, the development of hierarchies can be seen to enable progressively more complex behaviors. Two factors are important, progressively smaller branching ratios and lateral interactions. Both will be described below. There are also two complementary aspects to this development, complexity at the scale of the individual and complexity at the scale of the collective. In general, these complexities are not directly related. In the context of a control hierarchy, however, the complexity of individual behaviors increases with increasing complexity of collective behavior. The complexity/diversity of individual behaviors does not directly explain the difficulties experienced by hierarchies. The complexity of collective behaviors does explain the difficulties experienced by control hierarchies, since controlling these behaviors is the role of central control.

From earliest recorded history until the fall of the Roman empire, empires replaced various smaller kingdoms that had developed during a process of consolidation of yet smaller associations of human beings. The degree of control exercised in these systems varied, but the progression toward larger more centrally controlled systems is apparent. As per our discussion of the difference between independent individuals and coherent behaviors, this process was driven by military force.

Indeed, during the time of ancient empires, large-scale human systems executed relatively simple behaviors, and individuals performed relatively simple individual tasks that were repeated by many individuals over time to have a large-scale effect. This observation applies to soldier armies, as well as slaves working in agriculture, mines or construction. The scale of ancient empires controlled by large armies, as well as the scale of major projects of construction would be impressive if performed today. The scale of activity was possible, without modern sources of energy and technology, because of the large number of individuals involved. However, the nature of the activity was simple enough that one individual could direct a large number of individuals. Thus, hierarchies had a large branching ratioeach controller was in charge of a large number of individuals.

As time progressed, the behavior of individuals diversified as did the collective tasks they performed. The increasing diversity of individual behaviors implies an increase in the complexity of the entire system viewed at the scale of the individual. Consequently, this required reducing the branching ratio by adding layers of management that served to exercise local control. As viewed by higher levels of management, each layer simplified the behavior to the point where an individual could control it. The hierarchy acts as a mechanism for communication of information to and from management. The role is also a filtering one, where the amount of information is reduced on the way up. Conversely, commands from the top are elaborated (made more complex) on the way down the hierarchy. As the collective behavioral complexity at the scale of an individual increases, the branching ratio of the control structure becomes smaller and smaller so that fewer individuals are directed by a single manager, and the number of layers of management increases. The formation of such branching structures allows an inherently more complex local behavior of the individuals, and a larger complexity of the collective behavior as well.

The most dramatic increases in the complexity of organizational behavior followed the industrial revolution. The use of new energy sources and automation enabled larger scale behavior in and of itself. This, in turn, enabled higher complexity behaviors of human systems because the amplification of the behavior to a larger scale can be accomplished by the use of energy rather than by task repetition.

At the point at which the collective complexity reaches the complexity of an individual, the process of complexity increase encounters the limitations of hierarchical structures. Hierarchical structures are not able to provide a higher complexity and must give way to structures that are dominated by lateral interactions. A hierarchy serves to create correlations in the behavior of individuals that are similar in many ways to the behavior of a network. The hierarchy serves as a kind of scaffolding. At the transition point, it becomes impossible to exercise control, so the management effectively becomes divorced from the functional aspects of the system. Lateral interactions that replace the control function have been present in hierarchical structures, however, they become necessary when the hierarchical control structure fails due to the high complexity of collective behavior. The greater the dependence of a system on the hierarchy, the more dramatic the changes that then take place.

The lateral interactions achieve the correlations in behavior that were previously created by management. As such mechanisms are introduced, layers of management can be removed. Over the course of the transition, the hierarchy exercises control over progressively more limited aspects of the system behavior. Some of the behavior patterns that were established through the control hierarchy may continue to be effective; others cannot be since an increase in system complexity must come about through changes in behavior. Among these changes are the coordination mechanisms themselves, which must be modified. It could be argued that this picture describes much of the dynamics of modern corporations. Upper levels of management have turned to controlling fiscal rather than production aspects of the corporation. In recent years, corporate downsizing has often been primarily at the expense of the middle management, resulting in a reduction of payroll and little change in production. Hierarchical control has been replaced by decision teams introduced by corporate restructuring; and the reengineering of corporations has focused on the development of task related processes that do not depend on hierarchical control.

Using this argument it is straightforward to understand why control structures ranging from communism to corporate hierarchies could not perform the control tasks required of them in recent times. As long as the activities of individuals were uniform and could be simply describedfor example, soldiers marching in a row, or manufacturing workers producing a single product by a set of repetitive and simple activities (pasting eyes on a doll, screwing in bolts)control could be exercised. The individual’s activities can be specified once for a long period of time, and the overall behavior of the collective could be simply described. The collective behavior was simple; it could be summarized using a description of a simple product and the rate of its production. In contrast, central control cannot function when activities of individuals produce many products whose description is complex; when production lines use a large number of steps to manufacture many different products; when the products vary rapidly in time; and the markets change rapidly because they themselves are formed of individuals with different and rapidly changing activities.

It is useful to distinguish networks that coordinate human activity from markets that coordinate resource allocation. Markets are a distinct type of system that also results in an emergent collective behavior based upon the independent actions of many individuals. Markets such as the stock exchanges or commodity markets coordinate the allocation of resources (capital, labor and materials) according to the dynamically changing value of their use in different applications. Markets function through the actions of many agents (individuals, corporations and aggregate funds). Each agent acts according to a limited set of local objectives, while the collective behavior can coordinate the transfer of resources across many uses. Markets are distinct from networks in that they assume that the interactions among all agents in regard to a single resource can be summarized by a single time-dependent variable which is the value of the relevant resource.

To illustrate the problem of central control of a complex economic system consider examples of the problem of resource allocation. An example might be the supply of oil to a country. For an individual to allocate the supply of oil, all of the needs of different users in amounts and times, the capabilities of different suppliers, and the transportation and storage available must be taken into account. Even if one were to suggest that a computer program might perform the allocation, which is recognized as a formally difficult computational problem, the input and output of data would often eliminate this possibility. One of the crucial features of such an allocation problem is that there are both small and large suppliers and small and large users. As the number of independent users and the variation in their requirements increases, the allocation problem becomes impossible to solve. At the same time, a market is effective in performing this allocation with remarkable efficiency.

A more familiar example, which in many ways is more salient, is the problem of food supply to a metropolitan area. The supply of food is not a market, it is a network based upon a market structure. In a metropolitan area there are hundreds to thousands of small and large supermarkets, thousands to tens of thousands of restaurants, each with specific needs that in the optimal case would be specified by immediate requirements (on demand) rather than by typical or average need over time. The suppliers of foods are also many and varied in nature. Consider also the different categories of foodsproduce, canned goods, baked goods, etc. The transportation and storage requirements of each are subject to different constraints. The many types of vehicles and modes of transportation represent another manifold of possibilities. The market-based system achieves the necessary coordination of food supply without apparent hitch and with necessary margins of error. To consider conceptually the dynamic dance of the supply of food to a city that enables daily availability is awe-inspiring. Even though there are large supermarket chains that themselves coordinate a large supply system, the overall supply system is much greater. Realizing that this coordination of effort relies upon the action of many individuals gives meaning to the concept of complex collective behavior. One can also understand why in a centrally controlled system, consistent and adequate food supply would be a problem. In order to have any hope of controlling such a supply problem it would have to be simplified to allow for only a few products in only a few stores. These were well-known characteristics of food supply in communist regimes. They were seen to reflect the general economic ineffectiveness of such forms of government. In this context the connection is quite direct. While considering the allocation problem in the context of food supply may illustrate the problems associated with central control, the same argument can be applied to various resource allocation and other coordination problems in large and small corporations.

In conclusion, the implication of the disappearance or dramatic changes in centrally controlled human organizations is that the behaviors of collections of human beings do not simplify sufficiently to be controlled by individuals. Instead of progressive simplification from an individual to larger and larger collections of individuals, we have the oppositean increasing complexity that is tied to an increasing complexity of the demands of the environment. This makes it impossible for an individual to effectively control collective behaviors. While specific individuals have been faulted for management errors that have led to corporate failures, the analysis performed here suggests that it is inevitable for management to make errors under these circumstances.

Finally, from an academic point of view, for those interested in developing an understanding of the political, social or economic behavior of the human civilization or its various parts, there are several important consequences. The high collective complexity implies that as individuals we are unable to fully understand the collective behavior. This does not mean that insights and partial understandings are impossible. However, the existence of many different scales of behavior in a complex system implies that two traditional approaches to modeling or considering such systems cannot be effective. The first assumes that the collective behavior can be understood solely from large scale interactions; specifically, a description of the interactions between nations. The second assumes that the collective behavior can be understood by decomposing the system into its smallest elements and developing models based upon individual behavior. A complete specification of each of the physical components of a system would describe also the collective system behavior, however, such a complete specification is impossible. Mapping or simulating all individual behaviors is ineffective as an approach to gaining understanding. This reductionist view, dominating much of the scientific thought, does not take into consideration the significance of large scale correlations essential to the complex collective behaviors we would like to understand. Effective models must build descriptions that account both for the many scales of behavior of a system and the interplay between environmental and system properties. In addition, it is the dynamic behavior patterns of the system that must be the focus of the understanding.

HUMAN CIVILIZATION AS AN ORGANISM

The interdependence of human civilization on a global scale is manifest in the many ways that local actions in one part of the world affect global behaviors. From military acts to humanitarian aid global response has taken the place of local interactions. Implicit in this discussion is recognizing that the interdependence affects individuals in various ways and at various scales.

For example, the invasion of Kuwait by Iraq in 1990 had a manifest global response despite originally involving only a tiny proportion of the global population. The effects of the oil embargo and OPEC in the 1970s illustrated the global impact of the supply of oil from the Middle East and is reflected in the continued global concerns in that region. The impact on consumers, corporations and economies of the world of the production of automobiles and consumer electronics in Japan is well appreciated, as is the growing impact of the exports of other Pacific Rim nations. A disruption of the supply of products, even a partial disruption as occurred for example in the wake of the earthquake in Kobe, can have global impact.

The potential impact that a small nation can cause through development of nuclear weapons has recently been manifest in the global response to events in North Korea. The widespread destruction that could result from use of nuclear weapons of the arsenals of the nuclear powers is well recognized. The drug production in specific parts of the world such as in Colombia, has relevance to individuals and the public in many other areas of the world. Various recent occurrences of social disruption and conflict in Somalia, Bosnia and Rwanda illustrate the global response to social disruption in what are considered relatively out of the way places of the world. Since World War II various local conflicts have attained global significance and attention, e.g. Korea, Vietnam, and the Middle East.

Changes of government in diverse countries such as Iran in the 1970s and South Africa in the 1990s occurred in an environment of global influences and consequences. The example of South Africa is of particular interest since the global influence (the boycott) was directed at internal civil rights rather than external interactions. The global aid in response to famines in Africa, and earthquakes and floods in other parts of the world, are further indications of the global response to local events. The impact of fluctuations of the value of currencies during the 1990s in Italy and England, Mexico, and recently the United States have illustrated the power of global currency markets.

These examples illustrate how, at the present time, events on a national scale can have global effects. However, smaller-scale events can also have global effects. One of the manifestations of the global interdependence is the wide geographic distribution of product manufacturing and utilization. Manufacturing a product involves raw materials, capital, design, assembly and marketing. Today each may originate or occur in a different part of the world, or even in several. The loss of a factory in any one of tens of countries may significantly affect the production of a corporation. Since individual corporations can be primary suppliers of particular products, this can in turn affect the lives of individuals throughout the world.

In order to consider the effects of the world on a particular individual one must specialize. Consider, for example, the influx of students from around the world into universities in the greater Boston area and analyze how this affects faculty, students, and the Boston area economy, as well as how the existence of Boston affects them. Even more specifically, ask how a student from one part of the world can affect another student from another part of the world when both meet in Boston. Or, how an individual faculty member affects students that come from many parts of the world, and how students coming from many parts of the world affect a faculty member. Even to ask these questions demonstrates the interdependence at the individual level that now exists throughout the globe. Moreover, this description of interdependence has not yet accounted in detail for the effects of direct information exchange through the telephone, global mass media, international journals and conferences, and recently the Internet.

The interdependence of global human civilization is self-consistently related to the increasing complexity both of our individual social environments and of the behavior of human civilization in entirety.

It is also possible to make a connection to internal structural changes that are taking place in social and economic systems. Complex systems that display complex collective behavior are structured as networks. By contrast, the traditional human social structure, whether in government or in industry, has been based upon control hierarchies. Just as a single neuron is not able to dictate the behavior of a neural system, an emergent complex network of human beings may not be directed by a single human being.

In this context, the traditional conflict between individual and collective good and rights should be revisited. This philosophical and practical conflict manifested itself in the conflict between democracy and communism. It was assumed that communism represented an ideology of the collective while democracy represented an ideology of the individual. The transition to a complex organism implies that this conflict has been resolved, not in favor of one or the other, but rather in favor of a third categoryan interdependent complex collective formed out of diverse individuals. The traditional collective model was a model that relied upon uniformity of the individuals rather than diversity. Similarly, the ideology of the individual did not view the individual in relation to the collective, but rather the individual serving himself or herself. It should be acknowledged that both philosophies were deeper than their caricatures would suggest. The philosophy of democracy included the idea that the individualistic actions would also serve the benefit of the collective, and the philosophy of communism included the idea that the collective would benefit the individual. Nevertheless, the concept of civilization as a complex organism formed out of human beings is qualitatively different than either form of government.

CONCLUSIONS

There are two natural conclusions to be drawn from recognizing that human beings are part of a global organism. First, one can recognize that human civilization has a remarkable capacity for responding to external and internal challenges. The existence of such a capacity for response does not mean that human civilization will survive external challenges any more than the complexity of any organism guarantees its survival. However, one can hope that the recent reduction in the incidence of military conflicts will continue and the ability to prevent or address local disasters will increase. The difficulties in overcoming other systematic ills of society, such as poverty, may also be challenged successfully as the origins of these problems become better understood.

Second, the complexity of our individual lives must be understood in the context of a system that must enable its components (us) to contribute effectively to the collective system. Thus, we are being, and will continue to be shielded from the true complexity of society. In part this is achieved by progressive specialization that enables individuals to encounter only a very limited subset of the possible professional and social environments. This specialization will have dramatic consequences for our children, and their educational and social environments are likely to become increasingly specialized as well.

What additional conclusions can be made from the recognition of human civilization as a complex organism? Given the complexity of its behavior, it is necessary to conclude self-consistently that as individuals we are unable to understand it, even though we comprise it as a collective. Therefore, one would be unwise to argue, on the basis of general considerations, matters of social policy. Social policy questions must be dealt with by the systemby the people involvedas direct challenges to the system.

However, this analysis suggests that it is possible to understand the functional structure and dependencies that exist in global civilization and organizations that comprise it. These dependencies are related to the scale of behaviors that can be triggered in response to internal and external challenges. When analyzing the nature of challenges, a similar analysis can be performed to recognize the scale, or scales, of behavior that are necessary to respond to them effectively. Recognizing the scale of necessary response should be an important contribution to our ability to address both internal and external challenges.

This is a brief introduction to concepts and tools of complex systems that can be applied to a wide range of systems. The central notion was the development of an understanding of the complexity profile which quantifies the relationship between independence, interdependence and the scale of collective behavior. By developing such tools we may discover much about ourselves, individually and collectively. The merging of disciplines in the field of complex systems runs counter to the increasing specialization in science and engineering. It provides many opportunities for synergies and the recognition of general principles that can form a basis for education and understanding in all fields.

Random, coherent and correlated behaviors illustrate the relationship between the behavior of parts and the collective behavior of a system. In both random and coherent behavior the collective behavior of the system is simple. Correlated behavior gives rise to complex collective behavior. Examples illustrating these types of behavior can be found in physical, biological and social systems.

The complexity profile is a mathematical tool that is designed to capture important aspects of the relationship between the behavior of parts of a system and the behavior of the entire system. Behaviors of the system are assigned a scale which is related to the ability of an observer to see that behavior. Typically, larger scale behaviors involve coordination between more parts and/or larger amounts of energy. The complexity profile counts the number of behaviors that are observable at a particular scale, which includes all behaviors assigned to that scale or larger scales. When a system is formed out of independent parts, the behaviors are on a small scale. When a system is formed out of parts that all move in the same direction, the behavior is on the largest scale. When a system is formed out of parts whose behaviors are partially correlated and partially independent then as we look at the system on finer and finer scales we see more and more details. This is characteristic of complex systems formed out of specialized and correlated parts. Such systems have a complexity profile that declines gradually with scale.

The complexity profile of a human being is a smoothly falling curve because there are various scales at which details of the internal behavior of parts of a human being become visible. For example, at the atomic scale the motion of individual atoms is visible, but most of these motions are not visible at the cellular scale. When considering the collective behavior of groups of human beings, it is convenient to consider as a reference the value of the complexity profile at the scale of a human being, C Individual . This describes the complexity of influence one human being can have on another.

Hierarchical organizations are designed to impose correlations in human behavior primarily through the influence of the hierarchical control structure. In an ideal hierarchy all influences/communications between two “workers” must travel through a common manager. As the complexity of collective behavior increases, the number of independent influences increases, and a manager becomes unable to process/communicate all of them. Increasing the number of managers and decreasing the branching ratio (the number of individuals supervised by one manager) helps. However, this strategy is defeated when the complexity of collective behavior increases beyond the complexity of an individual. Networks allowing more direct lateral interactions do not suffer from this limitation.

The behavior of a system and the environmental demands upon it are related. This relationship is established through the selection of systems that continue to survive in the environment. In particular, the complexity of the environmental demands must be less than the complexity of the system behavior for organisms that are likely to survive. The environment of human organizations is partially composed of other human organizations. Through competition an increase in the complexity of one organization leads to an increase in the complexity of the environment of other organizations. This suggests that over time the complexity of organizations increase until the collective behavior becomes more complex than the behavior of an individual human being.

The history of human civilization reflects a progressive increase in the complexity of large scale behaviors. Early civilizations introduced a few relatively simple large scale behaviors by use of many individuals (slaves or soldiers) performing the same repetitive task. Progressive specialization with coordination increased the complexity of large scale behaviors. The industrial revolution accelerated this process which continues till today. When the complexity of collective behaviors increases beyond that of an individual human being then hierarchical controls become ineffective. Hierarchically controled systems must yield to networked systems. Note that a system which has fixed energy and material can change its complexity profile only by transfering activities from one scale to another. Increasing complexity at one scale must be compensated by decreasing complexity at another scale. However, an increasing human population, and the addition of sources of energy during the industrial revolution (coal, oil and gas), violated these conditions, enabling the complexity to increase on all scales. As indicated on the horizontal axis, the scale of human civilization also increased.

A schematic history of human civilization reflects a growing complexity of the collective behavior of human organizations. The internal structure of organizations changed from the large branching ratio hierarchies of ancient civilizations, through decreasing branching ratios of massive hierarchical bureaucracies, to hybrid systems where lateral connections appear to be more important than the hierarchy. As the importance of lateral interactions increases, the boundaries between subsystems become porous. The increasing collective complexity also is manifest in the increasing specialization and diversity of professions. Among the possible future organizational structures are fully networked systems where hierarchical structures are unimportant.

Catching a ball with a homeostat – GentlySerious – Medium

 

Source: Catching a ball with a homeostat – GentlySerious – Medium

Catching a ball with a homeostat

Where will the ball go?

What’s the difference between going deep and drilling down? We look at some modelling approaches that reveal structures built on structures built on structures. These approaches also show how highly dynamic outcomes are built on keeping things stable.

Let’s do the metaphor first. If you are on a boat at night and you see a light then you may want to note the following: if you are moving and the light stays on the same bearing to you, then you are on a collision course and may want to take evasive action. Always remembering the battleship captain who radioed to say he was a battleship and whatever the light was on should keep clear, only to be radioed back by the lighthouse-keeper to suggest another course of action…

The off-putting label is perceptual control theory, or PCT. The standard PCT case relates directly to this metaphor. Suppose a fielder in a cricket match runs to catch a high ball. How on earth does he know where to run, with no time to work it out? Well, it seems that all the fielder has to do is to keep the ball at the same angle to his field of vision and he will be on a collision course with the ball as desired. An athlete moving at speed under pressure succeeds is his highly dynamic quest by keeping something stable. Remembering the warship, of course you may not be the only person trying to catch the ball: I smashed my nose playing rugby that way, loads of blood.

The early work of Warren McCulloch was built on by William Powers, who demonstrated that a control loop like the one used by the fielder is the basis of neurological control of many types, but that such loops are built of many subsidiary loops which in turn are built up in the same way, recursively. Think for a moment about the temperature of our bodies; it is critical that it is held stable by mechanisms such as sweating and such as the closing down of capillary blood vessels near the skin. It is also obvious that other body systems, especially the brain, are crucially dependent on that temperature maintenance. Many supports, many dependencies, not all of them obviously homeostatic maintenance of variables.

In living systems the reference variable for each feedback control loop in a control hierarchy is generated within the system, usually as a function of error output from a higher-level system or systems. — Wikipedia on William Powers.

The nature of such control loops is to cancel out any divergence from a set range of some parameter. There is a demonstration that you can easily do with a friend. Knot two elastic bands together. Put a reference dot in the middle of a sheet of paper. Put your market pen in one elastic band and give your friend a pen in the other band, with the knot over the reference mark on the paper. The instruction to your friend is to keep the knot over the mark. As you trace out a pattern with your pen, your friend must stretch his pen and band in an opposite motion to yours. He will draw mirror image pattern to yours. You can do this as a demo in a lecture — the instructions are not shared publicly and the participants have to guess what they were…

Deep models

The predictions of these models used to simulate neural control are very accurate. And the models can be many layers deep. The implication of a deep model is this: when a basal control loop goes out of bounds or is modified, then many other things will change. A single control loop may be a part of many circuits.

There is a psychotherapy version of this structure where some of our beliefs can be modified fairly independently of others, but some are deeply enmeshed and may imply serious and difficult changes in many areas of life and belief. For some people it is a comfort to know that the deep change and subsequent reconstruction can be mapped out.

This understanding of depth and the foundational nature of some things but not others does not come easy in the world of business and organisations. It is not the same thing as prioritisation or importance: cash flow or profit for instance are important but are a superficial outcome of many other things that are much less visible or malleable. And this is the opposite of drilling down which only finds ever more detail about a narrower field of interest.

Conventionally on a risk register, a risk is noted as having a potential impact on a project. In the risk management system that I built and worked with, risks were risks to the achievement of business objectives and a given risk might affect many objectives. And an objective might be contributed to by many projects. In the language of Larry Hirschhorn in The Workplace Within, any organisation has a primary task even if it is not articulated. And clearly some risks are going to be primary in the sense that they jeopardise the primary task itself.

If we use our ship metaphor again, an organisation sees a light, sees the light, recognises something. Is it on a collision course with some unrecognised risk? Quite possibly, and the way to find out is not to plough on regardless, but to do some experimental changes of course. What shifts? When Russian fighter planes fly into western airspace and Russian submarines penetrate the Swedish archipelago they are not playing. They are seeing who responds in what way. They are looking for where they have excited some sensitivities they might have been unaware of. And they are asking for and checking the significance of what they excite.

You find deep and primary elements of your structure by probing. The behaviour of most organisations is to let sleeping dogs lie. Philip and I rehearsed some of the rich language of avoidance: papering over the cracks, putting a brave face on it, skating on thin ice, building on sand. Without a sense of depth and without a strong grip on the primary task (displaced usually by personal survival and immediate concerns) we regularly miss that we are on a collision course. Really, really the most critical things are not even noticed, especially if they are deep in the sense used here.

The leap of faith

Among the grand old practical engineers of huge systems, the hands-on guys who knew intuitively about stability, there was a saying about the necessary leap of faith. No matter how much analysis and modelling and testing had been done, there is always a leap of faith that something will work in practice and it cannot be avoided. There is no certainty and can be no certainty. This might be Godel or Heisenberg or whoever, but as a practical question these guys like Bill Livingstone knew it in their waters.

This leap of faith also demands a discrimination between deep and superficial. Work that is ultimately superficial may make everyone feel better, that the situation is under control, but if it obscures the nature of the leap of faith it is unhelpful, counter-productive, potentially confusing and dangerous. Who is shouldering that leap of faith and who is going to learn from how it goes? Can we take leaps early and pin down some aspects of system behaviour? Is it possible to deal with deep and foundational things before they are built on?

This example is getting over-used here but it is a perfect fit. Ancel Keys bet the farm on changing the American diet to reduce rates of heart disease. He was wrong and he caused a global epidemic of illness. He had no safety net to re-evaluate the unfolding outcomes and none of the actual clinical trials supported his guesses. He didn’t know that he was looking at something as deep and foundational as he was.

It turns out that people, all of us, have two metabolic mechanisms: one burning glucose and the other ketones. It is too much glucose and the accompanying too much insulin that brings on our western chronic diseases. But by changing almost everyone’s diet, Ancel Keys accidentally ensured that everyone was stuck on glucose metabolism, because he demonised fat as a body fuel. So all the medical research in the last forty years has used a norm of human biochemistry that is itself a problem. And all the results from forty years of research are of dubious value and no-one can admit it. I have tried with the key proponents of “evidence -based medicine” to get them to take a sceptical view of their statistics.

Our claim in this blog is that this is the normal way of human knowledge. There are deep issues which potentially invalidate everything we know, and we don’t look for them! David Bohm in Thought as a System explains that because thought is a system a single flaw can invalidate the whole structure: weakest link and all that. He has a method called Bohmian Dialogue where a group of people build trust in each other over weeks and months of meeting regularly, gradually questioning each other deeper and deeper about the hidden assumptions in what they are each saying. That is what it takes and that is what no one is prepared to do. Why put vast amounts of effort into undermining your beliefs?

Enterprise architecture

Philip is an enterprise architect, a least sometimes. Enterprise Architecture (EA) as a discipline has an intuitive cachet: it would be nice to understand the structure of an enterprise/organisation in some way that made sense of why certain things are connected and certain things are not. Buildings have some logic (not always good or helpful) and maybe organisations can be designed a bit and mapped a bit too. You can gain extensive and serious qualifications in this field and you can wallow in oceans of detail that does indeed need ordering, but nothing in all that says you will find the deep things or a good angle on the primary task.

There seems to be a tension between clarity and power. Almost all organisations qua organisations are more interested in being busy than in finding out what the job is. There has to be a reason why we almost always risk endless error, damage and rework rather than look for the nature of the leap of faith. Lets just get on with it.

I was an observer in the early days of building Heathrow Terminal 5, then the biggest construction project in Europe. The contracts for the main contractors were organised this way. Each appointed contractor put in a cost estimate for doing their part. BAA, the client, deemed that the total of these estimates was 150% of what they were going to spend and the contractors need to work with each other to find the cost savings required.

The contractors loathed with a great loathing being exposed in this way. They wanted to get on doing what they knew how to do and not to have their estimates exposed to scrutiny. They started inventing things to do saying “we have never done this piece of engineering before and therefore we need to do that piece of work in order to get the estimate more accurate. Anti-depth: do the things you know how to do so as to avoid the leaps of faith and the perceived risk of failure. Even if the client is telling you the only thing they want at this point is for you to take the risks. You can lead a horse to water but you can’t make it drink.

Almost as a postscript, my colleague Martin Thomas said ten years ahead of the go-live date that baggage handling was on the critical path, i.e. was deep and foundational. No-one could see how a process like baggage handling could be more critical than building the beautiful physical structures. If you remember back to when the terminal first opened, there was baggage handling chaos. Of course Martin was far from popular!

The Science of the Unknowable: Stafford Beer’s Cybernetic Informatics Andrew Pickering, 2004

source (pdf) https://uberty.org/wp-content/uploads/2015/10/02-pickering.pdf

 

The Science of the Unknowable:
Stafford Beer’s Cybernetic Informatics
Andrew Pickering

Abstract
This essay explores the history of Stafford Beer’s work in management cybernetics, from his early conception and simulation
of an adaptive automatic factory and associated experimentation in biological computing up to his development of the
Viable System Model of complex organizations and its implementation in Chile. The essay also briefly pursues Beer into the
arenas of politics and spirituality. The aim throughout is to show
that all Beer’s projects can be understood as specific instantiations
and workings out of a cybernetic ontology of unknowability and
becoming: a stance that recognizes that the world can always
surprise us and that we can never dominate it through knowledge. The thrust of Beer’s work was thus to construct information systems that can adapt performatively to environments they
cannot fully control.

Filtered for water in history (22 Jan., 2018, at Interconnected) – Stafford Beer’s T- U- and V-machines and the factory managed by a pond

 

Source: Filtered for water in history (22 Jan., 2018, at Interconnected)

 

4.

Stafford Beer was the cyberneticist and business management pioneer who, in the early 1970s, built Project Cybersyn for the revolutionary government of Chile. Command economy meets socialist proto-internet.

In the early 1960s, he was running a more esoteric experiment, in pursuit of his desire to build an automated factory.

From historian Andrew Pickering’s essay, The Science of the Unknowable: Stafford Beer’s Cybernetic Informatics:

The T- and V-machines are what we would now call neural nets: the T-machine collects data on the state of the factory and its environment and translates them into meaningful form; the V-machine reverses the operation, issuing com- mands for action in the spaces of buying, production, and selling. Between the T- and V-machines lies the U-machine — the homeostat, or artificial brain — which seeks to find and maintain a balance between the inner and outer conditions of the firm

The U-machine.

By the way,

The cybernetic factory was not pure theory. By 1960 Beer had at least simulated a cybernetic factory at Templeborough Rolling Mills, a subsidiary of his employer, United Steel

It is a core tenet of (early) cybernetics that sufficiently complex learning systems are somewhat equivalent, whether they are made of flesh and blood, or vacuum tubes. It is this tenet which allowed the audicity of the cyberneticists to consider building “intelligent” machines, or to model the brain as a network of moving information.

And sure enough, when I went to the library to consult Beer’s collected papers, How Many Grapes Went into the Wine: Stafford Beer on the Art and Science of Holistic Management, Beer discusses the search for his ideal U-machine:

a self-organizing system need not have its circuitry designed in detail — otherwise what virtue is there in the self-organizing capability? Furthermore, if systems of this kind are to be used for amplifying intelligence, a fixed circuitry is a liability. Instead we seek a fabric that is inherently self-organizing, on which to superimpose (as a signal on a carrier wave) the particular cybernetic functions that we seek to model

And he continues:

Dr Gilbert, who had been trying to improve the Euglena cultures, suggested a potent thought. Why not use an entire ecological system, such as a pond?

So Stafford Beer captures a woodland pond, and attempts to train it to run a factory:

Accordingly, over the past year, I have been conducting experiments with a large tank or pond. The contents of the tank were randomly sampled from ponds in Derbyshire and Surrey. Currently there are a few of the usual creatures visible to the naked eye (Hydra, Cyclops, Daphnia, and a leech); microscopically there is the expected multitude of micro-organisms. In this tank are suspended four lights, the intensities of which can be varied to fine limits. At other points are suspended photocells with amplifying circuits which give them high sensitivity.

The intention was to communicate information about the factory into the pond via optical couplings. Earlier attempts, reported by Pickering, included attempts to induce small organisms — Daphnia collected from a local pond –to ingest iron filings so that input and output couplings to them could be achieved via magnetic fields.

The state of this research at the moment is that I tinker with this tank from time to time in the middle of the night.

I have this picture of Beer, in his slippers in his basement, trying to figure out not only how to speak to this tank of water and algae in its own language, but attempting to put it through business school.

What would be the management style of such a factory foreman? Risk averse? A deep sympathy with the principles of sustainability and the circular economy? (Given it sits in a closed-system tank.)

Our modern efforts into machine learning and artificial intelligence have a familiar feel: we place the neural network at the heart of the system… and just turn it on. And although we can’t tell how the neural network recognises a face or optimises a system, we can tell that they have some natural politics: AIs are unable – or unwilling – to correct for their implicit racism and sexism.

What is the umwelt of a pond? What is the umwelt of an AI?

Uber’s marketplace and Facebook’s newsfeed are run by captured artificial intelligences — unreasonably efficient optimisers, blind to human feelings, natural free market libertarians; a warp core of tremendous ability and held only just in check. We don’t know how these things make their decisions, but we are beginning to see the biases in their actions.

Obviously Stafford Beer’s experiments came to nothing: the factories of China are not run by captured, semi-sentient woodland ponds.

Or. Who knows. Maybe we should put one in charge of Facebook.

018 – The Cybernetic Brain, Part 1: Ontological Theatre — General Intellect Unit — Overcast

This – from a longer and ongoing podcast – is quite interesting to me because they have a different segment of understanding of cybernetics to the slice I have. Some of the other stuff is much more political (socialist) focused – this and the next episode (on Pickering on Beer) are the most clearly systems thinking focused.

Source: 018 – The Cybernetic Brain, Part 1: Ontological Theatre — General Intellect Unit — Overcast

 

018 – The Cybernetic Brain, Part 1: Ontological Theatre
0:001:18:54
speed
++++++
In which we begin a two-part discussion of The Cybernetic Brain, by Andrew Pickering. This episode covers the opening two chapters, “The Adaptive Brain” and “Ontological Theatre”. If you like the show, consider supporting us on Patreon. Links: The Cybernetic Brain at University of Chicago Press General Intellect Unit on iTunes http://generalintellectunit.net Support the show on Patreon https://twitter.com/giunitpod General Intellect Unit on Facebook General Intellect Unit on archive.org

(2) Design@Large: Ann Pendleton-Jullian & John Seely Brown: Agency in a White Water World – YouTube

Design@Large: Ann Pendleton-Jullian & John Seely Brown: Agency in a White Water World

Published on 7 Apr 2017

Design@Large for Winter 2017 Quarter CSE 1202 Wednesdays 4:00 PM – 5:15 PM

Peter Scholtes on Teams and Viewing the Organization as a System | Curious Cat Management Improvement Blog – John Hunter

 

Source: Peter Scholtes on Teams and Viewing the Organization as a System | Curious Cat Management Improvement Blog

 

Peter Scholtes on Teams and Viewing the Organization as a System

In this presentation Peter Scholtes provides an explanation of teams within the context of understanding an organization of a system:

We will not improve our ability to achieve our purpose by empowering people or holding people accountable. I know that those are fashionable words but what they have in common that I think is the wrong approach is that they still are focused on the people and not on the systems and processes. I’m sure that will trigger quite a bit of conversation and perhaps some questions.

He is right, though those are difficult old thoughts to break from for many. He does a good job of explaining how to seek better methods to achieve more success in this presentation and in the Leader’s Handbook. Following the links in the quote above will also provide more details on Peter’s thoughts.

Peter includes a description of the creation of the “organization chart” (which Peter calls “train wreck management”) that we are all familiar with today; it was created in the Whistler report on a Western Railroad accident in 1841.

Almost a direct quote from the Whistler report: “so when something goes wrong we know who was derelict in his duty.” The premise behind the traditional organizational chart is that systems are ok (if we indeed recognize that there are such things as systems) things are ok if everyone would do his or her job. The cause of problems is dereliction of duty.

Peter then provides an image of W. Edwards Deming’s organization as a system diagram which provides a different way to view organizations.

In the old way of viewing organizations you look for culprits, in this way of viewing the organization you look for inadequacies in the system. In the old way of viewing the organization when you ask “whom should we please” the answer is your boss. In this way of viewing an organization when you ask “whom should we please” the answer is our customers.

This is an absolutely great presentation: I highly recommend it (as I highly recommend Peter’s book: The Leader’s Handbook).

Without understanding a systems view of an organization you can’t understand whats at the heart of the quality movement and therefore everything else you do, management interventions, ways of relating to people, will reflect more likely the old philosophy rather than the new one.


Points like this are very true but difficult to understand until you come to view organizations as systems.

The whole notion of empowering people reflects the hierarchical view of the organization. People at the higher levels of the hierarchy empower people in the lower levels of the hierarchy. I suppose if you are going to stay with a hierarchical set of premises empowerment is better than no empowerment but if we are going to try and convert our thinking to a systems view then the notion of empowerment has no meaning in a systems organization.

When a group of people have a clear purpose then they can be called the beginning of a team. Then they will be able to make themselves into a team, when previously they were just an aggregate of individuals.

If you want to create teamwork in a group of people the best way to do that is give them a job worth doing and the methods to do it successfully.

Previous posts on this blog on related i

The proof that Facebook is broken is obvious from its very modus operandi | John Naughton | Opinion | The Guardian

 

Source: The proof that Facebook is broken is obvious from its very modus operandi | John Naughton | Opinion | The Guardian

 

Facebook’s burnt-out moderators are proof that it is broken

Despite employing a small army of contractors to monitor posts, it’s clear the company is no longer fit for purpose

A moderator featured in the film The Cleaners: ‘sobering viewing’.
 A moderator featured in the film The Cleaners: ‘sobering viewing’.

Way back in the 1950s, a pioneering British cybernetician, W Ross Ashby, proposed a fundamental law of dynamic systems. In his book An Introduction to Cybernetics, he formulated his law of requisite variety, which defines “the minimum number of states necessary for a controller to control a system of a given number of states”. In plain English, it boils down to this: for a system to be viable, it has to be able to absorb or cope with the complexity of its environment. And there are basically only two ways of achieving viability in those terms: either the system manages to control (or reduce) the variety of its environment, or it has to increase its internal capacity (its “variety”) to match what is being thrown at it from the environment.

Sounds abstruse, I know, but it has a contemporary resonance. Specifically, it provides a way of understanding some of the current internal turmoil in Facebook as it grapples with the problem of keeping unacceptable, hateful or psychotic content off its platform. Two weeks ago, the New York Times was leaked 1,400 pages from the rulebooks that the company’s moderators are trying to follow as they police the stuff that flows through its servers. According to the paper, the leak came from an employee who said he “feared that the company was exercising too much power, with too little oversight – and making too many mistakes”.

continues in source

Systemic Leadership Summit – a free online thingummy January 13-20, 2019

The Systemic Leadership Summit is an online event and has a simple mission – to help create a shift in our leadership paradigm and dramatically grow and spread the transformation capabilities of leaders across the world. How? By introducing you to a highly diverse, cutting edge and experienced group of influencers.

Source: Systemic Leadership Summit

 

Systemic Leadership Summit 2019

The new way to grow, develop & transform your organization

Free – Online – 7 Days – 15+ Leader & Expert sessions

January 13-20, 2019

Learn from the best about
Systemic Leadership

The Systemic Leadership Summit is an online event and has a simple mission – to help create a shift in our leadership paradigm and dramatically grow and spread the transformation capabilities of leaders across the world. How? By introducing you to a highly diverse, cutting edge and experienced group of influencers.

We’ve brought together over 15 of the world’s most influential thought leaders, experts and wise individuals from across the world, who live and breathe systemic approaches and who embody this paradigm shift towards a new collective focused leadership. They will teach you all about systemic leadership and a 3-step approach how to bring forth leadership from the collective.

This is the third edition of the Systemic Leadership Summit, which was first launched January 2017.

This exclusive online event is broken down into 3 parts to help you accelerate your understanding and implement your learnings faster:

1 See The System First
View Your Tribe As a Whole

You will learn what systems are and what a systemic approach to leadership brings to the table. You will practice seeing your tribe as a system and discover what it costs you when you keep focusing on the parts in it.

2 Foster Generative 
Communication & Interaction

Learn how to have dialogue from a place of real connection, deep listening and reflection. You will be able to tap into the wisdom and the different viewpoints that exist in the system you are part of.

3 Co-create Sustainable SolutionsTransform the System

Start generating results from the collective intelligence and leadership of your tribe by co-creating from what emerges, rather than react to what has already happened in your systems environment.

speaker featured in:

Get acc​​​​​ess to 15+ expert sessions

You can now get access for FREE (for a limited time)!

The experts
in Systemic Leadership

I feel honored to present to you speakers who are at the top of their game. They’re the top experts & elite leaders from around the world.

Despite their extremely busy schedules, each of these speakers jumped on board for this event and promised to teach their best knowledge and experience — because they don’t want you to go through the same mistakes and setbacks they made… and they know that the right strategy or insight, properly applied, can change everything.

All I can say is, you’re in for an amazing summit with these world class speakers!

Below is a overview of the speakers & the topics they will be discussing.

Phase 1 – See the System first

Jennifer Campbell

Creator & Host of the Systemic Leadership Summit, Senior Change, Leadership & Living Human Systems

Leader and Expert

Summit Kick-off and

the Value of Systemic Leadership

Dr. Peter Senge

Founding Chair of Society of Leader & System Leadership Institute, author of the Fifth Discipline and a senior lecturer at the Massachusetts Institute of Technology.

Beyond the Fifth Discipline:

System Leadership 2.0

Founding member and

partner at Encode.org

and Evolution at Work, Creator of

Language of Spaces

Language of Spaces

Klaus Lombardozzi

Leader in Multinational Organizations,

Internationally CRR Global Certified Organizational & Systems/Team Coach

Leading with Relationship Intelligence

Noomi Natan

Certified Coach and Constellatory trained at

The Centre for Systemic Constellation and the Nowhere Academy

The Power of Constellations

Christian Kromme

Author of Humanification, Public Speaker, and board member at a.o. the Workforce Institute EMEA and the Human Genome Foundation

Humanification:

Go digital,

Stay Human

Phase 2 – Foster reflective and generative communication

Dr. Alexander Laszlo

Director of Development at L-INPR, President of B of D BCSSS & ISSS, Founding Dir. of the Doctoral Program in Leadership & Systemic Innovation at ITBA (Arg.)

Thrivability & Being the Systems you want to See in the World

Heather Plett

Speaker,  Writer,

Facilitator of the

Holding Space Coach/Facilitator

Program

Holding Liminal Space

George Por

Founder of Community Intelligence, Creator of the Enlivening Edge Community and Faculty member at Meridian University

Evolutionary Purpose

Katherine Tyler Scott

Managing Principal of KiThoughtBridge ,

Chair of the International Leadership Association Board  (ILA)

Leading Highly Anxious Systems

Mathias Weitbrecht

Founder and Managing Director of Visual Facilitators, Facilitator, Visual Strategist,

Graphic Recorder

Visual Strategy: the Why and How of Visualization

Speaker to be confirmed

xxxxxxxxxxxxxxxx

xxxxxxxxxxxxxxxxx

xxxxxxxxxxxxxxxxxx

Evolving our company

Phase 3 – Co-create sustainable solutions and transform the system

Sarah Cornally

Senior Systems Intelligence Professional,  accredited facilitator & AICD faculty  in ‘Board Ready’, and ‘Mastering the Boardroom’ programs. Graduate of Harvard University’s The Art & Practice of Leadership Development.

Systems Intelligence

in Corporations

Dr. Peter Robertson

Executive Lecturer at Nyenrode Business University, visiting professor to universities in NL, USA and China,  author of  Always Change A Winning Team and The Ecological Leader, senior consultant.

Ecology in Business

Nora Bateson

President of the International Bateson Institute,

research designer,

film-maker, writer, author of

Small Arcs of Larger Circles

Liminal Leadership

Speaker to be confirmed

xxxxxxxxxxxxxxxxxxx

xxxxxxxxxxxxxxxxxxx

xxxxxxxxxxxxxxxxxxx

To be confirmed

Summit host et. al.

xxxxxxxxxxxxxxxxxxx

xxxxxxxxxxxxxxxxxxx

xxxxxxxxxxxxxxxxxxx

Live Q&A Session

What will you learn?

  • See WHY the old leadership paradigm is not working

  • Discover what it costs you when you stick to old ways

  • Be inspired by the power of living human systems

  • Link leadership development with your tribe’s objectives

  • See how systemic leadership creates more leaders

  • Let results grow exponentially

  • Foster generative communication and dialogue

  • Apply actionable tools for reflection within your tribe

  • Join up disconnected ‘levers’ to improve leadership

  • Cement leaders’ individual and collective accountability

  • Take on an inner stance of listening and learning

  • Embrace and leverage the diversity in your tribe

Get access to 15+ expert sessions

You can now get access for FREE (for a limited time)!

What makes this summit unique?

We all face the same problems when we find ourselves trapped in the hero based leadership paradigm

  • Are you tired of trying to make change happen in your organization?

  • Are your organizational culture and old patterns preventing innovation, growth and new possibilities?

  • Is the number of complex changes increasing, while the success rate in your change programs is decreasing?

  • Are you looking for new ways to incorporate a higher purpose in your business or community, but don’t know how?

The hero-based leadership paradigm no longer works when faced with today’s complex problems.

We need a different approach. Here, in the Systemic Leadership Summit, you will discover what this approach is and how it will help you develop your systemic leadership capabilities.

You know how to lead and coach people. Now learn to spread leadership in your team, organization and community.

A startling 86% of respondents to the Survey on the Global Agenda (World Economic Forum, Outlook on 2015), agree that we have a leadership crisis in the world today. It is becoming harder for anyone to emerge as a strong leader. One is forced to play the game the way it’s built – which is inevitably in the interest of the system, rarely in the interest of the people.

But you dare to challenge the status quo.

You believe that the game can be changed and that we can make a paradigm shift in the way we look at leadership. You believe more strong leadership can enter teams and organizations, when it is spread out across more people.

But while there are thousands of courses and books about how to become a leader in the traditional sense, there has hardly been any education on how to spread leadership in the modern tribes we live and work in as human beings today.

You’ve been in the dark about where to learn and leverage this. Until now.

Learn right here at the Systemic Leadership Summit!

Why you should attend

1   Slash Your Learning Curve
With 100+ Years of Leadership and Systemic Approaches and Transformation Strategies Straight From People Who’ve Done It

Most people spend years trying to “figure it out” — and settle for a fraction of the success they and their tribes deserve. Why waste time experimenting when you can learn directly from people who’ve done what you want to do…straight from the horse’s mouth.

The speakers I’ve hand-selected will empower you by teaching you what really works…
so you can unite, build & spread leadership — and co-create change and transformation in your team, organization or community.

2   Action Step-Packed
Interviews
With Top Experts, Leaders
& Entrepreneurs

You get to see the expert speakers and me have a real, raw, authentic conversation about a topic in-depth. While delivering strong content and examples, the sessions are also aimed to provide you with valuable takeaways and actionable advice you can use immediately within your own tribe.

3  Your Ticket is
COMPLIMENTARY

(for a limited time)

Although most conferences with speakers like these cost thousands of dollars, we are gifting you with a complimentary ticket because we know how powerful and inspirational this material is.

But you must claim your spot now because each summit session will stream free for JUST 2 DAYS— then it’ll be locked up in the Systemic Leadership Summit vault. With a free ticket you will have access to the community area, where every session is made available for 48 hours.

Get acc​​​​​ess to 15+ expert sessions

You can now get access for FREE (for a limited time)!

Experiencing this online conference

First, let me express how enriching and relevant I find the summit, its topics and speakers. And also, you have an impressive and very helpful ability to summarise and ask questions. Thank you for that!

I did not have a chance to attend all sessions live, but will be listening to the onesremaining in the coming days with my All Access Pass.

Ryan Makhani

Systemic Leadership
Summit Participant

Frequently Asked Questions

What is the Systemic Leadership Summit?

The Systemic Leadership Summit is an online event featuring 20+ world-class experts, influencers and thought leaders. They share with you their knowledge about and experience with systemic approaches to leadership: leadership as a role that belongs to an entire team, organization, community or society.

You will learn what ego-based leadership is costing you and why and how systemic leadership leads to sustainable change and transformation in your tribe. In other words, if you want to take you and the people you lead to the next level, register for this profound online event.

Who should attend this summit?

The Systemic Leadership Summit is not for everyone. This event is a good fit for you if you are:

  • A leader who would like to have more results WITH the people you lead

  • An entrepreneur or business owner who wants to take your business to the next level with your team

  • A leadership coach or team coach who wants to learn more about systemic approaches and boost your success with the leaders and leadership teams you coach

Who is this event NOT meant for?

The Systemic Leadership Summit is not for people who like chasing the latest trend or who want more power for themselves. This summit is designed to be used to build long-term sustainable business, community and societal change. The summit is advanced material, focused on the collective leadership, and is therefore not aimed at people who would like to start learning basic traditional leadership skills.

Where is the event located?

Wherever you are! Because this is an online event, there is no physical venue and no travel expense. You can watch anywhere with an internet connection.

The Systemic Leadership Summit is designed to provide powerful content you can consume in a way that works for you. Therefore it is location independent.

H​​ow do I watch the live sessions?

Once you claim your free ticket, you’ll receive an email in your inbox each day of the event, giving you access to all of the sessions as they happen. Simply login and follow the easy instructions we give. You’ll be able to view our summit sessions on any computer, tablet or mobile device (with internet connection).

Jennifer Campbell

Systemic Leadership Summit Host, Senior Change & Transformation Manager, Leadership & Organization Development Professional and Executive & Relationship Systems Coach with over 20 years of worldwide professional experience in fortune global 500 companies such as Ford Motor Company, Hewlett Packard, Vodafone Group, NTT, Air France-KLM Group, Deutsche Bank, Royal Philips and Telstra Corporations.

Jennifer’s mission is to help leaders, teams and organizations change and transform towards growth, success and happiness in life, and to do business in an increasingly complex international context.

Jennifer organized the world’s biggest online systemic event, the Systemic Leadership Summit, to inspire and call forth leaders like you, and to help them tap into the collective leadership and co-create sustainable social change in their businesses, their lives and on this planet

You don’t need more of the same hero-based leadership training. You just need
a shift towards a different kind of leadership, towards a much more systemic approach to leadership. Once you make the shift, it will help you boost your transformation endeavors, create sustainable social change and enable you to take yourself, your team, your organization and your community to a higher level.

EmailSumoMe

Building social resilience in socio-technical systems through a participatory and formative resilience approach | Published in Systemic Change Journal – van de Merwe, Biggs, Preiser

First article in the new Systemic Change Journal!

 

Source: Building social resilience in socio-technical systems through a participatory and formative resilience approach | Published in Systemic Change Journal

 

Building social resilience in socio-technical systems through a participatory and formative resilience approach

Ecology and Society: Social-ecological systems as complex adaptive systems: organizing principles for advancing research methods and approaches

Preiser, R., R. Biggs, A. De Vos, and C. Folke. 2018. Social-ecological systems as complex adaptive systems: organizing principles for advancing research methods and approaches. Ecology and Society 23(4):46. https://doi.org/10.5751/ES-10558-230446

Source: Ecology and Society: Social-ecological systems as complex adaptive systems: organizing principles for advancing research methods and approaches

 

Ecology and SocietyEcology and Society
VOL. 23, NO. 4 > Art. 46
This article  is under a Creative Commons Attribution-NonCommercial 4.0 International License.  You may share and adapt the work for noncommercial purposes provided the original author and source are credited, you indicate whether any changes were made, and you include a link to the license.
Go to the pdf version of this article
The following is the established format for referencing this article:
Preiser, R., R. Biggs, A. De Vos, and C. Folke. 2018. Social-ecological systems as complex adaptive systems: organizing principles for advancing research methods and approaches. Ecology and Society 23(4):46.
https://doi.org/10.5751/ES-10558-230446

Synthesis

Social-ecological systems as complex adaptive systems: organizing principles for advancing research methods and approaches

1Centre for Complex Systems in Transition, Stellenbosch University, South Africa, 2Stockholm Resilience Centre, Stockholm University, Sweden, 3Department of Environmental Science, Rhodes University, South Africa, 4Beijer Institute, Royal Swedish Academy of Sciences, Sweden

ABSTRACT

The study of social-ecological systems (SES) has been significantly shaped by insights from research on complex adaptive systems (CAS). We offer a brief overview of the conceptual integration of CAS research and its implications for the advancement of SES studies and methods. We propose a conceptual typology of six organizing principles of CAS based on a comparison of leading scholars’ classifications of CAS features and properties. This typology clusters together similar underlying organizing principles of the features and attributes of CAS, and serves as a heuristic framework for identifying methods and approaches that account for the key features of SES. These principles can help identify appropriate methods and approaches for studying SES. We discuss three main implications of studying and engaging with SES as CAS. First, there needs to be a shift in focus when studying the dynamics and interactions in SES, to better capture the nature of the organizing principles that characterize SES behavior. Second, realizing that the nature of the intertwined social-ecological relations is complex has real consequences for how we choose methods and practical approaches for observing and studying SES interactions. Third, engagement with SES as CAS poses normative challenges for problem-oriented researchers and practitioners taking on real-world challenges.

Key words: complex adaptive systems; normative implications; ontology; social-ecological systems; typology of systemic features and dynamics

Complexity Live – Complexity Labs and the Human current live stream, Friday 11 January 6pm GMT – VUCA – on YouTube

This friday 6 pm GMT will be our 6th Live Streaming show with the HumanCurrent on the topic of VUCA, guests include: Deon Cloete – Len Fisher – Diego Espinosa – Benjamin Taylor –

 

The origins and purposes of several traditions in systems theory and cybernetics – Umpleby and Dent, February 1999

…and the companion paper

 

Source: The origins and purposes of several traditions in systems theory and cybernetics

Download pdf: http://www.acasa.upenn.edu/Ump_Final.pdf
Abstract
The story of systems theory and cybernetics is a story of several research traditions all of which originated in the mid 20th century. Systems ideas emerged in a variety of locations and for different reasons. As a result the ideas were developed in relative isolation and emerged with different emphases. This paper discusses the books and people, conferences and institutes, and politics and technology that have influenced the systems movement. The schools of thought presented are general systems theory, the systems approach, operations research, system dynamics, learning organizations, total quality management, and cybernetics. Three points-of-view within cybernetics are discussed. Total quality management is a new addition to the list, but we feel it is appropriate because of its extensive use of systems ideas. This paper does not address artificial intelligence, complexity theory, family therapy, or other traditions which might have been included.

Underlying assumptions of several traditions in systems theory and cybernetics – Eric B Dent and Stuart Umpleby, January 1998

What a wonderful little paper.

The six elements are:

  1. Observation
  2. Causality
  3. Reflexivity
  4. Self-organization
  5. Indeterminism
  6. Relationships
  7. Environment

The ‘six schools or traditions within systems science’ are:

  1. cybernetics
  2. operations research
  3. general systems theory
  4. system dynamics
  5. total quality management
  6. organizational learning.

Source: Underlying assumptions of several traditions in systems theory and cybernetics

PDF: Download

 

Abstract
How is the field of systems science different from other scientific fields, and how can we distinguish the various traditions within systems science? We propose that there is a set of underlying assumptions which are generally shared within systems science but are less common in other scientific fields. Furthermore, the various traditions within systems science have adopted different combinations of these assumptions. We examine six traditions within systems science –cybernetics, operations research, general systems theory, system dynamics, total quality management, and organizational learning. We then consider eight underlying assumptions –observation, causality, reflexivity, self-organization, determinism, environment, relationships, and holism. We then assess where each tradition stands with respect to each of the underlying assumptions.

 

 

COMMENT: The theory that will take artificial intelligence to the trading floor (cybernetics) – Paul Bilokon

 

Source: COMMENT: The theory that will take artificial intelligence to the trading floor | eFinancialCareers

 

COMMENT: The theory that will take artificial intelligence to the trading floor

AI in trading

If you want to make money in finance, you are probably pursuing ‘alpha.’ But alpha generation is not easy: it requires time series forecasting. It also requires that your (hopefully good) forecasts are turned into profits – and this is where things can get complicated.

When you work on the buy-side in finance, you can realize alpha either by placing orders and trading (aggressing) or by slightly modifying – skewing – the prices that you are quoting to others (known as passive risk management, as opposed to aggressive trading). In each case you leak some information about your forecast to the market – and therefore interact with the very object that you are trying to predict.

This interaction will be key to the application of machine learning in finance. Will the intereraction have no effect? Will it help realise your “prophecy” (in which case it is a self-fulfilling prophecy)?  Or will it thwart it (in which case it is a self-defeating prophecy, both terms having been coined by Robert K. Merton, the father of Robert C. Merton of the Black-Scholes-Merton fame)?

Cybernetic systems and the trading floor 

Trading strategies are prime examples of cybernetic systems. Norbert Wiener introduced cybernetics in 1948 as “the scientific study of control and communication in the animal and the machine”. The word originates from the Greek kubernetes, “steersman” via the 1830s French term cybernétique, “the art of governing”.

Wiener understood the importance of message-driven systems. In The Human Use of Human Beings he wrote: “Messages are themselves a form of pattern and organization. Indeed, it is possible to treat sets of messages as having an entropy like sets of states of the external world. Just as entropy is a measure of disorganization, the information carried by a set of messages is a message of organization… It is possible to interpret the information carried by a message as essentially the negative of its entropy, and the negative logarithm of its probability. That is, the more probable the message, the less information it gives. Clichés, for example, are less illuminating than great poems.”

In cybernetics we are considering the inputs and outputs of a particular system over time, possibly in the presence of feedbacks, which can be positive or negative. We are using the inputs to predict – and hopefully control – the outputs. Cyberneticians postulate: what you can measure, you can (sometimes) forecast; what you can forecast, you can (sometimes) manage; and what you can manage, you can (sometimes) prevent.

In cybernetic systems traders are trying to realise gains and avoid losses in markets where the input time series is used to forecast an output time series in the presence of feed back.

Why applying AI on the trading floor isn’t easy

It’s not easy to generate alpha as a trader – financial time series are notoriously difficult to deal with. They are non-stationary (their statistical properties change over time), non-Gaussian (often skewed and exhibiting fat tails, making extreme events far more likely than they normally would be), influenced by animal spirits (which Keynes defined as “a spontaneous urge to action rather than inaction” – a property of the human soul), driven by unobservables (or latent variables, such as volatility), affected by human errors (including fat-finger errors), complex and interrelated, often multivariate and high-frequency (consisting of numerous intraday observations arriving at irregular time intervals).

Most of the successes in artificial intelligence (AI) so far have been achieved with images and natural languages. However, financial time series are far more challenging, and so applying AI in finance can be struggle.

Cybernetics suffered from the same issues as AI in the 1970s, 1980s, and 1990s. It was explored first and foremost by academics, rather than by engineers or entrepreneurs. It never became a technology, which Stephen Boyd defines at something that “can be reliably used by many people who do not know, and do not need to know, the details.” The computing power accessible in Wiener’s time was insufficient; the MIT Autocorrelator used by Wiener, Jerome B. Wiesner, and Yuk W. Lee was way off the modern Moore’s Law charts. It didn’t help that the mathematical technique for replicating the system – stochastic analysis – is complex and labour-intensive, and better-suited to parsimonious models with few parameters. There was no straightforward way to represent a system with anything but the most trivial feedback loops in software.

The technology available to us today is far more powerful. Message-driven processing, event-driven architectures (EDA), let alone reactive programming, were unheard of in Wiener’s times. Today’s technologies mean we can move on from mere cybernetics to neocybernetics. We can turn cybernetics into a technology by using it to create user-friendly processes, algorithms, software libraries and end-user products. We can use high-performance computing (HPC) technology, including cloud computing and potentially, going forward, quantum computing. We can complement stochastic analysis with the simpler mathematical language of deep learning and deep reinforcement learning, which rely on simpler probabilistic ideas to express uncertainty. We can use novel software engineering methodologies, such as the modified Functional Reactive Programming (FRP) incorporating transactions and making a clear expression of feedbacks possible.

We now have the new mathematics that makes neocybernetics accessible; programming languages, such as Python, that simplify the process of data science; numerous libraries for dealing with time series data, such as NumPy, SciPy, Scikit-Learn, Matplotlib, and Pandas; FRP libraries, such as ReactiveX and Sodium; special-purpose databases, such as kdb+/q, suitable for capturing, storing and processing vast amounts of data in real-time; and, using TensorFlow and Keras, more or less any data scientist can calibrate a fairly sophisticated neural net.

Kolmogorov and Wiener both recognised that cybernetics would lead to a different view of human beings and a different appreciation of human life – a new anthropology. Something that Master Yoda summarised as “Luminous beings are we, not this crude matter”. Wiener stated, in The Human Use of Human Beings, that the goal of cybernetics is the age-old struggle of humanity against entropy: “In control and communication we are always fighting nature’s tendency to degrade the organized and to destroy the meaningful; the tendency, as Gibbs has shown us, for entropy to increase.”

It turns out that alpha-generating traders are very well positioned to help out in this quest.

Paul Bilokon is a founder of The Thalesians. The Thalesians are an Artificial Intelligence (AI) company specialising in neocybernetics, digitaleconomy, quantitative finance, education, and consulting. The are experts in (and run courses in)  the application of Machine Learning (ML) techniques to time series data, particularly Big Data and high-frequency data. Our areas of expertise also include the mathematics of ML, Deep Learning (DL), Python, and kdb+/q. A former quant and algorithmic trader at Deutsche Bank, Citi and Nomura, Paul also lectures part time at Imperial College London.

Have a confidential story, tip, or comment you’d like to share? Contact: sbutcher@efinancialcareers.com in the first instance. Whatsapp/Signal/Telegram also available.

s
search
c
compose new post
r
reply
e
edit
t
go to top
j
go to the next post or comment
k
go to the previous post or comment
o
toggle comment visibility
esc
cancel edit post or comment