Modeling Life As Cognitive Info-Computation
Modeling Life As Cognitive Info-Computation
Modeling Life As Cognitive Info-Computation
Gordana Dodig-Crnkovic
1 Introduction
It is a remarkable fact that even after half a century of research in cognitive science,
cognition still lacks a commonly accepted definition [1]. E.g. Neissers description of
cognition as “all the processes by which sensory input is transformed, reduced, elabo-
rated, stored, recovered and used” [2] is so broad that it includes present day robots. On
the other hand, the Oxford dictionary definition: “the mental action or process of ac-
quiring knowledge and understanding through thought, experience, and the senses” ap-
plies only to humans. Currently the field of cognitive robotics is being developed where
we can learn by construction what cognition might be and then, returning to cognitive
systems in nature find out what solutions nature has evolved. The process of two-way
learning [3] starts from nature by reverse engineering existing cognitive agents, while
simultaneously trying to design cognitive computational artifacts. We have a lot to learn
from natural systems about how to engineer cognitive computers. [4]
Until recently only humans were commonly accepted as cognitive agents (anthro-
pogenic approach in Lyon). Some were ready to ascribe certain cognitive capacities to
all apes, and some perhaps to all mammals. The lowest level cognition for those with
the broadest view of cognition included all organisms with nervous system. Only a few
were prepared to go below that level. Among those very few, the first who were ready to
acknowledge a cognitive agency of organisms without nervous system were Maturana
and Varela [5][6], who argued that cognition and life are identical processes. Lyons
classification, besides describing the anthropogenic approach, includes a biogenic ap-
proach based on self-organizing complex systems and autopoiesis. The adoption in the
present paper of the biogenic approach through the definition of Maturana and Varela is
motivated by the wish to provide a theory that includes all living organisms and artificial
cognitive agents within the same framework.
2 The Computing Nature, Computational Naturalism and
Minimal Cognition
Naturalism is the view that nature is the only reality. It describes nature through its
structures, processes and relationships using a scientific approach. Naturalism studies
the evolution of the entire natural world, including the life and development of humanity
as a part of nature. Computational naturalism (pancomputationalism, naturalist compu-
tationalism) is the view that the nature is a huge network of computational processes
which, according to physical laws, computes (dynamically develops) its own next state
from the current one. Representatives of this approach are Zuse, Fredkin, Wolfram,
Chaitin and Lloyd, who proposed different varieties of computational naturalism. Ac-
cording to the idea of computing nature, one can view the time development (dynamics)
of physical states in nature as information processing (natural computation). Such pro-
cesses include self-assembly, self-organization, developmental processes, gene regula-
tion networks, gene assembly, protein-protein interaction networks, biological transport
networks, social computing, evolution and similar processes of morphogenesis (cre-
ation of form). The idea of computing nature and the relationships between two basic
concepts of information and computation are explored in [7] and [8].
In computing nature, cognition should be studied as a natural process. If we adopt
the biogenetic approach to cognition, the important question is what is the minimal cog-
nition? Recently, a number of empirical studies have revealed an unexpected richness
of cognitive behaviors (perception, information processing, memory, decision making)
in organisms as simple as bacteria. Single bacteria are too small to be able to sense any-
thing but their immediate environment, and they live too briefly to be able to memorize
a significant amount of data. On the other hand bacterial colonies, swarms and films
exhibit an unanticipated complexity of behaviors that can undoubtedly be characterized
as biogenic cognition, [9][10][11][12][13][14].
Apart from bacteria and similar organisms without nervous system (such as e.g.
slime mold, multinucleate or multicellular Amoebozoa, which recently has been used
to compute shortest paths), even plants are typically thought of as living systems without
cognitive capacities. However, plants too have been found to possess memory (in their
bodily structures that change as a result of past events), the ability to learn (plasticity,
ability to adapt through morphodynamics), and the capacity to anticipate and direct their
behavior accordingly. Plants are argued to possess rudimentary forms of knowledge,
according to [15] p. 121, [16] p. 7 and [17] p. 61.
In this article we focus on primitive cognition as the totality of processes of self-
generation, self-regulation and self-maintenance that enables organisms to survive us-
ing information from the environment. The understanding of cognition as it appears in
degrees of complexity can help us better understand the step between inanimate and
animate matter from the first autocatalytic chemical reactions to the first autopoietic
proto-cells.
Combining the Bateson and Hewitt insights, at the basic level, information is a
difference in one physical system that makes a difference in another physical system.
When discussing cognition as a bioinformatic process of special interest, there is
the notion of agent, i.e. a system able to act on its own behalf [26]. Agency has been
explored in biological systems by [30] [31] [32]. The world as it appears to an agent
depends on the type of interaction through which the agent acquires information, [33].
Agents communicate by exchanging messages (information) that help them coordinate
their actions based on the (partial) information they possess (a form of social cognition).
“The model of learning they follow, known as the probably approximately cor-
rect model, provides a quantitative framework in which designers can evaluate
the expertise achieved and the cost of achieving it. These ecorithms are not
merely a feature of computers. I argue in this book that such learning mech-
anisms impose and determine the character of life on Earth. The course of
evolution is shaped entirely by organisms interacting with and adapting to their
environments.” [46] p. 8
A different approach to evolution is taken by Chaitin, who argues for Darwins the-
ory from the perspective of gene-centric metabiology [47]. The interesting basic idea
that life is software (executable algorithms) run by physics is applied in the search for
biological creativity (in the form of increased fitness). Darwins idea of common descent
and the evolution of organisms on earth is strongly supported by computational models
of self-organization through information processing i.e. morphological computing.
The cognitive capacity of living systems depends on the specific morphology of
organisms that enables perception, memory, information processing and agency. As ar-
gued in [48], morphology is the central idea connecting computation and information.
The process of mutual evolutionary shaping between an organism and its environment
is a result of information self-organization. Here, both the physical environment and the
physical body of an agent can be described by their informational structure that con-
sists of data as atoms of information. Intrinsic computational processes, which drive
changes in informational structures, result from the operation of physical laws. The en-
vironment provides an organism with a variety of inputs in the form of both information
and matter-energy, where the difference between information and matter-energy is not
in the kind, but in the use the organism makes of it. As there is no information without
representation [49], all information is carried by some physical carrier (light, sound,
radio-waves, chemical molecules, etc.). The same physical object can be used by an
organism as a source of information and as a source of nourishment/matter/energy. In
general, the simpler the organism, the simpler the information structures of its body,
the simpler the information carriers it relies on, and the simpler its interactions with the
environment.
5 Cellular Computation
The environment is a resource, but at the same time it also imposes constraints that
limit an agents space of possibilities. In an agent that can be described as a complex
informational structure, constraints imposed by the environment drive the time develop-
ment (computation) of its structures to specific trajectories. This relationship between
an agent and its environment is called structural coupling by [5]. Experiments with
bacteria performed by Ben-Jacob and Bassler show that bacteria interact with the envi-
ronment, sense it, and extract its latent/potential information. This information triggers
cognitive processes (“according to internally stored information”) that result in changes
of their structure, function and behavior. Moreover, Ben-Jacob explains how informa-
tion can be seen as inducing “an internal condensed description (model of usable infor-
mation)” of the environment, which directs its behavior and function. This is a process
of intracellular computation, which proceeds via “gene computation circuits or gene
logical elements”, that is gene circuits or regulatory pathways. As bacteria multiply by
cell division, complex colony forms.
Every single bacterium is an autonomous system with internal information manage-
ment capabilities: interpretation, processing and storage of information. Ben-Jacob has
found that complex forms emerge as a result of the communication between bacteria
as interplay of the micro-level vs. macro-level (single organism vs. colony). Chemical
sign-processes used by bacteria for signaling present a rudimentary form of language.
Waters and Bassler [14] describe the process of “quorum-sensing and communication
between bacteria that use two kinds of languages – intra-species and inter-species chem-
ical signalling. That is how they are capable of building films consisting of a variety of
species.
Experiments show that the colony as a whole “behaves much like a multi-cellular or-
ganism” governed by the distributed information processing with message broadcasting
that stimulates changes in individual bacteria (plasticity). Communication, cooperation
and self-organization within a swarm/colony enable decision-making at the group level
as a form of social cognition.
A bacteria colony changes its morphology and organization through natural dis-
tributed information processing and thus learns from experience (such as encounters
with antibiotics). Ben-Jacob concludes that they “ possibly alter the genome organi-
zation or even create new genes to better cope with novel challenges.” All those pro-
cesses can be modelled as distributed concurrent computation in networks of networks
of programs, where individual bacteria form networks and bacteria themselves can be
modelled as networks of programs (processes or executing algorithms).
Empirical studies of the cognitive abilities of bacteria swarms, colonies and films
confirm the result of [50], proving a theorem that natural selection will always lead a
population to accumulate information, and so to ’learn’ about its environment. Okasha
points out that
The role of cognition for a living agent, from bacteria to humans is to efficiently deal
with the complexity of the world, helping an agent to survive and thrive. The world is
inexhaustible and largely complex and exceeds by all accounts what a cognizing agent
can take in. Cognition is then the mechanism that enables cognizing agents to control
their own behavior in order to deal with the complexity of the environment, make sense
of the world and use it as a resource for survival, [52] p. 234. In this view, “ cognition ‘
shades off’ into basic biological processes such as metabolism.”
Through autopoietic processes with structural coupling (interactions with the envi-
ronment) a biological system changes its structures and thereby the information pro-
cessing patterns in a self-reflective, recursive manner [5]. But self-organisation with
natural selection of organisms, responsible for nearly all information that living sys-
tems have built up in their genotypes and phenotypes, is a simple but costly method to
develop. Higher organisms (which are more expensive to evolve in terms of resources)
have developed language and reasoning as a more efficient way of learning. The step
from genetic learning (typical of more primitive forms of life) to the acquisition of cog-
nitive skills on higher levels of organisation of the nervous system (such as found in
vertebrata) will be the next step to explore in the project of cognitive info-computation,
following [53] who distinguish genetic, epigenetic, behavioral, and symbolic evolution.
The studies of bacterial cognition suggest that there are some important processes that
operate during evolution such as self-organization and auto-poiesis, which guarantee
growth of order, and the propagation of structures in spite of the randomness of envi-
ronmental influences. Also, colonies, swarms and films seem to play a prominent role
in bacterial evolution (as swarm intelligence).
Interesting question arises in connection to AI and AL which are not based on
chemical processes: is molecular computation necessary for cognition? For example
[9] proposed that minimal cognition can be identified with sensorimotor coordination.
However, even though fundamental, sensorimotor coordination is not enough to explain
cognition in biological systems. Chemical processes of autopoiesis based on molecu-
lar computation (information processing) are essential, not only for simple organisms
like bacteria, but also for the functioning of the human nervous system. In the words of
Shapiro:
References
1. Lyon, P.: The biogenic approach to cognition. Cognitive Processing 7 (2005) 11–29
2. Neisser, U.: Cognitive psychology. Appleton-Century Crofts (1967)
3. Rozenberg, G., Kari, L.: The many facets of natural computing. Communications of the
ACM 51 (2008) 72–83
4. Modha, D.S., Ananthanarayanan, R., Esser, S.K., Ndirango, A., Sherbondy, A.J., Singh, R.:
Cognitive computing. Communications of the ACM 54(8) (2011) 6271
5. Maturana, H., Varela, F.: Autopoiesis and cognition: the realization of the living. D. Reidel
Pub. Co. (1980)
6. Maturana, H.: Biology of Cognition. Defense Technical Information Center (1970)
7. Dodig-Crnkovic, G., Giovagnoli, R.: Computing Nature. Springer (2013)
8. Dodig-Crnkovic, G., Burgin, M.: Information and Computation. World Scientific Pub Co
Inc (2011)
9. Duijn, M.v., Keijzer, F., Franken, D.: Principles of minimal cognition: Casting cognition as
sensorimotor coordination. Adaptive Behavior 14 (2006) 157–170
10. Ben-Jacob, E., Shapira, Y., Tauber, A.: Seeking the foundations of cognition in bacteria.
Physica A 359 (2006) 495–524
11. Ben-Jacob, E.: Social behavior of bacteria: from physics to complex organization. The
European Physical Journal B 65(3) (2008) 315–322
12. Ben-Jacob, E.: Learning from bacteria about natural information processing. Annals of the
New York Academy of Sciences 1178 (2009) 78–90
13. Ng, W.L., Bassler, B.L.: Bacterial quorum-sensing network architectures. Annual Review
of Genetics 43 (2009) 197–222
14. Waters, C.M., Bassler, B.L.: Quorum sensing: Cell-to-cell communication in bacteria. An-
nual Review of Cell and Developmental Biology 21 (2005) 319–346
15. Pombo, O., Torres, J., Symons, J., eds.: Special Sciences and the Unity of Science. Springer
(2012)
16. Rosen, R.: Anticipatory Systems. Pergamon Press (1985)
17. Popper, K.: All Life is Problem Solving. Routledge (1999)
18. Floridi, L.: Informational realism. In Weckert, J., Al-Saggaf, Y., eds.: Selected papers from
conference on Computers and philosophy - Volume 37. Australian Computer Society, Inc.
(2003) 7–12
19. Sayre, K.M.: Cybernetics and the Philosophy of Mind. Routledge and Kegan Paul (1976)
20. Stonier, T.: Information and meaning: an evolutionary perspective. Springer (1997)
21. Zeilinger, A.: The message of the quantum. Nature 438 (Dec 2005) 743–743
22. Vedral, V.: Decoding reality: the universe as quantum information. Oxford University Press
(2010)
23. Chaitin, G.: Epistemology as information theory: From leibniz to omega. In Dodig Crnkovic,
G., ed.: Computation, Information, Cognition The Nexus and The Liminal. Cambridge
Scholars Pub. (2007) 2–17
24. Dodig-Crnkovic, G.: Dynamics of information as natural computation. Information 2(3)
(2011) 460–477
25. Dodig-Crnkovic, G.: Investigations into Information Semantics and Ethics of Computing.
Mälardalen University Press (2006)
26. Dodig-Crnkovic, G.: Information, computation, cognition. agency-based hierarchies of lev-
els. In Müller, V.C., ed.: Fundamental Issues of Artificial Intelligence (Synthese Library).
Springer (2014) forthcoming
27. Bateson, G.: Steps to an Ecology of Mind: Collected Essays in Anthropology, Psychiatry,
Evolution, and Epistemology. University Of Chicago Press (1972)
28. McGonigle, D., Mastrian, K.: Introduction to information, information science, and infor-
mation systems. In: Nursing informatics and the foundation of knowledge. Jones & Bartlett
(2012)
29. Hewitt, C.: What is commitment? physical, organizational, and social. In Noriega, P.,
Vazquez-Salceda, J., Boella, G., Boissier, O., Dign, V., eds.: Coordination, Organizations,
Institutions, and Norms in Agent Systems II. Springer-Verlag (2007) 293–307
30. Kauffman, S.: At Home in the Universe: The Search for Laws of Self-Organization and
Complexity. Oxford University Press (1995)
31. Kauffman, S.: Origins of Order: Self-Organization and Selection in Evolution. Oxford
University Press (1993)
32. Deacon, T.: Incomplete Nature. How Mind Emerged from Matter. W. W. Norton and Com-
pany (2011)
33. Dodig-Crnkovic, G., Müller, V.: A dialogue concerning two world systems: Info-
computational vs. mechanistic. In Dodig Crnkovic, G., Burgin, M., eds.: Information and
Computation. World Scientific (2011) 149–184
34. Cooper, S.B.: Turingś titanic machine? Communications of the ACM 55(3) (2012) 74–83
35. Dodig-Crnkovic, G.: Significance of models of computation from turing model to natural
computation. Minds and Machines, 21(2) (2011) 301–322
36. Hewitt, C.: What is computation? actor model versus turingś model. In Zenil, H., ed.: A
Computable Universe, Understanding Computation and Exploring Nature As Computation.
World Scientific Publishing Company/Imperial College Press (2012)
37. Abramsky, S.: Information, processes and games. In Benthem van, J., Adriaans, P., eds.:
Philosophy of Information. North Holland (2008) 483–549
38. Goertzel, B.: Chaotic Logic. Language, Thought, and Reality from the Perspective of Com-
plex Systems Science. Plenum Press (1994)
39. Kampis, G.: Self-modifying systems in biology and cognitive science: a new framework for
dynamics, information, and complexity. Pergamon Press (1991)
40. Rozenberg, G., BŁck, T., Kok, J., eds.: Handbook of Natural Computing. Springer (2012)
41. MacLennan, B.: Natural computation and non-turing models of computation. Theoretical
computer science 317(1) (2004) 115145
42. Nunes de Castro, L.: Fundamentals of natural computing: An overview. Physics of Life
Reviews 4 (2007) 136
43. Cardelli, L.: Artificial biochemistry. In Condon, A., Harel, D., Kok, J., Salomaa, A., Winfree,
E., eds.: Algorithmic Bioprocesses. Springer (2009) 429–462
44. Burgin, M.: Super-Recursive Algorithms. Springer-Verlag New York Inc. (2005)
45. Wegner, P.: Interactive foundations of computing. Theoretical computer science. 192(2)
(1998) 315351
46. Valiant, L.: Probably Approximately Correct: Natures Algorithms for Learning and Prosper-
ing in a Complex World. Basic Books (2013)
47. Chaitin, G.: Life as evolving software. In Zenil, H., ed.: A Computable Universe, Under-
standing Computation and Exploring Nature As Computation. World Scientific (2012)
48. Dodig-Crnkovic, G.: The info-computational nature of morphological computing. In Müller,
V.C., ed.: Theory and Philosophy of Artificial Intelligence. Springer (2012) 59–68
49. Landauer, R.: Information is physical. Physics Today 44 (1991) 23–29
50. Harms, W.F.: Naturalizing epistemology: Prospectus 2006. Biological Theory 1 (2006)
23–24
51. Okasha, S.: Review of william f. harms, information and meaning in evolutionary processes.
Notre Dame Philosophical Reviews 12 (2005)
52. Godfrey-Smith, P.: Environmental complexity and the evolution of cognition. In Sternberg,
R., Kaufman, J., eds.: The evolution of intelligence. Lawrence Elrbaum Associates (2001)
233–249
53. Jablonka, E., Lamb, M.: Evolution in Four Dimensions: Genetic, Epigenetic, Behavioral,
and Symbolic Variation in the History of Life. MIT Press (2005)
54. Shapiro, J.A.: Evolution: A View from the 21st Century. FT Press Science (2011)
55. Bechtel, W.: Representations and cognitive explanations: Assessing the dynamicists chal-
lenge in cognitive science. Cognitive Science 22(3) (1998) 295–318
56. Wolfram, S.: A New Kind of Science. Wolfram Media (2002)