Biographical SketchResearch ProjectsThe iCub Cognitive Humanoid Robotthe euCognition NetworkBooks and PapersCourses and PresentationsCycling ActivitiesBack to the Home page
Research Manifesto

Context: The Gradual Rise of Enactive Cognition
Although most of my work over the past 28 years has focussed on computer vision & AI, beginning with my Ph.D. work on robotics and robot vision, I started to study cognition and autonomous systems when I completed the Ph.D. in 1985. The work of Maturana and Varela and their the principles of autopoiesis & operational closure had a profound influence on my thinking, as did Husserl's and Heidigger's philosophy of phenomenology. Unfortunately, despite many attempts to design and build an autopoietic system, the next 20 years yielded very little by way of convincing empirical scientific results. A few papers on the underlying philosophy did get published but these never satisfied the engineer in me and they certainly didn't impress a scientific community that was still in thrall to the physical systems hypothesis of Newell and Simon and the attendant cognitivist approach to cognition and artificial intelligence. So, pragmatism prevailed (but only just) and I divided my efforts and focussed much of my energy on computer vision. This work yielded a new Fourier-based technique to effect blind image separation and segmentation.

During this twenty-five year period, however, there has been a slow but inexhorable shift in thinking in the scientific community and, in recent years, it has become clear that cognition is strongly entwined with the physical structure of the body and its interaction with the environment. Intelligence and mental processes are deeply influenced by the structure of the body, by motor abilities and especially skillful manipulation, by the elastic properties of the muscles, and the morphology of the retina and the sensory system. The physical body and its actions together play as much of a role in cognition as do neural processes, and human intelligence develops through interaction with objects in the environment and it is shaped profoundly by its interactions with other human beings.

This new view of artificial intelligence represents a fundamental shift away from the functionalism and dualism of cognitivism and classical AI towards an alternative position that re-asserts the primacy of embodiment, development, and interaction in a cognitive system. The models are principally ones that deploy dynamical systems theory, the deeper forms of connectionism, and self-organization. Most resonate strongly with the early work of Maturana and Varela. In their strongest form, they trade under the name of enactive systems.

Enactive systems are based on five central principles: embodiment, experience, emergence, autonomy, and sense-making. Enactive approaches assert that the primary model for cognitive learning is anticipative skill construction rather than knowledge acquisition and that processes that both guide action and improve the capacity to guide action while doing so are taken to be the root capacity for all intelligent systems.

Enactive approaches are intrinsically embodied and the physical instantiation plays a pivotal constitutive role in cognition. A strong consequence of this is that one cannot short-circuit the ontogenetic development because it is the agent's own experience that defines its cognitive understanding of the world in which it is embedded.

Furthermore, since cognition is dependent on the richness of the system's action interface and since the system's understanding of its world is dependent on its history of interaction, a further consequence of the enactive approach is that, if the system is to develop an understanding of the world that is compatible with humans, the system requires a morphology that that is compatible with a human.

Current Work
One of the most concrete consequences of this recent shift in thinking has been the realization that a deeply interdisciplinary research agenda in needed, embracing the neurosciences, developmental psychology, epigenetic robotics, complex systems theory, philosophy, as well as computer science. The European Commission has been in the vanguard in supporting and indeed actively promoting this new science. I am fortunate enough to be involved in two Commission funded projects: RobotCub and euCognition.

RobotCub is building a cognitive humanoid robot - the iCub - with the specific goal of creating an open-systems platform for research in enactive cognition. My specific responsibility in the project is the iCub's cognitive architecture. I am hopeful that, nearly 25 years on, we now have the tools and embryonic theories that will finally allow us to realize a true enactive cognitive system that will do justice to the pioneering thinking of Varela.

This optimism is founded not just on the work of the RobotCub consortium but on the fact that so many researchers in the Europe, the USA, and Japan are all working toward similar goals (for example, see the spectrum of interests of euCognition members and the cognitive systems projects funded by the European Commission). On the other hand, my optimism is also tempered a bit by a concern that many of those that subscribe to the enactive approach have not yet realized the full philosophical implications of the approach (see Vernon and Furlong 2007).

My Position on Cognition and Perception
There are many definitions of cognition. One view is that cognition implies the ability to anticipate possible future events when selecting actions and then assimilate what does actually happen to adapt and improve the system's behaviour, while remaining embedded in an on-going process of action and perception.

Cognition breaks through the 'here-and-now barrier', using memory to anticipate the future, learn and develop. By virtue of this development, cognition also breaks through the 'a priori knowledge' building the system's own understanding of its environment. Of course, the obvious question that arises is: How does it do this?

My personal position is that a cognitive system is an autonomous anti-entropy engine, a system that is capable of creating order locally. Specifically, cognition is the dynamic evolution of a complex non-linear re-entrant self-organizing system that decreases its entropy as it survives environmental perturbations & maintains its autonomy. Thus, there are two complementary processes going on in a cognitive system. One is the self-organization, which maintains the autonomy of the system. This is probably achieved in some sort of process of autopoiesis (or self-production, after Maturana and Varela). The other is a process of self-development, whereby the system changes its organization so as to increase its space of possible interaction and, consequently, decrease the entropy of some function of its organization and behaviour in the face of environmental perturbations (which may well include interactions with other cognitive agents). These complementary processes are captured nicely by the two circles in Maturana's and Varela's ideogram of two interacting cognitive systems show below.

Autonomy implies a self-governing self-organizing system. Hence, it is not controlled by external influences, although it may of course react and adapt to external influences. That is, external influences are perturbations, not control signals. Again, this idea is due to Maturana and Varela.

Anti-entropy implies that, over time, the system dynamics change so that there is an increase in the order of some characteristic of the system's dynamics. And, again, this idea corresponds to Maturana's and Varela's distinguishing property of a cognitive system: the ability to self-modify. So what is this characteristic? I postulate that it is the interactions of the system with its environment, including other agents also including itself. In other words, the space of possible interactions increases over time and as entropy of interaction decreases as a function of its history of interaction, i.e., the system becomes more robust to perturbations. There is no requirement that this entropy reduction (qua increase in the space of interaction) occur in a monotonic fashion. It often happens non-monotonically, e.g. such as is the case when children learn to walk and when adults learn a new skill or language; you get worse before you get better.

This entropy reduction manifests itself as (a) an ability to adapt to new perturbations or stimuli, and (b) an ability to anticipate or predict the consequences of the system's actions. It is this anticipatory capacity that facilitates the non-monotonic development: it allows the system to effect some prospective projection of what might be in order to guide it through the developmental period.

So, as noted above, cognitive systems adapt and anticipate, but they adapt to enhance and improve the anticipatory capability, and the anticipatory ability, in turn, facilitates the adaptation.

That's my position on cognition. What about perception, then? My view of perception dovetails with cognition: Perception is a system-dependent process that acts to filter and shape the morass of stimulus perturbing the system with the express purpose of facilitating the effective action of that system (i.e. maintain its autonomy through self-organization and decrease its entropy though self-development). Thus perception is dependent on the cognitive system; it is not unique mapping from a fixed external world to internal representation but instead a process of system dependent structuring. Berkeley was one of the first to articulate this view of perception in his Essay Towards a New Theory of Vision but, ultimately, this is a phenonemological view of perception and cognition (in the strict sense of Husserl's and Heidigger's philosophy). This structuring can be viewed as a sort of transform (or set of transforms), where the transform is specified by the system's own particular state of organization and development. What is peculiar to all transform techniques - Fourier, Mellin, Laplace, Hough, whatever - is that they map from one space where information is distributed and implicit to one where relevant information is localized and explicit, and therefore accessible and useful (in the sense of facilitating the system's autonomy and self-organization). How are these transforms identified? Some are certainly present in the phylogenetic configuration of the system but others arise from the ontogenetic process, that is, as a consequence of the self-development of the system. In other words, a system's perceptual processes arise from its cognition and these perceptual processes facilitate cognition. If this all sounds very circular, that's exactly what you would expect because, as many researchers such as Edelman, Bickhard, and of course Varela, have indicated over the years, cognitive processes are strongly entwined with the concepts of recursion and reentrance.

My research programme for the next X years is to validate this position empirically by writing software for the iCub, beginning with its cognitive architecture.