intelligence

Living on the edge of chaos; implications for autism and psychosis

SMI32-stained pyramidal neurons in cerebral co...Image via Wikipedia

I serendipitously came cross this article today about how our brains are self-organized criticality or systems living on the edge of chaos. There are many interesting ideas and gold nuggets in that article, and I’ll briefly quote from it.

In reality, your brain operates on the edge of chaos. Though much of the time it runs in an orderly and stable way, every now and again it suddenly and unpredictably lurches into a blizzard of noise.

Neuroscientists have long suspected as much. Only recently, however, have they come up with proof that brains work this way. Now they are trying to work out why. Some believe that near-chaotic states may be crucial to memory, and could explain why some people are smarter than others.

In technical terms, systems on the edge of chaos are said to be in a state of “self-organised criticality”. These systems are right on the boundary between stable, orderly behaviour – such as a swinging pendulum – and the unpredictable world of chaos, as exemplified by turbulence.

The quintessential example of self-organised criticality is a growing sand pile. As grains build up, the pile grows in a predictable way until, suddenly and without warning, it hits a critical point and collapses. These “sand avalanches” occur spontaneously and are almost impossible to predict, so the system is said to be both critical and self-organising. Earthquakes, avalanches and wildfires are also thought to behave like this, with periods of stability followed by catastrophic periods of instability that rearrange the system into a new, temporarily stable state.

Self-organised criticality has another defining feature: even though individual sand avalanches are impossible to predict, their overall distribution is regular. The avalanches are “scale invariant”, which means that avalanches of all possible sizes occur. They also follow a “power law” distribution, which means bigger avalanches happen less often than smaller avalanches, according to a strict mathematical ratio. Earthquakes offer the best real-world example. Quakes of magnitude 5.0 on the Richter scale happen 10 times as often as quakes of magnitude 6.0, and 100 times as often as quakes of magnitude 7.0.

These are purely physical systems, but the brain has much in common with them. Networks of brain cells alternate between periods of calm and periods of instability – “avalanches” of electrical activity that cascade through the neurons. Like real avalanches, exactly how these cascades occur and the resulting state of the brain are unpredictable.

Two of the power laws that are found in human brains relate to the phase shift and phase lock periods of EEG/fMRI or human brain systems etc. As per this PLOS comp biology paper:

Self-organized criticality is an attractive model for human brain dynamics, but there has been little direct evidence for its existence in large-scale systems measured by neuroimaging. In general, critical systems are associated with fractal or power law scaling, long-range correlations in space and time, and rapid reconfiguration in response to external inputs. Here, we consider two measures of phase synchronization: the phase-lock interval, or duration of coupling between a pair of (neurophysiological) processes, and the lability of global synchronization of a (brain functional) network. Using computational simulations of two mechanistically distinct systems displaying complex dynamics, the Ising model and the Kuramoto model, we show that both synchronization metrics have power law probability distributions specifically when these systems are in a critical state. We then demonstrate power law scaling of both pairwise and global synchronization metrics in functional MRI and magnetoencephalographic data recorded from normal volunteers under resting conditions. These results strongly suggest that human brain functional systems exist in an endogenous state of dynamical criticality, characterized by a greater than random probability of both prolonged periods of phase-locking and occurrence of large rapid changes in the state of global synchronization, analogous to the neuronal “avalanches” previously described in cellular systems. Moreover, evidence for critical dynamics was identified consistently in neurophysiological systems operating at frequency intervals ranging from 0.05–0.11 to 62.5–125 Hz, confirming that criticality is a property of human brain functional network organization at all frequency intervals in the brain’s physiological bandwidth.

Further, as per research by Thatcher et al, the EEG phase shift is larger in people with high IQ, while phase lock is smaller in the people with high IQ.

Phase shift duration (40–90 ms) was positively related to intelligence (P < .00001) and the phase lock duration (100–800 ms) was negatively related to intelligence (P < .00001). Phase reset in short interelectrode distances (6 cm) was more highly correlated to I.Q. (P < .0001) than in long distances (> 12 cm).

Further, in this paper , thatcher eta look at autistics and conclude that the people with autism show some deficits in phase shift and phase lock.

Results: In both short (6 cm) and long (21 – 24 cm) inter-electrode distances phase shift duration in ASD subjects was significantly shorter in all frequency bands but especially in the alpha-1 frequency band (8 – 10 Hz) (P < .0001). Phase lock duration was significantly longer in the alpha-2 frequencyband (10 – 12 Hz) in ASD subjects (P < .0001). An anatomical gradient was present with the occipitalparietal regions the most significant.
Conclusions: The findings in this study support the hypothesis that neural resource recruitment occurs in the lower frequency bands and especially the alpha-1 frequency band while neural resource allocation occurs in the alpha-2 frequency band. The results are consistent with a general GABA inhibitory neurotransmitter deficiency resulting in reduced number and/or strength of thalamo-cortical connections in autistic subjects 

It is interesting that in the original new scientist article , thatcher speculates that the pattern in schizophrenia may be reverse of what is seen in autism (exactly my thoughts, though the confounding of low IQ with autism may explain his autism results to an extent):

He found that the length of time the children’s brains spent in both the stable phase-locked states and the unstable phase-shifting states correlated with their IQ scores. For example, phase shifts typically last 55 milliseconds, but an additional 1 millisecond seemed to add as many as 20 points to the child’s IQ. A shorter time in the stable phase-locked state also corresponded with greater intelligence – with a difference of 1 millisecond adding 4.6 IQ points to a child’s score (NeuroImage, vol 42, p 1639). Thatcher says this is because a longer phase shift allows the brain to recruit many more neurons for the problem at hand. “It’s like casting a net and capturing as many neurons as possible at any one time,” he says. The result is a greater overall processing power that contributes to higher intelligence. Hovering on the edge of chaos provides brains with their amazing capacity to process information and rapidly adapt to our ever-changing environment, but what happens if we stray either side of the boundary? The most obvious assumption would be that all of us are a short step away from mental illness. Meyer-Lindenberg suggests that schizophrenia may be caused by parts of the brain straying away from the critical point. However, for now that is purely speculative. Thatcher, meanwhile, has found that certain regions in the brains of people with autism spend less time than average in the unstable, phase-shifting states. These abnormalities reduce the capacity to process information and, suggestively, are found only in the regions associated with social behaviour. “These regions have shifted from chaos to more stable activity,” he says. The work might also help us understand epilepsy better: in an epileptic fit, the brain has a tendency to suddenly fire synchronously, and deviation from the critical point could explain this. “They say it’s a fine line between genius and madness,” says Liley. “Maybe we’re finally beginning to understand the wisdom of this statement.”

Thus, it seems Autism and Psychosis are just two ways in which self-organized criticality can cease to do what it was designed to do- live on the edge , without falling on either side of order or chaos.

Reblog this post [with Zemanta]

Major conscious and unconcoscious processes in the brain: part 3: Robot minds

This article continues my series on major conscious and unconscious processes in the brain. In my last two posts I have talked about 8 major unconscious processes in the brain viz sensory, motor, learning , affective, cognitive (deliberative), modelling, communications and attentive systems. Today, I will not talk about brain in particular, but will approach the problem from a slightly different problem domain- that of modelling/implementing an artificial brain/ mind.

I am a computer scientist, so am vaguely aware of the varied approaches used to model/implement the brain. Many of these use computers , though not every approach assumes that the brain is a computer.

Before continuing I would briefly like to digress and link to one of my earlier posts regarding the different  traditions of psychological research in personality and how I think they fit an evolutionary stage model . That may serve as a background to the type of sweeping analysis and genralisation that I am going to do. To be fair it is also important to recall an Indian parable of how when asked to describe an elephant by a few blind man each described what he could lay his hands on and thus provided a partial and incorrect picture of the elephant. Some one who grabbed the tail, described it as snake-like and so forth.

With that in mind let us look at the major approaches to modelling/mplementing the brain/intelligence/mind. Also remember that I am most interested in unconscious brain processes till now and sincerely believe that all the unconscious processes can, and will be successfully implemented in machines.   I do not believe machines will become sentient (at least any time soon), but that question is for another day.

So, with due thanks to @wildcat2030, I came across this book today and could immediately see how the different major approaches to artificial robot brains are heavily influenced (and follow) the evolutionary first five stages and the first five unconscious processes in the brain.
The book in question is ‘Robot Brains: Circuits and Systems for Conscious Machines’ by Pentti O. Haikonen and although he is most interested in conscious machines I will restrict myself to intelligent but unconscious machines/robots.

The first chapter of the book (which has made to my reading list) is available at Wiley site in its entirety and I quote extensively from there:

Presently there are five main approaches to the modelling of cognition that could be used for the development of cognitive machines: the computational approach (artificial intelligence, AI), the artificial neural networks approach, the dynamical systems approach, the quantum approach and the cognitive approach. Neurobiological approaches exist, but these may be better suited for the eventual explanation of the workings of the biological brain.

The computational approach (also known as artificial intelligence, AI) towards thinking machines was initially worded by Turing (1950). A machine would be thinking if the results of the computation were indistinguishable from the results of human thinking. Later on Newell and Simon (1976) presented their Physical Symbol System Hypothesis, which maintained that general intelligent action can be achieved by a physical symbol system and that this system has all the necessary and sufficient means for this purpose. A physical symbol system was here the computer that operates with symbols (binary words) and attached rules that stipulate which symbols are to follow others. Newell and Simon believed that the computer would be able to reproduce human-like general intelligence, a feat that still remains to be seen. However, they realized that this hypothesis was only an empirical generalization and not a theorem that could be formally proven. Very little in the way of empirical proof for this hypothesis exists even today and in the 1970s the situation was not better. Therefore Newell and Simon pretended to see other kinds of proof that were in those days readily available. They proposed that the principal body of evidence for the symbol system hypothesis was negative evidence, namely the absence of specific competing hypotheses; how else could intelligent activity be accomplished by man or machine? However, the absence of evidence is by no means any evidence of absence. This kind of ‘proof by ignorance’ is too often available in large quantities, yet it is not a logically valid argument. Nevertheless, this issue has not yet been formally settled in one way or another. Today’s positive evidence is that it is possible to create world-class chess-playing programs and these can be called ‘artificial intelligence’. The negative evidence is that it appears to be next to impossible to create real general intelligence via preprogrammed commands and computations.

The original computational approach can be criticized for the lack of a cognitive foundation. Some recent approaches have tried to remedy this and consider systems that integrate the processes of perception, reaction, deliberation and reasoning (Franklin, 1995, 2003; Sloman, 2000). There is another argument against the computational view of the brain. It is known that the human brain is slow, yet it is possible to learn to play tennis and other activities that require instant responses. Computations take time. Tennis playing and the like would call for the fastest computers in existence. How could the slow brain manage this if it were to execute computations?

The artificial neural networks approach, also known as connectionism, had its beginnings in the early 1940s when McCulloch and Pitts (1943) proposed that the brain cells, neurons, could be modelled by a simple electronic circuit. This circuit would receive a number of signals, multiply their intensities by the so-called synaptic weight values and sum these modified values together. The circuit would give an output signal if the sum value exceeded a given threshold. It was realized that these artificial neurons could learn and execute basic logic operations if their synaptic weight values were adjusted properly. If these artificial neurons were realized as hardware circuits then no programs would be necessary and biologically plausible artificial replicas of the brain might be possible. Also, neural networks operate in parallel, doing many things simultaneously. Thus the overall operational speed could be fast even if the individual neurons were slow. However, problems with artificial neural learning led to complicated statistical learning algorithms, ones that could best be implemented as computer programs. Many of today’s artificial neural networks are statistical pattern recognition and classification circuits. Therefore they are rather removed from their original biologically inspired idea. Cognition is not mere classification and the human brain is hardly a computer that executes complicated synaptic weight-adjusting algorithms.

The human brain has some 10 to the power of 11 neurons and each neuron may have tens of thousands of synaptic inputs and input weights. Many artificial neural networks learn by tweaking the synaptic weight values against each other when thousands of training examples are presented. Where in the brain would reside the computing process that would execute synaptic weight adjusting algorithms? Where would these algorithms have come from? The evolutionary feasibility of these kinds of algorithms can be seriously doubted. Complicated algorithms do not evolve via trial and error either. Moreover, humans are able to learn with a few examples only, instead of having training sessions with thousands or hundreds of thousands of examples. It is obvious that the mainstream neural networks approach is not a very plausible candidate for machine cognition although the human brain is a neural network.

Dynamical systems were proposed as a model for cognition by Ashby (1952) already in the 1950s and have been developed further by contemporary researchers (for example Thelen and Smith, 1994; Gelder, 1998, 1999; Port, 2000; Wallace, 2005). According to this approach the brain is considered as a complex system with dynamical interactions with its environment. Gelder and Port (1995) define a dynamical system as a set of quantitative variables, which change simultaneously and interdependently over quantitative time in accordance with some set of equations. Obviously the brain is indeed a large system of neuron activity variables that change over time. Accordingly the brain can be modelled as a dynamical system if the neuron activity can be quantified and if a suitable set of, say, differential equations can be formulated. The dynamical hypothesis sees the brain as comparable to analog feedback control systems with continuous parameter values. No inner representations are assumed or even accepted. However, the dynamical systems approach seems to have problems in explaining phenomena like ‘inner speech’. A would-be designer of an artificial brain would find it difficult to see what kind of system dynamics would be necessary for a specific linguistically expressed thought. The dynamical systems approach has been criticized, for instance by Eliasmith (1996, 1997), who argues that the low dimensional systems of differential equations, which must rely on collective parameters, do not model cognition easily and the dynamicists have a difficult time keeping arbitrariness from permeating their models. Eliasmith laments that there seems to be no clear ways of justifying parameter settings, choosing equations, interpreting data or creating system boundaries. Furthermore, the collective parameter models make the interpretation of the dynamic system’s behaviour difficult, as it is not easy to see or determine the meaning of any particular parameter in the model. Obviously these issues would translate into engineering problems for a designer of dynamical systems.

The quantum approach maintains that the brain is ultimately governed by quantum processes, which execute nonalgorithmic computations or act as a mediator between the brain and an assumed more-or-less immaterial ‘self’ or even ‘conscious energy field’ (for example Herbert, 1993; Hameroff, 1994; Penrose, 1989; Eccles, 1994). The quantum approach is supposed to solve problems like the apparently nonalgorithmic nature of thought, free will, the coherence of conscious experience, telepathy, telekinesis, the immortality of the soul and others. From an engineering point of view even the most practical propositions of the quantum approach are presently highly impractical in terms of actual implementation. Then there are some proposals that are hardly distinguishable from wishful fabrications of fairy tales. Here the quantum approach is not pursued.

The cognitive approach maintains that conscious machines can be built because one example already exists, namely the human brain. Therefore a cognitive machine should emulate the cognitive processes of the brain and mind, instead of merely trying to reproduce the results of the thinking processes. Accordingly the results of neurosciences and cognitive psychology should be evaluated and implemented in the design if deemed essential. However, this approach does not necessarily involve the simulation or emulation of the biological neuron as such, instead, what is to be produced is the abstracted information processing function of the neuron.

A cognitive machine would be an embodied physical entity that would interact with the environment. Cognitive robots would be obvious applications of machine cognition and there have been some early attempts towards that direction. Holland seeks to provide robots with some kind of consciousness via internal models (Holland and Goodman, 2003; Holland, 2004). Kawamura has been developing a cognitive robot with a sense of self (Kawamura, 2005; Kawamura et al., 2005). There are also others. Grand presents an experimentalist’s approach towards cognitive robots in his book (Grand, 2003).

A cognitive machine would be a complete system with processes like perception, attention, inner speech, imagination, emotions as well as pain and pleasure. Various technical approaches can be envisioned, namely indirect ones with programs, hybrid systems that combine programs and neural networks, and direct ones that are based on dedicated neural cognitive architectures. The operation of these dedicated neural cognitive architectures would combine neural, symbolic and dynamic elements.

However, the neural elements here would not be those of the traditional neural networks; no statistical learning with thousands of examples would be implied, no backpropagation or other weight-adjusting algorithms are used. Instead the networks would be associative in a way that allows the symbolic use of the neural signal arrays (vectors). The ‘symbolic’ here does not refer to the meaning-free symbol manipulation system of AI; instead it refers to the human way of using symbols with meanings. It is assumed that these cognitive machines would eventually be conscious, or at least they would reproduce most of the folk psychology hallmarks of consciousness (Haikonen, 2003a, 2005a). The engineering aspects of the direct cognitive approach are pursued in this book.

Now to me these computational approaches are all unidimensional-

  1. The computational approach is suited for symbol-manipulation and information-represntation and might give good results when used in systems that have mostly ‘sensory’ features like forming a mental represntation of external world, a chess game etc. Here something (stimuli from world) is represented as something else (an internal symbolic represntation).
  2. The Dynamical Systems approach is guided by interactions with the environment and the principles of feedback control systems and also is prone to ‘arbitrariness’ or ‘randomness’. It is perfectly suited to implement the ‘motor system‘ of brain as one of the common features is apparent unpredictability (volition) despite being deterministic (chaos theory) .
  3. The Neural networks or connectionsim is well suited for implementing the ‘learning system’ of the brain and we can very well see that the best neural network based systems are those that can categorize and classify things just like ‘the learning system’ of the brain does.
  4. The quantum approach to brain, I haven’t studied enough to comment on, but the action-tendencies of ‘affective system’ seem all too similar to the superimposed,simultaneous states that exits in a wave function before it is collapsed. Being in an affective state just means having a set of many possible related and relevant actions simultaneously activated and then perhaps one of that decided upon somehow and actualized. I’m sure that if we could ever model emotion in machine sit would have to use quantum principles of wave functions, entanglemnets etc.
  5. The cognitive approach, again I haven’t go a hang of yet, but it seems that the proposal is to build some design into the machine that is based on actual brain and mind implemntations. Embodiment seems important and so does emulating the information processing functions of neurons. I would stick my neck out and predict that whatever this cognitive approach is it should be best able to model the reasoning and evaluative and decision-making functions of the brain. I am reminded of the computational modelling methods, used to functionally decompose a cognitive process, and are used in cognitive science (whether symbolic or subsymbolic modelling) which again aid in decision making / reasoning (see wikipedia entry)

Overall, I would say there is room for further improvement in the way we build more intelligent machines. They could be made such that they have two models of world – one deterministic , another chaotic and use the two models simulatenously (sixth stage of modelling); then they could communicate with other machines and thus learn language (some simulation methods for language abilities do involve agents communicating with each other using arbitrary tokens and later a language developing) (seventh stage) and then they could be implemented such that they have a spotlight of attention (eighth stage) whereby some coherent systems are amplified and others suppressed. Of course all this is easier said than done, we will need at least three more major approaches to modelling and implementing brain/intelligence before we can model every major unconscious process in the brain. To model consciousness and program sentience is an uphill task from there and would definitely require a leap in our understandings/ capabilities.

Do tell me if you find the above reasonable and do believe that these major approaches to artificial brain implementation are guided and constrained by the major unconscious processes in the brain and that we can learn much about brain from the study of these artificial approaches and vice versa.

SES and the developing brain

I have written about poverty/SES and its effects on brain development/IQ earlier too,and this new review article by Farah and Hackman in TICS is a very good introduction to anyone interested in the issue.

The article reviews the behavioral studies that show that SES is correlated with at least the two brain systems of executive function and language abilities.It also review physiological data that shows that even when behavioral outcomes do not differ ERP can show differential activation in the brains of people with low and middle SES , thus suggesting that differences that may not be detected on behavioral measures may still exist. They also review (f)MRI data that shows no structural differences in the brains of low and middle SES children, but definite functional differences.they also review experimental manipulation of social status in labarotaories, and show how those studies also indicate that SES and executive function are correlated.

They then turn to the million dollar question of the direction of causality and for this infer indirectly based on the SES-IQ causal linkages.

What is the cause of SES differences in brain function? Is it contextual priming? Is it social causation, reflecting the influence of SES on brain development? Alternatively, is it social selection, in which abilities inherited from parents lead to lower SES? Current research on SES and brain development is not designed to answer this question. However, research on SES and IQ is relevant and supports a substantial role of SES and its correlated experience as causal factors.

Slightly less than half of the SES-related IQ variability in adopted children is attributable to the SES of the adoptive family rather than the biological. This might underestimate environmental influences because the effects of prenatal and early postnatal environment are included in the estimates of genetic influence. Additional evidence comes from studies of when poverty was experienced in a child’s life. Early poverty is a better predictor of later cognitive achievement than poverty in middle- or late-childhood, an effect that is difficult to explain by genetics. SES modifies the heritability of IQ, such that in the highest SES families, genes account for most of the variance in IQ because environmental influences are in effect at ceiling in this group, whereas in the lowest SES families, variance in IQ is overwhelmingly dominated by environmental influences because these are in effect the limiting factor in this group. In addition, a growing body of research indicates that cognitive performance is modified by epigenetic mechanisms, indicating that experience has a strong influence on gene expression and resultant phenotypic cognitive traits . Lastly, considerable evidence of brain plasticity in response to experience throughout development indicates that SES influences on brain development are plausible.

Differences in the quality and quantity of schooling is one plausible mechanism that has been proposed. However, many of the SES differences summarized in this article are present in young children with little or no experience of school , so differences in formal education cannot, on their own, account for all of the variance in cognition and brain development attributable to SES. The situation is analogous to that of SES disparities in health, which are only partly explained by differential access to medical services and for which other psychosocial mechanisms are important causal factors .

The last point is really important and can be extended. Access to health services for low SES people may be a reason why , for eg, more schizophrenia incidence is found in low SES neighbourhoods. which brings us to the same chicken-and-egg question of the drift theory of schizophrenia- whether people with schizophrenia drift into low SES or low SES is a risk factor in itself. Exactly this point was brought to my attention when I was interacting with a few budding psychiatrists recently, this Martha Farah theory about the SES leading to lower IQ/ cognitive abilities. It is important to acknowledge that low SES not only leads to left hypo-frontality (another symptom of schizophrenia), schizophrenia is supposed to be due to lessened mylienation and again nutritional factors may have a role to play; also access to health care, exposure to chronic stress and lesser subjective feelings of control may all be mediating afctors that lead low SS to lead to schizophrenia/ psychosis.Also remember that schizophrenia is sort of a devlopmenetal disorder.

Well, I digressed a bit, but the idea is that not only does low SES affect ‘normal’ cognitive abilities, it may even increase the risk for ‘abnormal’ cognitive abilities that may lead to psychosis, and his effect of SES on IQ/cognitive abilities/ risk of mental diseases is mediated by the effect of SES on the developing brain. I have already covered the putative mechanisms by which SES may affect brain development, but just to recap, here I quote from the paper:

Candidate causal pathways from environmental differences to differences in brain development include lead exposure, cognitive stimulation, nutrition, parenting styles and transient or chronic hierarchy effects. One particularly promising area for investigation is the effect of chronic stress. Lower-SES is associated with higher levels of stress in addition to changes in the function of physiological stress response systems in children and adults. Changes in such systems are likely candidates to mediate SES effects as they impact both cognitive performance and brain regions, such as the prefrontal cortex and hippocampus, in which there are SES differences.

We can only hope that the evil of low SES is recognized as soon as possible and if for nothing else, than for advancing science, some intervention studies are done that manipulate the SES variables in the right direction and thus ensure that the full cognitive potential of the children flowers.

ResearchBlogging.org

HACKMAN, D., & FARAH, M. (2009). Socioeconomic status and the developing brain Trends in Cognitive Sciences, 13 (2), 65-73 DOI: 10.1016/j.tics.2008.11.003

Get Adobe Flash playerPlugin by wpburn.com wordpress themes