Back on the anti-representation train

I have the wonderful opportunity at the moment to teach methods of Ecological Psychology and Dynamic Systems Theory, their philosophical basis, theoretical concepts, how they require certain analyses, and what kinds of explanations this/these perspective/s give. I am lucky to be in a department that is (as of yet) wholly representation-dominant, yet are curious, interested, and promotes theoretical plurality. I just personally keep running into the wall of not being able to believe in representations as an ontological foundation for psychology.

Perhaps someone can convince me otherwise. Four different ways of defining representations are as follows. The ‘literal-structural’ version, which amounts to old-school phrenology, i.e., it is literally neurons/physical structures in the brain that are/store representations. I do not meet many researchers that hold this belief. Mostly, I find this belief in folk psychology, because I think it is an easily envisionable version that has surface validity through movies and tv-series that talk about brain function in this way (the British “knowledge”-panel program QI is an example of this). Second, you have a ‘literal-activational’ version, which amounts to what I would call modern phrenology, i.e., it is the electrical activity in the brain that are representations. This and the literal-structural version are sometimes unhelpfully combined. fMRI, MRI, PET and similar techniques try to get at this by measuring blood flow to different parts of the brain, although it is an indirect technique since the assumptions go 1) thoughts, feelings, reactions, cognitions, etc, are produced in the brain, 2) in the brain there is electrical activity presumed to indicate usage of a particular brain area, 3) when a brain area is used, increased blood flow is seen to the area, 4) blood flow can indicate brain-part-usage and therefore thoughts, feelings, reactions, cognitions, etc. Third, we leave the literal kinds and hop the fence to ‘symbolic-mathematical’ accounts, that representations aren’t literal parts in the brain, but a more abstract version, instantiated by mathematics. This version is often combined with the methods of the ‘literal-activational’ version, and I’ve listened to several, prominent cognition scholars that have expressed beliefs in how mathematical equations are running in/produced by the brain… somehow. And several of them, upon explaining how the math got there to begin with, used various kinds of nativism as explanations. I’ve also found network-explanations, or ‘patterns of activation across groups of neurons’ and similar, both here and in the fourth grouping. Fourth, the ‘symbolic-abstract’ version, which often amounts to more hand-waving than the third, where representations are not mathematics, they can be groups of patterned activity, sometimes explained as dynamic clouds of activation of different kinds.

I just don’t find myself believing in any of them. With the literal-structural versions, there’s actually been attempts at finding them. Or, they were called Engrams at the time, and could simply not be found. There is little wiggle room in this description, either you can show empirically that a literal neuron/structure changes when you memorize something new or change a memory, or you are more or less forced to accept that this story isn’t the best one. Which is why I think so few ascribe to it beyond non-experts (e.g. folk psychology and AI researchers, the latter of which are almost exclusively dependent on this version).

The literal-activational version is far more popular however. In part, a lot of support comes from the medical sciences, where, if you poke a brain with electricity while talking or playing an instrument, are often disrupted in their activities. Or, if you have particular cognitive issues, a neurosurgeon can often quite easily pick out where a tumor is pushing up against (if you have a tumor, which isn’t always the case). This evidence is a muddle to me, since you can also completely remove brain parts, even half the brain(!), and still maintain functioning -which seems to me to break down the validity of this narrative. It is usually explained away with brain plasticity, but if brain plasticity is true (in reference to literal-activational representations), then the reliability across time when looking at the same brain, or when looking at different brains, break down (Anderson’s book After Phrenology is an interesting read). In fact, if either of the literal accounts are true, we should have specific structures and/or patterns of activation found to be stable across time for a single person, or across people. And if this were substantiated by research and industry, where the f* are our mind-reading helmets? Often when I bring this point up in discussions, neurocognitivists retreat back to neurons and how we don’t have the technical expertise to measure individual neurons in the entire brain simultaneously to answer that question. There are a couple of practices that seem to support the view however, sending a whole bunch of electricity down the spine seems to help people with motor-function constraints to regain/less disruptive movements. Which is great. But it is a far cry from being specific in the sense that’s needed to support the theoretical position. There are also toy versions like moving cubes on a screen using EEG, and beyond taking a surprising amount of time to train, once the person leaves the room and comes back the next day, the process restarts and cannot be continued the next day. I understand this position though, I do, I can deal with living alongside it (although I am extremely frustrated by grant-decisions heavily favoring neuroscience). However, the evidence surrounding it promises a specificity, a specificness, of identifying recurring activation/al patterns, that very clearly both empiricism and practical implementation does not live up to.

We get to the symbolic version of brain activity, particularly mathematical accounts, the story about activation standing in for representations seems to me to either give up the ontological foundation of representations (hand-wavy “it’s maths” explanations), or simply add another step of assumptions to the literal-activational account. Now, not only do you have to solve the above problems, but you also have to explain why a conglomerate of biology-chemical-electrical activity would instantiate an accounting tool that humans created to begin with. A good tool, mind you, but human-created nonetheless. From this point, of course, you get all kinds of half-to-non-scientific abstractions about how everything in the world is made up of mathematics, a tall-tale version of ruthless reductionism, and you of course lose the ontology of the phenomena you are trying to explain. You’d be surprised who I have heard literally say, in very public circumstances, that babies run physics equations in their brain that they are born with. And they are given so much research funding. My personal grievances aside, we have the symbolic-abstract version, which I find the most convincing, perhaps surprisingly. In some ways it can be seen as a less specific version of the literal-activational/structural versions of representations. Often, the explanation begins from the point that larger structures in the brain are not specific specific, but rather, there may be particular patterns of activation across structures that are recruited in a kind of online fashion. The patterns can thus “move around” the brain in part-deterministic-part-stochastic ways, meaning that, if you think about a cat, you come into that time-period from a different point than if you had been asked to think about it the next day. So, a similar pattern would repeat, but, not necessarily the same neurons and not necessarily all the same structures. This account would additionally fit the empirical findings detailed in After Phrenology. It would also explain how fMRI and MRI studies find general trends (averages over both spatial structures, and averages over time -how much time of course depends on imaging technique) across people. However. If this account is true, then I will most likely never get my mind-reading helmet, because it would be near-impossible to know how a particular pattern of activation would only stand for one object, and, what that pattern would look like the next day. Of course, an objection could be that it is not objects that are represented, but everything that we are exposed to continuously at the same time (plus memories, plus …). But then it would be nigh impossible to sort out which components of input lead to what activational pattern, particularly if that pattern changes over each instance. I do have some sympathy for this position though, as it seems to me to better fit more of the empirical data, but it gives a version of representations that is practically unusable except as a theoretical description.

To sum up. The more literal narratives of representations gives promises of specificity (particularly the medically inspired accounts), but this just hasn’t materialized on the practical-functional end, and, there is plenty of contradictory empirical evidence. The symbolic-mathematical perspective seems to explain some of the contradictions due to the shift of ontological basis to mathematics, but this step seems fantastical as it requires another set of beliefs to accept an ontological reality of maths. The world isn’t maths. The world is the world. Although it can be described in detail by maths. Lastly, we have the more symbolic-abstract-network version, which seems to me to cover most of the empirical literature and dispel the contradictions of the literal account. However, this perspective seems to me to not live up to the definition of a representation to begin with, losing the ‘specificness’ of representations that at the outset make them attractive to AI-researchers. In a recent interview with a prominent Ecological Psychological researcher, they were reacted to with a “I don’t see how anything could be anything else than computation”, and I have the exact opposite view, I have a very hard time seeing how anything could really be computational (that says something of value about psychological phenomena beyond simple, mechanical, surface level generalisations).So what is the brain up to? Biology does not preserve components that are not used.

Well, finally, we have the Raja-ian version of brain-activity, but we have left the realm of representations. Where the brain and central nervous system is seen more as a tuning fork, a resonance device, than something harboring ‘the real world’ in one way or another. As a non-content explanation of the brain I have high hopes for this perspective, and perhaps it is compatible with some versions of the abstract-variational-network version of representations (which do not live up to the demands of what a representation would be in the first place). But, just as more literal proponents of representations wait for the technological solutions to their theoretical problems, I’ll have to wait out the empirical evidence and theory-building required for a fuller account of the resonance narrative.

A non-content brain. 2/2

There is some misreading of Ecological Psychology due to the way direct perception and information detection are spoken about. Direct perception seems to carry with it a connotation of specificity (guarantee), that the world is in the specific way it is seen, we cannot be wrong and we have all of it available at once. There is an explicit rejection of the poverty of the stimulus. But pause here a second, because this is what information detection is about.

First, the production of photons exist regardless of my existence. They will bounce around on surfaces, be partly absorbed/reflected depending on surface makeup, and create structure (if we were to put an observer somewhere in this space). In this instance, it would be most appropriate to simply refer to this as the optic array, or structured light. It is not that this structure carries content, it simply is structured (and continuously re-restructured) in a manner specific, and guaranteed, by the surfaces around it and the medium(s) by which it came to any specific point.

Second, for a very long time, organisms have grown to be able to detect such structures. I cannot remember the organism, I think it’s a deep water fish, but a precursor to our eyes was sensitive only to ‘light’ or nothing. Since, eyes seemed to catch on as an important way (in an evolutionary sense) to keep developing, which in our case meant becoming more and more sensitive to the structure that light carries with it. There is no reason to believe that at once, in any given slice of time, that we can perceive all of the structures that light carries with it. ‘We see what we see’ and if we want to see more, we have to explore whatever we are trying to see by moving, to literally detect structure that may be occluded to us from one vantage point (like “illusions”), or, we simply have not looked at something for enough time that we have yet to learn to discriminate between smaller differences in structure in the optic array. I can, in the end, come to the same or a different conclusion about what I saw, depending on the history with which I came into the situation, but also depending on which parts of the array I was detecting, or trying to detect, at the time.

Third, we see and hear and detect pressure and other things at the location at which that information is available (but as you might expect, we do not necessarily detect it, but, we have the possibility to). The firing of cells in the eye that propagate to the brain, never held content, and was always in a ‘language neutral’, ‘symbol neutral’, non-content “signal”.

However. Vicente Raja Galian pointed out that so far, I have yet to assign any function to the brain, and it seems appropriate that we should since it is a curious structure and we have kept it evolutionarily. Keeping a biological structure does not entail function or even importance (in the strictest interpretation of the word), but it seems to me to be a very valid point. So far, I am having issues arguing against that the brain is for ‘where’ (on/in the body) and ‘in what order’. Something is detected at the foot as intense pressure, I look down and see a dog biting it, this (in a sense) creates a loop where whatever signals are propagated back from the retina together with the pressure of the foot are happening simultaneously. There is simultaneous increased firing from two directions into the brain. Solely by being simultaneous in a close (geographically) space, intertwines the two. Experience does not happen in the brain, it happens in the relationship between body and environment, but one thing happening before, after or simultaneously, may come to be through having a space within a body where the ‘where and when’ co-exists. Because a lot of neural propagation going on in the body, in one way or another, travels to one collected structure, the brain. No content is needed, all we need to “know” is where and when, which is simply (although plastic) a matter of bodily geography.

I also have a sneaking suspicion that the brain is for drawn-ness and repulsion, but that currently requires more thought and explication before I feel comfortable laying it out publically.

A non-content brain. 1/2

In search for a non-content perspective of brain activity, I often feel I come up empty handed. Either non-content is not really directly spoken about (e.g. Anderson, 2014, and isn’t really intended to -it does however very importantly free us from other assumptions), or when a positive account is languaged like “but the brain does this or that” is more confusing to me than clarifying. So I’ve been criticized for not having my own positive account, or even a reasonable idea of what I expect or accept as a good answer. So here’s a minimal start.

With a non-content view of the brain, I mean that, any and all activity in the brain is not representational, symbolic, or in any way carries any content in the sense that if I show you a picture of a cat then your cat neurons are firing (simplified of course). To clarify this further, Anderson to me gets close, talking about the brain in a functional sense, non-reductionally. Instead, everything “magic” already happens in a) the continuously ongoing relationship in a given organism-environment system, but importantly, b) in the sensory system(s) (e.g. eyes, ears, legs, body at large, etc.).

All that really would happen after sense-making at the sensory system organs, would be probabilistic (and likely functional as Anderson suggests) networks of directed firing. I mean this in quite a specific way. For example, eyes connect to brain at specific sites, electrical signals propagate from eye to brain at specific sites and an initial direction, but after that, neuronal firing is (due to specific reasons) a matter of what current state immediately neighbouring neurons are in. So, if one neighbour is in post-firing and another not, the latter has a higher likelihood of firing. At a larger scale, what we will see in an image of the brain is a dendritic spreading that at the time is part stochastic (and re-used) because neurons in this sense are non-essential. Of course, if a network of neurons (with part stochastic spread) are firing together, like the oscillators they are, they are more likely to fire together again at a short time scale (they are also likely to fire together again at a longer time scale, but less so. Here is where a lot of the misinterpreting of brain images (by cognitivists usually) exist if you ask me, neurons and often networks of neurons are seen as essential or carrying content so we make a one-to-one mapping between an image of a cat and the specific neurons that are firing -but there are far too many confounds for this to be a confident finding.

Like anything dynamic systems tells us, future (or current) state depends on the history of the system, and because there is no real beginning to any one individual’s brain activation, I cannot bring myself to believe that the brain ‘starts a series of neuronal firings to achieve a body movement’. Body movement is in relation to environment, that’s where the decision is made to move a certain way, that’s where “cognition” is. Actually moving a body part, yes, that is connected to brain firing -but not (necessarily) in a causal manner. Direction, intentionality, agency, mind, is not in the brain, it is in the relationship between organism and environment, a course of body movements is already given by that relationship, at most and only in this sense, is the brain a “mediating” structure.

An aside. Blood flow through the brain is already always ongoing. Co-developing with all our other organs, will also play a (perhaps minor) part in where and how a probabilistic dendritic neuronal network of firing will move through the brain. Then, wherever that was, will need more blood flow (as is the basis of most imaging techniques), however (and again), because the route through the brain is part stochastic anyways, it makes no sense to talk about brain regions, networks, or neurons in any detached, representational, contenty, essential, manner. Re-use, on the other hand, and functional (roughly similar from time 1 to time 2) networks of firing, over time, is what the brain is up to. Because of this, with current imaging techniques, they can get us worse or better probabilities of ‘what’s going on’, and interventions can hit or miss depending on individual and time of intervention. But if you are interested in human behavior, it is probably not the most productive scale or scope at which to analyse it (although there’ll be some absolutely beautiful oscillator dynamics going on at a neuronal level).

The first response ever to anything non-representational, ‘yeah, well, how do you explain closing your eyes and thinking to yourself “I am going to move my hand now” and then move your hand?’ Well, firstly, the question already assumes the brain did it, so it is always an unfair question. But. Nevertheless it needs to be answered. As always, closing your eyes and remaining still isn’t some kind of magical state where you are closed off to the world, you are still continuously co-constituted with it. In fact, I can predict that sentence above to be said because of the type of conversation we are having -the history of the system already determines and constrains direction and force into and with the future. But most importantly, the experience of the “decision” in the ‘word-sentence’ that you are thinking doesn’t ‘come from’/isn’t instantiated in the brain, it is already a decided course due to the relationship between you and the environment that you are in -alike other body movement through the world. I could respond and say “do you know how many people choose their arm/hand to move when we get to this point in the conversation? 100% so far”, that is how constraining our history is (and the direction it already gives us) even on a short timescale. You could respond “ok well now I can think of anything and maybe I won’t even move, just think that I will but don’t”, and we can go around forever in this type of dialogue, entrenching us further into that dissonant attractor state. The last point is, that question doesn’t really tell us what is going on, at worst it is a defensive reaction, at best a curiosity that likely can be satisfied empirically or by appealing to the continuously ongoing activity of our senses and sense-making.

Theory of Mind really is dead.