I Am the Architect of My Life

The mind, computing, architecture and what ought to be built

  • Enter your email address to subscribe to this blog and receive notifications of new posts by email.

    Join 7 other followers

  • Users

  • Copyright

    Copyright (C) 2011, Nicole C. Tedesco. All rights reserved.

Posts Tagged ‘cognition’

Memory, Adaptation and Entropy

Posted by Nicole Tedesco on July 26, 2011

I will write more in the coming weeks and months about the various types of memory a life form may leverage in order to adapt to its environment.  An interesting article from ScienceDaily illustrates how epigenetics, those chemical changes which alter the way DNA is processed (or not processed) in our cells, provide an organism with an adaptation subsystem that helps it better fit its environment,

http://www.sciencedaily.com/releases/2011/07/110724135553.htm

Adaptation cannot occur without memory.  Organisms, including plants, leverage many forms of memory.  Other than chemical and physical construction, perhaps the most important characteristic which differentiates kinds of memories is the informational entropy capacities of those memories.  Memory systems with higher entropy capacities can assimilate larger informational variety.  As the informational variety (entropy) capacity of a memory system increases, so will rise the organisms potential to adapt to a greater number of environmental conditions.  That is, the higher the entropy capacity, the higher the potential utility of the adaptive system.

From the article,

Epigenetic memory comes in various guises, but one important form involves histones — the proteins around which DNA is wrapped. Particular chemical modifications can be attached to histones and these modifications can then affect the expression of nearby genes, turning them on or off. These modifications can be inherited by daughter cells, when the cells divide, and if they occur in the cells that form gametes (e.g. sperm in mammals or pollen in plants) then they can also pass on to offspring.

I will also illustrate in the coming weeks and months that adaptive system utility is not merely a function of higher information entropy capacity.  Adaptive system utility can also be extended by the system’s ability to “clean house”, “collect the garbage” and reduce information variety when the system has become saturated.

Posted in Cognition | Tagged: , , , | Leave a Comment »

Delegating Our Precious Memories to the Cloud

Posted by Nicole Tedesco on July 20, 2011

An interesting set of results published in MIT Technology Review,

http://www.technologyreview.com/web/38032/?nlid=nlweb&nld=2011-07-20&a=f

In short, if we think some information will be on the internet later, we are likely to not bother remembering that information today.

One way to interpret the results of the study is that, where we have a chance to jettison information, we do.  Hopefully, “jettison” means to “compress” information into a handy rule of thumb, word, concept or theory which we reuse with efficiency, rather than to reuse the original data set over and over again in all its unwieldy bulk. Sometimes however, we can be conned into simply erasing or otherwise strongly de-prioritizing memories without bothering to create a useful summary of what we’ve lost.  This supports that idea that our memory erasure mechanisms (or de-prioritization) are separate from our symbol creation mechanisms.  This would make sense from an incremental, evolutionary perspective.  It would also suggest that I should not assume my “transaction model” of cognition represents the working of a single mechanism.

It is interesting that one of the researchers (Wegner) refers to this as “transactive memory” (this might be related to transactional analysis in psychology).

Posted in Cognition | Tagged: , | Leave a Comment »

Heuristics Over Logic

Posted by Nicole Tedesco on July 19, 2011

We have evolved to favor heuristics over logic precisely because we have evolved to make decisions,

http://www.troyhunt.com/2011/07/science-of-password-selection.html

To make a decision is to reduce data in a problem domain to some compressed form, call it a concept or a word, then reuse that form in the future.  If we had to use all data we had ever learned to adapt to every environmental change, we would keep slowing down as we learned more, eventually to be crippled by the ambiguity of the data we had collected over time.  While this behavior helps us to maximize the utility of the brain system we have, it also leaves us with a glaring hole: we may fail to realize that the use of a specific word, heuristic or concept is invalid or otherwise fraught with some kind of risk.

Remember, decision-making and concept formation are one-way trips.  Information is discarded.  This means we had better make good decisions the first time because we might not be able to easily give ourselves second chances to reconsider.


Update 20 July 2011: See also,

http://www.michaelshermer.com/2002/09/smart-people-believe-weird-things/

Posted in Cognition | Tagged: , | Leave a Comment »

Cognitive Entropy and Cognitive Informatics

Posted by Nicole Tedesco on July 7, 2011

In regards to my thoughts on cognitive irreversibility, I think the extant research favors the term, “cognitive entropy“.  I have a lot of reading to do, but I am not yet sure if my particular thoughts have been explicitly addressed.

An interesting paper, here:

http://psycnet.apa.org/index.cfm?fa=buy.optionToBuy&id=2009-22869-014

Also, here:

http://portal.acm.org/citation.cfm?id=1020230

Apparently, the IEEE has an interest group on Cognitive Informatics.  See also, the International Journal of Cognitive Informatics and Natural Intelligence,

http://www.enel.ucalgary.ca/IJCINI/

Posted in Current Activities | Tagged: , , | Leave a Comment »

Barry Schwartz and the “Paradox of Choice”

Posted by Nicole Tedesco on July 7, 2011

This could be an interesting read in both topics of cognition and behavioral economics,

http://en.wikipedia.org/wiki/Paradox_of_choice

(note the section, “Why we suffer“, which corresponds to some of the notions I was throwing around in my previous article)

http://www.amazon.com/The-Paradox-of-Choice-ebook/dp/B000TDGGVU

A review and synopsis of the book can be found here,

http://andreagandino.com/journal/2009/cognitive-entropy-the-paradox-of-choice/

In short, we humans are not very fond of possessing too many choices.

Posted in Current Activities | Tagged: , , | Leave a Comment »

Cataloging Cognitive Phenomena Using Reversibility Criteria

Posted by Nicole Tedesco on July 4, 2011

As you can probably tell by yesterday’s post, my thesis is still young, not quite formed, and has a few holes.  As an exercise, I am considering cataloging cognitive behavior (especially economic behavior) in terms of reversibility.  I am wondering if the results of this exercise, which might have a physical basis in neurobiology, could result in a kind of “periodic table of elements” for human behavior. Could it help point the way to better understanding of the neurobiology of various behavioral mechanisms?  This would be a mult-dimensional map, including:

  • Degree of irreversibility
  • Irreversibility seeking versus irreversibility maintenance
  • Irreversibility recognition (do you know it when you see it?)
Consider some examples:
  • Defense of property (irreversibility maintenance)
  • Economic transaction (irreversibility seeking)
  • Social bonding (irreversibility seeking while bonding, maintenance afterwards)
  • Obsessive compulsive disorder (irreversibility seeking, but unable to recognize it when it occurs)
  • Schizophrenia (brain randomness: low irreversibility/bias, high irreversibility seeking behavior)

Consider the potential mapping along these dimensions:

Reversible ← → Irreversible
Successful recognition ↑
Recognition failure ↓

Indeed, I am having a difficult time expressing what is on my mind.  I will try to read more literature on behavioral economics to see if others have already tread these waters and also to see if I can get some hints on how to express my thoughts better on this topic.  Of course, this work might be a nothing but a snipe hunt, but I think I might at least learn something from the exercise.

Posted in Current Activities | Tagged: , , , | Leave a Comment »

Cognitive Irreversibility and the Limits of Nomadic Life

Posted by Nicole Tedesco on July 3, 2011

Is the Never-Ending March of Transience a Given?

Since I first read Alvin Toffler’s book, Future Shock, as a child (ca. 1972), I had come to agree with his premise that our future will be wrought with increased transience across all aspects of life.  For instance our friendships would be increasingly temporary, jobs would be increasingly unstable and we would become increasingly nomadic out of necessity.  The intervening years have been kind to Toffler’s prognostication.  A colleague of mine, Scott Anderson, is beginning to suspect that he is due for a relocation as a result of some yet unforeseen set of circumstances waiting in the wings to boot him from his cozy abode.  There is a limit to how much ambiguity humans can and will put up with.  I am beginning to suspect that continual increased transience is not a given because, at the smallest of time scales, our lives become too ambiguous for us to handle.  We will find other ways of coping with the complexities of life, or at least appear to, in addition to the easy choice of decreasing time.  These other means may not be rational, and may even be violent.  To understand why it helps to understand the role of information loss and irreversibility in cognitive processes.

Information Omission and Irreversibility

Ayn Rand proposed that useful concepts in the human mind are dependent upon the process of informational omission.  Once we identify sensory measurements as related, or even abstract ideas as related, we “compress” the related measurements or abstractions into a grouping and then discard the original measurements.  The group, or concept she said, is then integrated into existing concepts in a hierarchical manner.  This informational omission reduces cognitive load and the integration allows us to reuse information across greater and greater scales.  Rand’s concepts are very closely related to groups in group theory.  However, group theory is inherently lossless.  Like wires extruded from a hot copper ingot, the continuum of real numbers in group theory can be “extruded” through the use of functions into finer and finer strands until individual elements have been isolated, such as discrete integers.

In group theory, functions are computable and reversible.  The results of extrusion functions can always be traced back to their source, like a wound-up, fine copper wire not yet separated from its generating ingot.  Human concept formation however is not inherently reversible.  A “cut” is necessarily made when concepts are formed, otherwise the continued explicit use of the original information (sensory data or other abstractions) would overwhelm our ability to think clearly, think quickly or think at all (especially under stress).  This cut may not be computable or traceable like the codomains of mathematical groups.  In his book, The Emperor’s New Mind, physicist Roger Penrose described the role of non-computability in human decision making.  Philosophers such as David Hume had long ago identified the non-logical (non-computable) nature of epistemological induction.  Rand, I believe correctly, identified the concept formation process as an inductive one, non-deductive, hence essentially non-computable.  Human concept formation, like all non-computable processes, is associated with information loss and thus varying degrees of cognitive irreversibility.

Cognitive load” is the burden of information variety in the mind.  Maintaining a large variety of ungrouped/unconceptualized information in working memory is often described as a state of high entropyambiguity, or of indecision, and in generally perceived as uncomfortable if not downright dangerous.  We could never make a decision without conceptualizing our problems and potential solutions.  To do so requires we commit to casting aside this information or that, and commit to compression of thought.  This will not occur on its own.  The simplistic memory systems of early evolution probably cataloged raw sensory information and did little else.  Those simplistic memory systems, which we still possess, quickly become filled to capacity.  Evolution, however, has favored the animal that could scale that memory through pruning and reuse. The predator-escaping human of pre-history would be dead if they could not make up their mind in time whether to turn right or left at a fork in the potential escape route because their mind was filled only with raw facts.  Decision-making, pruning the tree of facts to derive a conclusion, is a feature of evolution.  With decision-making come the epiphenomena of disambiguation and irreversibility.  Though our cognitive processes are adept at reducing ambiguity we do not explicitly seek ambiguity reduction for its own sake.  Similarly, while our inductive and concept-formation processes tend to exhibit varying degrees of irreversibility, we probably do not explicitly seek irreversibility for its own sake.  Rather we just do what we do and try to create working knowledge for ourselves so that the world makes sense and so that we can take action when we need or desire to.  Disambiguation and irreversibility are side effects of our normal cognitive processes.  On the other hand, we are motivated to form concepts and to take action in the world.

Cognitive irreversibility is not always complete.  Sometimes we discard original sensory data and basic abstractions, sometimes we don’t.  Human memory, especially when considering such phenomena as the reliability of witness testimony in law, is notoriously unreliable because we recreate many past events by “uncompressing” concepts and other mental structures in order to rebuild discarded (or otherwise inaccessible) original sensory data and abstraction.  In this respect, concepts act somewhat like mathematical groups, though imperfectly.  Some of the original raw memory may linger to make up for some of this loss.  In most cases however our neuroanatomy does a fine job of mimicking mathematical group reversibility and we fail notice the imperfections.  What is important to understand however is that actual information is discarded, or rendered inaccessible, and that we are utterly dependent upon non-computable, somewhat irreversible processes no matter how much we may convince ourselves otherwise.

Relationships, Law and Superstition

Hunter-gatherer tribes which experienced the ambiguity of multiple locations and varying meal options traveled together and kept their interpersonal relationships constant.  One benefit that consistency of social network provides is a reduction of ambiguity and cognitive load.  Creating new relationships, especially trusted relationships, is hard.  Relationship building requires understanding the behavior new people.  It also requires the time necessary for our endocrine systems to work properly to literally allows us to chemically bond with one another.  Breaking relationships with other humans is difficult.  In particular break-ups, either with friends, family or colleagues, is fraught with the perils of emotional reaction.  It is easier to bind to other human beings than it is to unbind.  This difficult-to-reverse behavior is why we as a species are described as “social animals”.  We need good reason to destroy relationships.  The lead up to the break-up usually consumes a lot of thought and emotion.  Hunter-gatherer tribes typically develop complex rules in order to keep their tribes together.  After all, if family and friends were in constant flux, how much mind would have been left to concentrate on the perils of travel, feeding and defense?

Hard-and-fast rules for anything reduce cognitive load.  Committing to a credo of “eye for an eye” is easy.  Instead of examining all evidence for every crime, instead of revisiting ethical and moral propositions for each and every case, the simple heuristic allows people under stress to survive.  By pruning the possibility for revisiting ethical and moral propositions over and over, laws allow difficult situations in human relationships to be arbitrated with speed and allows all concerned to spend more time thinking about the more important problems in life such as food and health concerns.  If the human brain power were, perhaps a few orders of magnitude higher in terms of I.Q., perhaps we could revisit ethical and moral propositions over and over again and make better decisions.  However, we are not intelligent gods.  The relative irreversibility of enforced law allows human beings, on the whole, to thrive, even if individual cases here and there may not be adjudicated fairly.

For similar reasons it is not difficult to see why superstition comes to be so readily.  Creating a rule, any rule, then discarding the original thought behind it is a natural survival skill.  Some rules are useful, some rules are neutral, some rules might even be deadly on occasion.  No matter, we are excellent concept-generating and rule-developing machines.  The general mechanisms for concept-generation and rule-development are what allowed us to survive and thrive in the great maelstrom of the evolutionary process, not specific concepts or specific rules.  We come to cherish our concepts and rules, even institutionalize them, for the benefit of survival.  In fact we are even rewarded for our concept and rule creation with the flush of opiates that come with the moment of, “Eureka!”  That some rules come to be called superstition is par for the course for a system that, biologically, does not favor specifics but in general favors something, anything.  What makes superstition “sticky”, what makes it last so long, what makes it spread from human to human and over generations, is the one-way nature of information which accompanies the creation of rules of any kind: if you are motivated to embrace a simple idea instead of ambiguity, a rule can last for a very long time and what is more, others will be similarly motivated to think it is a good idea as well.

Monarchies and Irreversible Social Structures

Why do humans follow their leaders?  Being empathetic as we are, why were our ancestors not more egalitarian than they turned out to be?  The simple answer is that to follow a leader is easy.  To surrender choice to a leader is like adopting a simple law or a superstition, it lowers cognitive load by removing the need to think about those things the leader is thinking for you.  To the extent that a leader’s reign might be temporary, the self interested human cannot completely unload their decision making.  To the extent that a leader’s reign is protected and assumed to be long lasting—to the extent it is perceived to be irreversible—then the self interested is free to lighten their cognitive load and concentrate on other things in life.

It is common in some schools of legal theory to attribute the existence of a monarchy to the need solve various regress problems of permission and enforcement.  It is the sovereign who charters the legislators, the jurists and the enforcers to act on their behalf.  Familial inheritance solves the problem of chartering the sovereign.  The original monarch arose by force of “habit” amongst the populace.  When considering cognitive load, a simpler explanation becomes apparent: surrendering to a sovereign is, for the subject, a simple solution to a set of hard problems present in complex societies and in a dangerous world.  The inheritable nature of monarchies is valuable in that it provides the subjects with a sense of perceived irreversibility, which reduces the need for any subject to consider all aspects of law for themselves at any time.  This sense of ease and utility in reducing cognitive load also helps explain why even egalitarian democracies drift towards strong, central control over time, assuming extraordinary efforts are not taken to stop such drift.  If the end of a monarchy was perceived as near, or if a strong, central government were perceived as close to dissolution, panic might ensue amongst the citizenry.  What to do?  How to fend for thyself?  How to defend one’s property?  The burden of the enormity of thinking required to solve complex problems in a complex society would be avoided if possible.  It seems that, for some, it is better to lose information and keep it lost by surrendering to a tyrant than it is to shoulder the responsibilities of citizenship for thyself.  Irreversible social structures of all kinds fulfill the role of cognitive salve including institutional religions, labor unions, fraternal orders and, as mentioned previously, families.

Feedback Loops, Money and the Economics of Time

Economic activity is human collaboration motivated by the exchange of economically liquid—exchangeable—goods or services.  Humans by themselves pursuing their self interests do not economic activity make.  Humans in spontaneous collaboration do not economic make.  The exchange of an exchangeable good or service is an interesting motivational force in human affairs.  While one-on-one collaboration takes place, motivation to collaborate can become increasingly difficult to obtain the more complex the activity.  To motivate a group of people to build a complex farming community, for instance, requires the development of interpersonal bonds, cajoling, arguing, reasoning, discussion, more discussion and sometimes even violence.  When a human exchanges of a good or service however, our ability for symbolic manipulation and concept formation do something miraculous: it reduces the need for the kind of cognitive activity normally required to trigger collaborative activity.  Instead of long, arduous argument about why such and such a barn might need to be built, the exchange of consumable goods reduces the cognitive loads of all parties by alleviating the need to concentrate on the logic of the need to collaborate.  Instead, the participants can allow themselves the luxury of concentrating on the logic of their self-interests.

Information is lost in the economic exchange however, specifically much of the information about the need to collaborate that would have normally been exchanged need not be exchanged at all.  The interesting thing about this information loss, especially since the invention of money, is that the information loss can accelerate human collaboration.  Since the logic of the need to collaborate need not enter the collaboration equation, as long as goods are exchanged humans can remain motivated to continue their collaboration, even if the original conditions of collaboration have long been satisfied.  Positive economic activity is actually a case where cognitive irreversibility fails to be achieved in some aspect.  It may be the easy thing to do to ignore the original conditions of the collaboration as long as the opportunity for the transaction of goods, and the rush the closing of those transactions provide, continue to present themselves.  Humans remain motivated, perhaps to continue building barns.  As long as goods exchange continues satisfactorily, collaboration with other humans suddenly becomes easier because motivation is high and cognitive load for all concerned remain low.  As long as the original logic of the collaboration need not be reexamined, cycles of activity can continue accelerate and miracles occur.  Money accelerates the cycles even more because they are not directly consumable and thus likely to survive serial exchange from one motivated human to another.  This is one of the advantages of the use of gold as a currency as opposed to wheat or even oil.  Information loss in human affairs leads to feedback cycles of all kinds, not just economic booms.  We sometimes call negative feedback cycles born of information loss “moral hazards” or, sometimes, insanity.

Of course, fish will always grow to fill their fish tank.  Economic exchange reduces human cognitive load, which enables collaboration to occur more easily and can even lead to enhanced motivation to build or to serve.  Economic exchange allows humans not just to survive, but to thrive as individuals and allows societies to grow.  Eventually however, cognitive limits are reached once again as the collaborative activities reach critical levels of complexity.  Many cognitive reduction techniques are brought to bare to handle complex collaborations such as forming collaborative hierarchies, surrender to legal authority or reduction of time.  Management hierarchies work because all participants are alleviated of the need to consider all information all the time; “managers” make decisions upon which others are compelled to act.  The effect of the manager is similar to that of the legal sovereign: information load is reduced and the perception of compulsion allows the participants to relax in their anticipation of the future need to think too hard.  Breaking up large activities into smaller serial activities play a similar role to sovereigns and management in that cognitive information is allowed to pass once a subgoal has been reached.  Reducing the length of time required for each unit of economic activity to complete allows human collaborations to scale into yet larger scales of complexity.

Our Complex World and the Limit To Scott’s Fears

Our world is becoming increasingly complex every day.  My colleague Scott is correct to assume that units of economic activity will continue to be reduced in time.  Units of economic activity also include his employment tenure, the housing values in his neighborhood and even the positive economic feedback cycles found in the society of any geographic location.  Time units, in human activity, can only be reduced so far however before the number of discrete activities themselves overwhelm the limited human mind.  Fortunately, we do not need to reduce economic activity into the scale of the microsecond since evolution has provided us with other tricks to toss out “unwanted” information and perception.  Not to worry Scott, perhaps the people you live and work with might stop running faster and faster and might instead start adopting more hard and fast rules of conduct, more superstitions, attempt to throw more money at their problems or surrender themselves to tyrants.  Sometimes people also drink to forget or entertain themselves to death.

When we humans feel we have too much on our mind, we are very, very inventive in our ways to lighten our mental loads.  In a complex world, sometimes the insane are the luckiest of them all, for they can escape the pain of overload through the simple bliss of ignorance.

[Update 5 July 2011: a word of caution herehttp://nicoletedesco.wordpress.com/2011/07/04/cataloging-cognitive-phenomena-using-reversibility-criteria/]

Posted in Cognition | Tagged: , , , , , , | 5 Comments »

Ambiguity Avoidance is not Explicit

Posted by Nicole Tedesco on July 2, 2011

In behavioral economics, the “ambiguity effect” describes the tendency of people to select the least ambiguous amongst choices.  Ambiguity avoidance in human behavior however, is probably not explicit but perhaps more of an epiphenomenon,

http://www.sciencedirect.com/science/article/pii/074959788690018X

Posted in Cognition | Tagged: , , | Leave a Comment »

The Endowment Effect and Irreversibility

Posted by Nicole Tedesco on June 27, 2011

The (disputed) endowment effect in economics is the observed phenomenon where most people tend to value the same thing more once they own it than before they owned it.

http://en.wikipedia.org/wiki/Endowment_effect

This is one example of the cognitive value of irreversibility in economic transactions. The case of the endowment effect is a phenomenon where irreversiblity is sought to be maintained rather than obtained. Interestingly, the endowment effect seems to attenuate with a little education; those who understand that buying prices and selling prices ought to converge are more likely to thwart what otherwise seems like a default bias with human beings.

Posted in Economics | Tagged: , , | Leave a Comment »

Cognitive Irreversibility and Economic Value

Posted by Nicole Tedesco on June 25, 2011

Call me “fascinated” by my own comment from a previous post,

The successful conclusion of an economic transaction represents a difficult-to-reversecognitive commitment by the participants to a balance of trade-offs, or economic utility.

My fascination lies with what seems to me to be a pervasive phenomenon in human affairs which I call cognitive irreversibility, which is a perception by a human agent that a willful physical action of theirs is to some degree irreversible.  From an economics perspective, I am exploring that cognitive irreversibility may be a necessary condition for economic value to emerge.  This is not a simple re-hash of Hernando de Soto’s imperative of property rights.  Rather I suspect that irreversibility may be something of an imperative, an entropy imperative, for a great deal of human cognitive behavior including:

  • compression in cognitive concept-building
  • time reduction as a complexity management strategy
  • the emergence of the concept of property
  • marginal utility in economics
  • the attraction of tyrannical leadership (irreversible surrender to authority)
  • rape, murder and war (the imposition of irreversibility)
  • tattooing and body piercing (here is where it becomes explicit)
  • transsexualism as a mechanism to manage “out of control” empathy

I am not suggesting that humans always explicitly seek “irreversibility” in decision-making, but that a lot of human behavior (especially that which we consider “economic activity”) can be modeled using one-way motivational operators, that is modeled in terms of what appears to be either explicit entropy-seeking or entropy-seeking gone wrong (cognitive failure).  I am also not suggesting that human activity can be mathematically modeled using thermodynamics.  Rather, similar to what the early information theorists did, I am borrowing the concept of “entropy” for its superficial relationship to irreversibility (Shannon seemed to be attracted to the idea of information variety).

I’ll post more later as I develop the idea further, but in the mean time consider the cognitive phenomenon of “boat burning”, or “Crossing the Rubicon”, or point of no return,

http://en.wikipedia.org/wiki/Point_of_no_return


Update: given a physically rigorous definition of entropy, I may want to reconsider borrowing the term as an analogy for “irreversibility”,

http://entropysite.oxy.edu/

Entropy change is the measure of how more widely a specific quantity of molecular energy is dispersed in a process, whether isothermal gas expansion, gas or liquid mixing, reversible heating and phase change or chemical reactions, as shown by the Gibbs free energy equation/T .”

While models such as Gibbs free energy for chemistry loosely associate irreversibility with entropy, the association is not necessary and may even be misleading.  The association, for instance, may lead one to assume that equations of thermodynamics may somehow be applicable to economics.  As Claude Shannon was aware, this is not necessarily so.

Posted in Current Activities | Tagged: , , , | 2 Comments »

 
Follow

Get every new post delivered to your Inbox.