Tuesday, September 16, 2014

Understanding Organizational Stupidity


Shintaro Kago
[Another re-run. Regularly scheduled blogging will resume once I've sailed far enough down the coast. Homework assignment: read this article and apply the concepts within it to the Obama administration's policies on Ukraine and Syria.]

Is it morning in America again, or is the bubble that is the American economy about to pop (again), this time perhaps tipping it into full-blown collapse in five stages with symphonic accompaniment and fireworks? A country blowing itself up is quite a sight to behold, and it makes us wonder about lots of things. For instance, it makes us wonder whether the people who are doing the blowing up happen to be criminals. (Sure, they may be in a manner of speaking—as a moral judgment passed on the powerful by the powerless—but since none of them are likely to see the inside of a jail cell or even a courtroom any time soon, the point is moot. Let's be sure to hunt them down once they try to run and hide, though.) But at a much more basic and fundamental level, a better question to ask is this one:

“Why are we being so fucking stupid?”

What do I mean when I use the term “fucking stupid”? I do not mean it as a term of abuse but as a precise, if unflattering, diagnosis. Here is as good a definition as any, excerpted from American Eulogy by Jim Quinn:
If you had told someone on September 10, 2001 that ten years later America would be running $1.5 trillion annual deficits, fighting two wars of choice in countries that despise our presence, and had not only not addressed the $100 [trillion] of unfunded welfare liabilities but added billions more with Medicare D and Obamacare, they would have thought you were a crazy doomster predicting the end of the world. They would have put you away in a padded cell if you had further predicted that politicians would cut taxes three separate times, that the Wall Street banks that leveraged themselves 40 to 1 and destroyed the financial system [would be] handed $2 trillion of taxpayer funds so they could pay themselves multi-million dollar bonuses, and that the Federal Reserve would triple its balance sheet to $2.45 trillion by running its printing presses at hyper-speed and handing the money to those same Wall Street Mega-Banks.
Well, the evidence is in, and that crazy doomster in his padded cell has turned out to be amazingly prescient, so perhaps we should listen to him. And what would that crazy doomster have to say now? I would venture to guess that it would be something along these lines:
There is no reason to think that those who failed to take corrective action up until now, but remain in control, will ever do so. But it should be perfectly obvious that this situation cannot continue ad infinitum. And, as a matter of general principle, things that can't go on forever—don't.
Back to the question of stupidity: Why are we (as a country) being so fucking stupid? This question has puzzled me for some time. It appears that the problem of stupidity is quite pervasive: look at any large human organization, and you will find that it is ruled by stupidity. I was not the first to stumble across the conjecture that the intelligence of a hierarchically organized group of people is inversely proportional to its size, but so far the mechanism that makes it so has eluded me. Clearly, there is something amiss with hierarchically organized groups, something that causes all of them to eventually collapse, but what exactly is it? To try to get at this question, last year I spent quite a while researching anarchy, and wrote a series of articles on it (Part I, Part II, Part III). I discovered that vast hierarchies do not occur in nature, which is anarchic and self-organizing, with no chains of command and no entities in supreme command. I discovered that anarchic organizations can go on forever while hierarchical ones inevitably end in collapse. I examined some of the recent breakthroughs in complexity theory, which uncovered the laws governing the different scaling factors in natural (anarchically organized, efficient, stable) systems and unnatural (hierarchically organized, inefficient, collapse-prone) ones.

But nowhere did I find a principled, rigorous explanation for the fatal flaw embedded in the very nature of hierarchical systems. I did have a very strong hunch, though, backed by much anecdotal evidence, that it comes down to stupidity. In anarchic societies whose members cooperate freely, intelligence is additive; in hierarchical organizations structured around a chain of command, intelligence is subtractive. The lowest grunts or peons are expected to carry out orders unquestioningly. Their critical faculties are 100% impaired; if not, they are subjected to disciplinary action. The supreme chief executive officer may be of moderately impaired intelligence, since it is indicative of a significant character flaw to want such a job in the first place. (Kurt Vonnegut put it best: “Only nut cases want to be president.”) But beyond that, the supreme leader must act in such a way as to keep the grunts and peons in line, resulting in further intellectual impairment, which is compounded across all of the intervening ranks, with each link in the chain of command contributing a bit of its own stupidity to the organizational stupidity stack.

I never ascended the ranks of middle management, probably due to my tendency to speak out at meetings and throw around terms such as “nonsensical,” “idiotic,” “brainless,” “self-defeating” and “fucking stupid.” If shushed up by superiors, I would resort to cracking jokes, which were funny and even harder to ignore. Neither my critical faculties, nor my sense of humor, are easily repressed. I was thrown at a lot of special projects where the upside of being able to think independently was not negated by the downside of being unwilling to follow (stupid) orders. To me hierarchy = stupidity in an apparent, palpable way. But in explaining to others why this must be so, I had so far been unable to go beyond speaking in generalities and telling stories.

And so I was happy when I recently came across an article which goes beyond such “hand-waving analysis” and answers this question with some precision. Mats Alvesson and André Spicer, writing in Journal of Management Studies (49:7 November 2012) present “A Stupidity-Based Theory of Organizations” in which they define a key term: functional stupidity. It is functional in that it is required in order for hierarchically structured organizations to avoid disintegration or, at the very least, to function without a great deal of internal friction. It is stupid in that it is a form intellectual impairment: “Functional stupidity refers to an absence of reflexivity, a refusal to use intellectual capacities in other than myopic ways, and avoidance of justifications.” Alvesson and Spicer go on to define the various “...forms of stupidity management that repress or marginalize doubt and block communicative action” and to diagram the information flows which are instrumental to generating and maintaining sufficient levels stupidity within organizations. What follows is my summary of their theory. Before I start, I would like to mention that although the authors' analysis is limited in scope to corporate entities, I believe that it extends quite naturally to other hierarchically organized bureaucratic systems, such as governments.

Alvesson and Spicer use as their jumping-off point the major leitmotif of contemporary management theory, which is that “smartness,” variously defined as “knowledge, information, competence, wisdom, resources, capabilities, talent, and learning” has emerged as the main business asset and the key to competitiveness—a shift seen as inevitable as industrial economies go from being resource-based to being knowledge-based. By the way, this is a questionable assumption; do you know how many millions of tons of hydrocarbons went into making the smartphone? But this leitmotif is pervasive, and exemplified by management guru quips such as “creativity creates its own prerogative.” The authors point out that there is also a vast body of research on the irrationality of organizations and the limits to organizational intelligence stemming from “unconscious elements, group-think, and rigid adherence to wishful thinking.” There is also no shortage of research into organizational ignorance which explores the mechanisms behind “bounded-rationality, skilled incompetence, garbage-can decision making, foolishness, mindlessness, and (denied) ignorance.” But what they are getting at is qualitatively different from such run-of-the-mill stupidity. Functional stupidity is neither delusional nor irrational nor ignorant: organizations restrict smartness in rational and informed ways which serve explicit organizational interests. It is, if you will, a sort of “enlightened stupidity”:
Functional stupidity is organizationally-supported lack of reflexivity, substantive reasoning, and justification (my italics). It entails a refusal to use intellectual resources outside a narrow and “safe” terrain. It can provide a sense of certainty that allows organizations to function smoothly. This can save the organization and its members from the frictions provoked by doubt and reflection. Functional stupidity contributes to maintaining and strengthening organizational order. It can also motivate people, help them to cultivate their careers, and subordinate them to socially acceptable forms of management and leadership. Such positive outcomes can further reinforce functional stupidity.
The terms I italicized are important, so let's define each one:

Reflexivity refers to the ability and willingness to question rules, routines and norms rather than follow them unquestioningly. Is your corporation acting morally? Well it doesn't matter, because “what is right in the corporation is what the guy above you wants from you.” The effects of this attitude tend to get amplified as information travels (or, in this case, fails to travel) down the chain of command: your immediate superior might be a corrupt bastard, but your supreme leader cannot possibly be a war criminal.

Justification refers to the ability and willingness to offer reasons and explanations for one's own actions, and to assess the sincerity, legitimacy, and truthfulness of reasons and explanations offered by others. In an open society that has freedom of expression, we justify our actions in order to gain the cooperation of others, while in organizational settings we can simply issue orders, and the only justification ever needed is “because the boss-man said so.”

Substantive reasoning refers to the ability and willingness to go beyond the “small set of concerns that are defined by a specific organizational, professional, or work logic.” For example, economists tend to compress a wide range of phenomena into a few numbers, not bothering to think what these numbers actually represent. Organizational and professional settings discourage people from straying from the confines of their specializations and job descriptions, in essence reducing their cognitive abilities to those of idiot-savants.

Functional stupidity can arise spontaneously, because there are many subjective factors which motivate people within organizations to narrow their thinking to the point of achieving it. A certain amount of closed-mindedness can be helpful in furthering your career. It helps you present yourself as a reliable organizational person—one who would never even question the validity of the organizational or occupational paradigm, never mind stray from it. At the other extreme, your refusal to stray beyond a narrow focus may be prompted by feelings of anxiety, insecurity, and fear of jeopardizing your position. And while, just as you would expect, functional stupidity produces negative outcomes for the organization as a whole, it provides for smooth social functioning within the organization itself by suppressing dangerous or uncomfortable questions and by avoiding the awkwardness of calling into question the judgment of your superiors.

But such subjective factors are dwarfed by certain stupidity-generating features of organizations. At their highest level, organizations tend to focus on purely symbolic issues such as “strong corporate cultures and identities, corporate branding, and charismatic leadership.” Corporate (and other) leaders try to project an identical internal and external image of the organization, which may have little to do with reality. This is only possible through stupidity management—the process by which “various actors (including managers and senior executives as well as external figures such as consultants, business gurus, and marketers) exercise power to block communication. The result is that adherence to managerial edicts is encouraged, and criticism or reflection on them is discouraged.”

As the people within the organization internalize this message, they begin to engage in stupidity self-management: they cut short their internal conversations, refusing to ask themselves troubling questions, and focusing instead on a positive, coherent view of their environment and their role within it. But stupidity self-management can also fail when the mismatch between the message and reality becomes too difficult to ignore, ruining morale. The suppressed reality (“The king is naked!”) can spread as a whisper, resulting in passive-aggressive behavior and deliberate foot-dragging all the way to sabotage, defections and resignations.

The functions of stupidity management are to project an image, to encourage stupidity self-management in defense of that image, and to block communication whenever anyone lapses into reflexivity or substantive reasoning, or demands justification. Communication is blocked through the exercise of managerial power. The authors discuss four major ways in which managers routinely exercise their power in defense of functional stupidity: direct suppression, setting the agenda, ideological manipulation, and fetishizing leadership. Of these, direct suppression is by far the simplest: the manager signals to the subordinate that further discussion will not be appreciated, threatening or carrying out disciplinary action if the signaling doesn't work. Setting the agenda is a more subtle technique; for instance, a typical ploy is to require that all criticisms be accompanied by “constructive suggestions,” placing beyond the pale all problems that do not have immediate solutions (which are the vast majority). Ideological manipulation is more subtle yet; one common technique is to emphasize action, at the expense of deliberation, as expressed by the corporate cliché “stop thinking about it and start doing it!” Finally, fetishizing leadership involves splitting each group into leaders and followers, where the leaders seek to make their mark, whatever it takes, and to get promoted quickly. To do so successfully, they must suppress the critical faculties of those around them, compelling them to act as obedient followers.

Functional stupidity is self-reinforcing. Stupidity self-management, reinforced using the four managerial techniques listed above, produces a fragile, blinkered sort of certainty. By refusing to look in certain directions, people are able to pretend that what is there does not exist. But reality tends to intrude on their field of perception sooner or later, and then the reaction is to retreat into functional stupidity even further: those who can ignore reality the longest are rewarded and promoted, setting an example for others.

But the spell can also be broken when the artificial reality bubble protected by the imaginary film of functional stupidity is punctured by a particularly contradictory outcome. For an individual, the prospect of unemployment or the end to one's career can produce such a sudden realization: “How could I have been so stupid?” Similarly, entire organizations can be shaken out of their stupor by a painful fiasco that subjects them to a barrage of public criticism. Public hearings in which industry leaders are forced to appear before government committees and answer uncomfortable questions can sometimes serve as stupidity-busting events. A particularly daunting challenge is to pop the functional stupidity bubble of an entire nation, since there is no public forum at which objective outsiders can force national leaders to take part in a substantive discussion. Bearing witness to the fast-approaching end of the nation as a going concern may be of help here. How could we have been so fucking stupid? Well, now you know.



Please order your copy of The Five Stages of Collapse: Survivors' Toolkit for shipment in May.


(Although the order is placed through PayPal, you don't need to have a PayPal account; just click "Don't have a PayPal Account?" during check-out and enter a credit or debit card number. If you do have a PayPal account, please make extra-double-sure that the shipping address associated with it is up-to-date and correct, and will remain that way through May.)

18 comments:

JMu said...

I recently had cause to reflect on collective stupidity. I was driving on a suburban road, and encountered a group of bicyclists. I ride myself, but I don't wear a uniform as these riders do. I also make an effort to ride on the right side of the road, which many of these riders didn't. I was patient, but reflected on the rudeness, stupidity and boldness of large groups, be they runners, bicyclists, protesters, whatever. Even when there is no noticeable hierarchy, the more people there are, the larger the likelihood that someone will say "Hold my beer, now watch this!"

pond said...

A request for when you are back online: I would love to read the Orlov wit dissect the current practice of various police departments across the USA of robbing travelers at gunpoint. (The Washington Post recently published a feature article on this, which garnered ... silence ... on the part of our Liberty-Loving and Freedom-Defending Right Wingers, and our Civil-Liberty-Defending Left Wingers.)

Since you saw the like in old Russia, and predicted this in the collapse of the American Empire, how far advanced is our collapse, given that this practice has been going on for years and is growing?

dex3703 said...

Even more applicable the second time around. I've taken a short-term job in such an organization, and I can attest nothing has changed.

Derek
dex3703.wordpress.com

Mr. Moai said...

“Why are we being so fucking stupid?”

Because the stupid are easily manipulated. Those who only know different flavors of lies will believe whatever they have been conditioned to believe.

People being ignorant self-centered assholes is not a mistake, it is more of a tradition which ensures that the most psychopathic among us wield the most power. It is built into the structure of our civilization and we project that structure onto the world around us and nature itself (Darwinian competition models).

The BBC documentary series The Century of Self casts light onto the 20th century model of propaganda and behavior modification for social engineering. The 21st century model of social engineering is technocratic and cybernetic. I only hope things collapse before we go too far down that road lest we be gradually borg-ified into human drones.

From The Findhorn Garden:
"To manage men, you have to process them the way you do tomatoes: grow plastic varieties that can endure machine harvesting and pick them when they are green and unripe. The kind of men who can live compatibly with their machines are very much like the food they eat."

Jim R said...

That sounds about right.

Of course, if you had been in such places long enough, they'd send you to a team-building seminar, where you can break up into groups of four or five, and build things out of marshmallows and toothpicks.

wiseman said...

@pond
I am from India and here we don't harbor any illusions that the cops are out to protect our liberties.

It's understood that if you want to get your job done you have to pay them money or use your influence. Extortion and protection money is pretty common. It's a well organized system, there are no random robberies of the kind you mentioned above. It's probably a sign that collapse hasn't really begun.

Mister Roboto said...

Off-topic but interesting: A news story from NBC.com that demonstrates rather effectively what people in western Ukraine think of their current government.

Unknown said...

The dynamics of institutionalized stupidity are as you've indicated self-reinforcing and perpetuating - Why?
The reasons you've elicited refer back to operational requirements of sustaining a system of stupidity! This is verging on tautology.
Perhaps the operational mode can be characterized as 'stupidity', but I believe the logic is that of suppression and control. Institutional stupidity then becomes an expression of self-censorship in the service of control and privelage.

Jacob Gittes said...

What's up with this story planted in the Telegraph?
http://www.telegraph.co.uk/news/worldnews/europe/russia/11106195/Putin-privately-threatened-to-invade-Poland-Romania-and-the-Baltic-states.html

northsheep said...

Dmitry,

I found your use of the fact that nature is anarchic and self-organizing to be a compelling argument against hierarchy in society. To ecologists, it is an amusing myth that the human species is so radically different from other species as to be immune from nature’s laws and methods of organization. Decades ago, after a course in ecology, I began slowly debugging my mind of this widely held myth. As a farmer I began to design a way for our species to farm that obeyed nature’s laws and followed nature’s lead in my attempt to design a more sustainable agroecosystem. So it makes eminent sense to take nature’s cue to design smarter social systems as well.

I have memories of how stupid command hierarchies tend to be. My US army experience was full of laughs at how ridiculous and incompetent were the actions of those who ordered us grunts around. One summer I worked as a busboy at the Four Seasons in Manhattan, a large, very expensive restaurant. It was structured as a command hierarchy fully as rigid as the military one that I had known, and suffered for it in the quality of the food and service it offered. In both these cases, refusal of the upper echelons of the hierarchy to listen to the views of the base caused endless problems.

colinc said...

@ Mr. Moai said...
Tuesday, September 16, 2014 at 8:39:00 PM EDT

Bingo! I couldn't have said it more clearly or succinctly!

Paul said...

I bet the crazy doomster couldn't have foretold this:

http://www.rawstory.com/rs/2014/09/court-hammers-florida-sheriffs-office-for-swat-style-raid-to-check-for-barber-licenses/comments/#disqus

Paul said...

Of course, it's painting with a broad brush, but I remember being told by a Frenchman that the French looked upon the Americans as children; and I think I had a vague sense of what he was driving at.

It has just become little clearer. Although things have gone downhill in the US at a rate of knots, in recent decades, haven't they?

Paul said...

I'm sorry. I meant to post this link:

http://www.rawstory.com/rs/2014/09/court-hammers-florida-sheriffs-office-for-swat-style-raid-to-check-for-barber-licenses/comments/#disqus

Leo Knight said...

Robert Anton Wilson called it the SNAFU Principle:

"It's what I call the "snafu principle." Communication only occurs between equals (real communication, that is) because when you are dealing with people above you in a hierarchy, you learn not to tell them anything they don't want to hear. If you tell them anything they don't want to hear, the response is, "One more word Bumstead and I'll fire you!" Or in the military, "One more word and you're court-martialed." It's throughout the whole system.

So the higher up in the hierarchy you go, the more lies are being told to flatter those above them. So those at the top have no idea what is going on at all. Those at the bottom have to adjust to the rules made by those at the top who don't know what's going on. Those at the top can write rules about this, that and the other, while those at the bottom have got to adjust reality to fit the rules as much as they can."

michigan native said...

Here is a man who proffers an answer to the big question: when.
https://www.youtube.com/watch?v=aZwSiHBxm0c. No later than December. What do people think of this??

Meanwhile, JHK shares his take on this organizational insanity. http://kunstler.com/clusterfuck-nation/barbarism-versus-stupidism/

ANNA TULCHINSKY said...

While I don't argue with the main thesis, i.e. that organizations are stupid, I find that the reasoning in this article is circular: functional stupidity of organizations is caused by several types of stupidity. This can be further reduced to this: organizations are stupid because of stupidity.

I applaud the intention and I get the point, but the arguments presented in this article are a large number of big words around small things.

It would be nice to find a good essay addressing the issue at its core, i.e. why humans are unable to organize themselves on a large scale like birds do, penguins or best of all - bacteria.

Ixtlan said...

One of the executive vice-presidents of the Union Carbide Corporation...remarked in a private conversation that he and his colleagues "had no idea how to manage a large corporation."

He said they simply did not know enough of the corporate workings, nor did they know what to do even if a clear problem was identified.

Kevin Carson.