The Limits of Expertise

I originally published this essay on the 18th of January, 2014 at The Scholar’s Stage. David Foster’s recent post on “credentialed experts” has prompted me to resurrect it here. I have not otherwise changed it from the original.

—-

Last month Tom Nichols, professor of national security affairs at the U.S. Naval War College  and a well regarded authority on Russian foreign policy and American nuclear strategy, published a thought-provoking essay on his blog titled “The Death of Expertise:”

…I wonder if we are witnessing the “death of expertise:” a Google-fueled, Wikipedia-based, blog-sodden collapse of any division between students and teachers, knowers and wonderers, or even between those of any achievement in an area and those with none at all.

By this, I do not mean the death of actual expertise, the knowledge of specific things that sets some people apart from others in various areas. There will always be doctors, lawyers, engineers, and other specialists in various fields.

Rather, what I fear has died is any acknowledgement of expertise as anything that should alter our thoughts or change the way we live. A fair number of Americans now seem to reject the notion that one person is more likely to be right about something, due to education, experience, or other attributes of achievement, than any other.

Indeed, to a certain segment of the American public, the idea that one person knows more than another person is an appalling thought, and perhaps even a not-too-subtle attempt to put down one’s fellow citizen. It’s certainly thought to be rude: to judge from social media and op-eds, the claim of expertise — and especially any claim that expertise should guide the outcome of a disagreement — is now considered by many people to be worse than a direct personal insult.

This is a very bad thing. Yes, it’s true that experts can make mistakes, as disasters from thalidomide to the Challenger explosion tragically remind us. But mostly, experts have a pretty good batting average compared to laymen: doctors, whatever their errors, seem to do better with most illnesses than faith healers or your Aunt Ginny and her special chicken gut poultice. To reject the notion of expertise, and to replace it with a sanctimonious insistence that every person has a right to his or her own opinion, is just plain silly.
(emphasis added) [1]

I encourage visitors to the Stage to read Dr. Nichol’s entire piece. It was prompted by what has become a common experience every time he (or fellow UNWC professor and former NSA employee John Schindler) decides to publish a new essay or speak publicly about a pressing issue of the day. Soon after his work is published a flood of acrimonious tweets and e-mails follow, declaring that he does not really understand how American intelligence agencies, the Kremlin, or the Obama administration actually work

Most of these responses are misinformed. Many are simply rude and mean. They are not an impressive example of what laymen commentators can add to America’s political discourse. Dr. Nichols suggests four rules of thumb for engaged citizens that he believes would improve matters:

1.The expert isn’t always right.

2. But an expert is far more likely to be right than you are.

3. Your political opinions have value in terms of what you want to see happen, how you view justice and right. Your political analysis as a layman has far less value, and probably isn’t — indeed, almost certainly isn’t — as good as you think it is.

4. On a question of factual interpretation or evaluation, the expert’s view is likely to be better-informed than yours. At that point, you’re best served by listening, not carping and arguing. [2]

  ·


The trouble with this advice is that there are plenty of perfectly rational reasons to distrust those with political expertise.

Read more

The Roboticization of Customer Service

(Ran into this 2006 post while searching for an old Photon Courier post, and realized it had never been posted on Chicago Boyz.  It is unfortunately still quite relevant.)

Almost every day, one encounters some business that is attempting to micromanage the interactions between its employees and its customers.

At lunchtime a couple of weeks ago, I was in the mood for bacon & eggs, so I went to a restaurant (part of a local chain) that has breakfast items all day long. The interaction went something like this:

Waitperson: Welcome to Snarfers-by-the-Lake, my name is Linda, I’ll be your server today.

Me: Hi, Linda. I’m kind of in a breakfast mood, so I think I’ll have the bacon & eggs.

WP (looks confused, as if she’d never heard of this dish before): Bacon & eggs? I don’t think…Oh, that would be our “eggs any style.”

Me: OK…style I like ’em is over medium, with the bacon pretty crisp.

WP: Over medium…and would you like bacon or sausage with that?

Me: Bacon…pretty crisp.

WP: And our soup today is cream of broccoli.

Me: Soup with breakfast? That would be something different!

WP: I know it’s silly, but they make me say it.

I know it’s silly, but they make me say it.  In how many consumer-oriented businesses could employees say the same thing?

Also a couple of weeks ago, I had to call my local telco, always a dreaded experience. After I had finally gotten through the levels of the voice response menu and got a person, it was:

CS Agent: Thank you for calling, how may I provide you with exceptional service today?

How may I provide you with exceptional service today?  You can bet the agent didn’t come up with this phrase all by herself. And I doubt if her management came up with it all on their own. No, I detect the fine hand of a consultant here–maybe the pointy-haired guy in  Dilbert  went into the CS consulting business.

What imaginable purpose is there in requiring this phrase to be used in thousands of calls per day? Customers will decide if the service is “exceptional” or not based on what gets done or not done. You’re not going to convince them by using the  word. And from the standpoint of the CS agents, this kind of thing can only breed cynicism.

Read more

The Rule of Credentialed “Experts”

Lead and Gold links an article by Noemie Emery:

They had a dream. For almost a hundred years now, the famed academic-artistic-and-punditry industrial complex has dreamed of a government run by their kind of people (i.e., nature’s noblemen), whose intelligence, wit, and refined sensibilities would bring us a heaven on earth. Their keen intellects would cut through the clutter as mere mortals’ couldn’t. They would lift up the wretched, oppressed by cruel forces. Above all, they would counter the greed of the merchants, the limited views of the business community, and the ignorance of the conformist and dim middle class…Their stock in trade was their belief in themselves, and their contempt for the way the middle class thought, lived, and made and spent money: Commerce was crude, consumption was vulgar, and industry, which employed millions and improved the lives of many more people, too gross and/or grubby for words.

These attitudes, Emery notes, explain the passionate attraction that so many academics and journalists felt toward Barack Obama:

Best of all, he was the person whom the two branches of the liberal kingdom—the academics and journalists—wanted to be, a man who shared their sensibilities and their views of the good and the beautiful. This was the chance of a lifetime to shape the world to their measure. He and they were the ones they were waiting for, and with him, they longed for transcendent achievements. But in the event they were undone by the three things (Fred) Siegel had pegged as their signature weaknesses: They had too much belief in the brilliance of experts, they were completely dismissive of public opinion, and they had a contempt for the great middle class.

Much of the “expertise” asserted by people in the academic-artistic-and-punditry complex is entirely imaginary, as far as the organization and management of social institutions goes.  L&G cites one of my old posts at Photon Courier:

In university humanities departments, theory is increasingly dominant–not theory in the traditional scholarly and scientific sense of a tentative conceptual model, always subject to revision, but theory in the sense of an almost religious doctrine, accepted on the basis of assertion and authority. To quote Professor “X” once again: “Graduate “education” in a humanities discipline like English seems to be primarily about indoctrination and self-replication.”…  

Becoming an alcolyte of some all-encompassing theory can spare you from the effort of learning about anything else. For example: if everything is about (for example) power relationships–all literature, all history, all science, even all mathematics–you don’t need to actually learn much about medieval poetry, or about the Second Law of thermodynamics, or about isolationism in the 1930s. You can look smugly down on those poor drudges who do study such things, while enjoying “that intellectual sweep of comprehension known only to adolescents, psychopaths and college professors” (the phrase is from Andrew Klavan’s unusual novel  True Crime.)

See also L&G’s post How We Live Now: The Rule of Inept Experts.

I    believe that the overemphasis on educational credentials has played a major part in shifting the power balance between Line and Staff in organizations of all types…here, I am using “Line” to refer to people who have decision-making authority and responsibility, and corresponding accountability for outcomes, while “Staff” refers to people who analyze, study, and advise, but are not themselves decision-makers.  It was once pretty well understood that one should not take a person whose entire experience is in Staff positions (however exalted) and put him in a high-level Line position, where the consequences of failure will be very serious, without first having him gain experience and prove his performance in lower-level Line positions where the consequences of failure will be less-devastating to the entire organization.  This seems to be much less well-understood today, the ultimate example of course being the career path of Barack Obama.

Fred Siegel, mentioned in Noemie Emery’s article, is the author of the very interesting book The Revolt Against the Masses, which is on my (long) list of books that need reviewing.

A Compendium of Useful Reminders to be Consulted in Moments of Confusion

Judging by what I see communicated by many of my longtime friends, there are a whole lot of confused people out there these days. Here is a helpful list for them:

  1. Only a small minority of projects, even in relatively successful organizations in highly competitive industries, deliver their promised scope, on time, within budget. A large majority are drastically scaled back, incur huge cost overruns, deliver years later than intended, or are canceled outright. Anything nefarious either fails or is publicized by whistle-blowers or investigators. There are no secret, vast criminal enterprises pulling the wool over the eyes of the populace, and the best-known entities in society, both public and private, can be astonishingly inept.
  2. Large publicly-funded initiatives, other than those intimately connected to the physical survival of the societies in which they are undertaken, are quite likely to be mainly for show, irrespective of their supposedly spectacular significance. The current American example is the ACA, which has not resulted (and almost certainly will not result) in either greater insurance coverage or lower costs, is notoriously not a fully government-operated, “single-payer” system, and has no pathway to lead to one. None of this matters; indeed, many of its provisions, if they ever go into effect, will do so only after the current Administration has departed from the scene. All that matters is that its perpetrators get to claim to have passed “historic” legislation ostensibly providing “universal” health care. For an example from an earlier generation, see the Space Shuttle, which was supposed to fly 50-60 times per year at $5.5 million per launch. The actual flight rate hovered around a tenth of what was promised, and each launch cost nearly a hundred times the original projection. Hilariously, President Obama is now being criticized for ending this, even though it was collapsing from its own weight and consisted mainly of workfare jobs in Republican congressional districts.
  3. Notwithstanding phenomena like the above, the United States is probably the most successful large-population country in the world due to its sheer realism, in particular the relative openness and process orientation of English common law, which (to quote myself) “rather than construct elegant theories and then shoehorn (or bludgeon) societies into an unchanging mold,” exhibits “a willingness to work with the world and human nature as it is.”
  4. Even ignoring the fantastic technological advances, quality of life in the US has improved immensely in the past two decades. Social pathologies have plummeted. The rates of some categories of crime are down 90%, to all-time recorded lows. There are now fewer abortions per capita than at the time of Roe v Wade. Probably three-quarters of Americans live in neighborhoods where violent crime is effectively nonexistent. And the worst labor market in 80 years has done nothing to reverse these trends.
  5. Large-scale, institutionalized technologies range from the very safe (electric-power generation [including nuclear] and transmission) to the so-safe-there-is-no-instance-of-recorded-harm (agricultural genetic engineering). The problem is that in much of the real (that is, Third) world, they are insufficiently available to provide the thoughtless, comfortable existence that pervades most of the West. Living “off the grid” / following a soidisant “natural” lifestyle is a plaything of rich people who can slink away into town whenever they get tired of hewing wood and drawing water. Especially water with enterotoxigenic E. coli in it.
  6. Pharmaceutical companies are not trying to kill you, nor to provoke health crises to sell new drugs. They may in some instances be trying to convince you that your life depends on continuing to purchase their products, whether it actually does or not. Then again, so is the “health food” store down the street, and in all likelihood, what it’s pushing is far more dangerous.
  7. All religions are not equal. The general heuristic is to judge them by their effects, or at least by their efforts. Those prescribing global expansion through conquest and coercive displacement, and those (especially if they don’t refer to themselves as religions) prescribing the extermination of followers of other religions, are particularly problematic.
  8. Any conspiracy theory that mentions the Mossad, Rothschilds, etc, is every bit as viciously anti-Semitic as Mein Kampf and should be treated as such. Anyone expressing admiration for Marxist notions and personages is no better. Conspiracy theories involving the CIA quaintly ignore the NSA (which is ~6x larger) and, in any case, descend from Stalinist and Maoist propaganda during the early Cold War and the Korean War. Facile anger about the NSA, however, ignores its well-publicized activities with the analog wireline telecommunications of 30-40 years ago, as amply documented in Bamford’s The Puzzle Palace. The phenomena of Wikileaks and Snowden’s massive data theft are an existence proof that such activities can neither be kept secret nor have much influence on real-world events; as someone who read through the supposedly devastating Wikileaks cables remarked, “[American diplomats] sound like Canadians with better access.”
  9. No amount of “smart diplomacy” or supposed avoidance of provocation will protect a country from attack. Only a convincing ability to make an attack more trouble than it could possibly be worth can do that, and even such an ability may be insufficient to deter non-state actors and small groups. In combination with steadily declining costs of dual-use technologies, a more-or-less freelance WMD attack somewhere in the world seems inevitable. When it occurs, the greatest hazards to the immediate survivors will be 1) official overreaction, as by ordering the evacuation of a far larger area than was actually affected and 2) popular derangement, which in the worst-case scenario may create a conspiracy theory popular enough to put an extremist political movement in power, even in a large, democratic nation.

Commenters are encouraged to provide additional examples and corollaries.

Thoughts on Leadership and Command, From Two Writers and a General

In my review of The Caine Mutiny, I mentioned that the happy-go-lucky protagonist, Willie, eventually becomes a captain, and apparently a good one, too:

Even at anchor, on an idle, forgotten old ship, Willie experienced the strange sensations of the first days of a new captain: a shrinking of his personal identity, and a stretching out of his nerve ends to all the spaces and machinery of his ship.  He developed the apprehensive listening ears of a young mother; the ears listened in on his sleep; he never quite slept, not the way he had before.  He had the sense of having been reduced from an individual to a sort of brain of a composite animal, the crew and ship combined.

Achieving this sort of “feel” for an organization is of course far simpler when the organization consists of a fairly small number of people, like the crew of a destroyer-minesweeper or a very-early-stage startup.  But it is challenging even in these circumstances, and many leaders of modest-sized organizations never really accomplish “a stretching out of their nerve ends” to all aspects of the organization.  When the organization is very large and complex–too many people to ever meet personally, many geographical locations, a range of activities beyond the detailed comprehension of any one human mind–achieving a true sense of what is going on is much harder–it is to a substantial extent a matter of creating effective organization structures, choosing the right subordinate leaders, and establishing measurement and incentive systems which tend toward encouraging useful behavior rather than useless or damaging behavior…in addition to personal attributes such as curiosity, realistic sense of life, and ability to learn and to listen.

Whether the organization be large or small, the leader is far more likely to achieve the kind of depth understanding that Wouk describes if he has a strong sense of personal responsibility and interest in the organization, its people, and its mission.  I’m reminded of some thoughts expressed by General William Slim, who commanded British and allied forces in Burma during WWII, following his defeat by the Japanese:

The only test of generalship is success, and I had succeeded in nothing that I had attempted…Defeat is bitter. Bitter to the common soldier, but trebly bitter to his general. The soldier may comfort himself with the thought that, whatever the result, he has done his duty faithfully and steadfastly, but the commander has failed in  his  duty if he has not won victory–for that  is  his duty. He has no other comparable to it. He will go over in his mind the events of the campaign. ‘Here,’ he will think, ‘I went wrong; here I took counsel of my fears when I should have been bold; there I should have waited to gather strength, not struck piecemeal; at such a moment I failed to grasp opportunity when it was presented to me.’ He will remember the soldiers whom he sent into the attack that failed and who did not come back. he will recall the look in the eyes of men who trusted him. ‘I have failed them,’ he will say to himself, ‘and failed my country!’ He will see himself for what he is–a defeated general. In a dark hour he will turn on himself and question the very foundations of his leadership and his manhood.  

And then he must stop! For, if he is ever to command in battle again, he must shake off these regrets and stamp on them, as they claw at his will and his self-confidence. He must beat off these atacks he delivers against himself, and cast out the doubts born of failure. Forget them, and remember only the lessons to be learnt from defeat–they are more than from victory.

Read more