25 January, 2014

How to Be Buddy-Buddy With an Guerilla General

  Far Eastern Economic Review (2 August 1997)
with Thayer's investigative work featured as its cover story.

Image Credit: Wikimedia

If you read one thing this weekend, this should be it.

Nate Thayer was the Far Eastern and Economic Review's man on the ground in Cambodia for most of the 1990s. One of his editors at the Review described his achievements in the following terms:
"Nate broke the story in 1997 that Cambodia’s ex-dictator, Pol Pot, was still alive and had been purged from the Khmer Rouge. He followed up a few months later with the first interview with Pol Pot in 18 years, shedding light on how utopian leftism translated to genocide back in Cambodia.... In an era of instant communication, when scoops are matched in hours and sometimes minutes, the Pol Pot stories went unmatched for months. That’s because Nate had spent years developing contacts within the Khmer Rouge, Thai intelligence, and elsewhere to gain this access" [1]

 Mr. Thayer is currently writing a book that tells how he was able to build a network of contacts in an insurgent controlled jungle and gain the trust of the Khmer Rouge's top leaders. This week he published a meaty excerpt from his truly remarkable story:
"....Secretly, General Nuon came to my house in Bangkok scores of times, accompanied by Thai military intelligence escorts and handlers in unmarked pickup trucks who would lurk around my garden while Nuon drank hot tea with lots of sugar and peppered me with questions from politics to popular culture into the night. Sometimes, the Thais would get nervous and balk at his meetings with me and forbid him to come to my house. Nuon relished in giving them the slip from his Thai military safe house, where he stayed in Bangkok, and sneak over to my place in a taxi. Other times, he would call me and say it was urgent that I make my way to the Khmer Rouge jungle headquarters at Anlong Veng, or some obscure rural noodle shop in a remote Thai border village. There he would seek advice whether some political or military strategy the Khmer Rouge leadership were considering would be prudent or effective. Over time, I became General Nuon’s filter to explain how the world outside the jungles worked, which was critical to the new mission that Ta Mok had bequeathed him: to figure out how to salvage the remnants of the Khmer Rouge movement by establishing relations with an outside world that they had totally cut off for decades....

This gave me unprecedented access to Pol Pot until the day he died. I literally knew what Pol Pot ate for breakfast each day, what his mood was, what was the content of the conversations he had with his wife and daughter, and who visited him. “How is the old man today?” I would ask Nuon during his daily calls to check in. No names were ever used in these telephone conversations as we both knew they were monitored by more than one government, and Nuon would recount the minutia of the mundane existence that were the final weeks and months of one of the centuries most egregious mass murderers, Pol Pot." [2]

Mr. Thayer's account is not only a fascinating look at the nature of insurgencies, intelligence work, and investigative reporting, but also a pleasure to read. I strongly recommend that visitors to the Stage read it in its entirety.


[1] Andrew Sherry, quoted in "Selected Reviews and Commentary on Nate Thayer," ed. Nate Thayer.

[2] Nate Thayer. "How the U.S. Dropped the Ball When Offered to Bring Pol Pot to Trial For Mass Murder." 24 January 2013. Quoted with permission from author.

18 January, 2014

The Limits of Expertise

Scott Reinhard, Expert Button (February 2010). Print at Scott Reinhard Co.
Image source.

Last month Tom Nichols, professor of national security affairs at the U.S. Naval War College  and a well regarded authority on Russian foreign policy and American nuclear strategy, published a thought-provoking essay on his blog titled "The Death of Expertise:"
...I wonder if we are witnessing the “death of expertise:” a Google-fueled, Wikipedia-based, blog-sodden collapse of any division between students and teachers, knowers and wonderers, or even between those of any achievement in an area and those with none at all.
By this, I do not mean the death of actual expertise, the knowledge of specific things that sets some people apart from others in various areas. There will always be doctors, lawyers, engineers, and other specialists in various fields.
Rather, what I fear has died is any acknowledgement of expertise as anything that should alter our thoughts or change the way we live. A fair number of Americans now seem to reject the notion that one person is more likely to be right about something, due to education, experience, or other attributes of achievement, than any other.
Indeed, to a certain segment of the American public, the idea that one person knows more than another person is an appalling thought, and perhaps even a not-too-subtle attempt to put down one’s fellow citizen. It’s certainly thought to be rude: to judge from social media and op-eds, the claim of expertise — and especially any claim that expertise should guide the outcome of a disagreement — is now considered by many people to be worse than a direct personal insult.
This is a very bad thing. Yes, it’s true that experts can make mistakes, as disasters from thalidomide to the Challenger explosion tragically remind us. But mostly, experts have a pretty good batting average compared to laymen: doctors, whatever their errors, seem to do better with most illnesses than faith healers or your Aunt Ginny and her special chicken gut poultice. To reject the notion of expertise, and to replace it with a sanctimonious insistence that every person has a right to his or her own opinion, is just plain silly. (emphasis added) [1]
I encourage visitors to the Stage to read Dr. Nichol's entire piece. It was prompted by what has become a common experience every time he (or fellow UNWC professor and former NSA employee John Schindler) decides to publish a new essay or speak publicly about a pressing issue of the day. Soon after his work is published a flood of acrimonious tweets and e-mails follow, declaring that he does not really understand how American intelligence agencies, the Kremlin, or the Obama administration actually work

Most of these responses are misinformed. Many are simply rude and mean. They are not an impressive example of what laymen commentators can add to America's political discourse. Dr. Nichols suggests four rules of thumb for engaged citizens that he believes would improve matters:

1.The expert isn’t always right.
2. But an expert is far more likely to be right than you are.
3. Your political opinions have value in terms of what you want to see happen, how you view justice and right. Your political analysis as a layman has far less value, and probably isn’t — indeed, almost certainly isn’t — as good as you think it is.
4. On a question of factual interpretation or evaluation, the expert’s view is likely to be better-informed than yours. At that point, you’re best served by listening, not carping and arguing. [2]


The trouble with this advice is that there are plenty of perfectly rational reasons to distrust those with political expertise. Mr. Nichol's wiser readers, for example, may have heard of the research conducted by Philip Tetlock, presented most compellingly in his 2005 book, Expert Political Judgement: How Good is it? How Can We Know?. Louis Menard describes the results of Dr. Tetlock's research program in a book review for the  New Yorker: 
"Tetlock is a psychologist—he teaches at Berkeley—and his conclusions are based on a long-term study that he began twenty years ago. He picked two hundred and eighty-four people who made their living “commenting or offering advice on political and economic trends,” and he started asking them to assess the probability that various things would or would not come to pass, both in the areas of the world in which they specialized and in areas about which they were not expert. Would there be a nonviolent end to apartheid in South Africa? Would Gorbachev be ousted in a coup? Would the United States go to war in the Persian Gulf? Would Canada disintegrate? (Many experts believed that it would, on the ground that Quebec would succeed in seceding.) And so on. By the end of the study, in 2003, the experts had made 82,361 forecasts. Tetlock also asked questions designed to determine how they reached their judgments, how they reacted when their predictions proved to be wrong, how they evaluated new information that did not support their views, and how they assessed the probability that rival theories and predictions were accurate."[3]
Tetlock's experts came from all sorts of backgrounds: included were media personalities, tenured academics, professional analysts in Washington think tanks, and employees of numerous government agencies (including those with access to classified materials). A wide range of political beliefs and styles of analysis were also included: the study included both registered Republicans and Democrats, Austrian economists and their Keynesian counterparts, specialists in game theory, realist IR, area studies, and every other analytic model that gained popularity during the test period. What were the results of their 82,000 predictions?
"The results were unimpressive. On the first scale, the experts performed worse than they would have if they had simply assigned an equal probability to all three outcomes—if they had given each possible future a thirty-three-per-cent chance of occurring. Human beings who spend their lives studying the state of the world, in other words, are poorer forecasters than dart-throwing monkeys, who would have distributed their picks evenly over the three choices.

Tetlock also found that specialists are not significantly more reliable than non-specialists in guessing what is going to happen in the region they study. Knowing a little might make someone a more reliable forecaster, but Tetlock found that knowing a lot can actually make a person less reliable. “We reach the point of diminishing marginal predictive returns for knowledge disconcertingly quickly,” he reports. “In this age of academic hyperspecialization, there is no reason for supposing that contributors to top journals—distinguished political scientists, area study specialists, economists, and so on—are any better than journalists or attentive readers of the New York Times in ‘reading’ emerging situations.” And the more famous the forecaster the more overblown the forecasts. “Experts in demand,” Tetlock says, “were more overconfident than their colleagues who eked out existences far from the limelight.... The expert also suffers from knowing too much: the more facts an expert has, the more information is available to be enlisted in support of his or her pet theories, and the more chains of causation he or she can find beguiling. This helps explain why specialists fail to outguess non-specialists. The odds tend to be with the obvious" (emphasis added). [4]
In other words, the expert is not more likely to be right than you are! Rigorous examination of actual expert track records show the opposite to be true: the more famous, confident, and specialized an expert is, the less accurate their political judgments tend to be. It turns out what an expert truly excels at is explaining away his or her own horrible record. Dr. Tetlock describes what happened at the end of the study when participants were asked to explain their errors:
"When  we recontacted experts to gauge their reactions to confirmation or disconfirmation of their predictions, we frequently ran into a awkward problem. Our records of the probability judgements made at the beginning of the forcast periods often disagreed with experts recollections of what they predicted. Experts claimed that they assigned higher probabilities to outcomes that materialized than they did. From a narrowly Bayesian perspective, this 20/20 hindsight  effect was a methodological nuisance: it is hard to ask someone why they got it wrong when the think it is right. But from a psychological perspective the hindsight effect is intriguing in its own right... , so we decided in six cases, to ask experts to recollect their positions prior to receiving the reminder from our records. When we asked experts to recall their original likelihood judgments, experts, especially hedgehogs, often claimed that they attached higher probabilities to what subsequently happened than they did.... Experts [also] shortchanged competition. When experts recalled the probabilities they once thought their most influential rivals would assign t the future that materialized, they imputed lower probabilities after the fact than before he fact. In effect, experts displayed both the classic hindsight effect (claiming more credit for predicting the future than they deserved) and the mirror image effect (giving less credit to their opponents for anticipating the future they deserved.)" [5]
When confronted with these truths very few experts would admit that their reasoning or their methods were wrong. Instead they would create elaborate justifications for each failed prediction, claiming that their predictions were "almost right," that events had truly been "close calls," or that their prediction was only thrown off by some "out of the blue" or "fluke" occurrence no one could have seen coming. Each failed prediction was successfully turned into a compelling story that not only justified the expert's failures but made things seem as if they and their methods had been right all along.

Mr. Tetlock's research deserves to be better known than it is. In addition to Louis Menard's review in the New Yorker excerpted above, interested readers are encouraged to read the CATO Unbound issue devoted to the book, view Tetlock's hour long presentation for the Long Now Foundation, or purchase the book itself. It is difficult to delve into his work and think about experts the same way again.

Of course, Mr. Tetlock is not the only person to put our faith in expertise to question. The last decade has seen a general assault on the role of experts in a wide variety of fields: research by John Ioannis has shown that much of--if not most of--the medical findings published every year are false, and Daniele Fanelli has used similar methods to critique scientific research as a whole. [6] Doctors like Ben Goldcare and Adrian Fugh-Berman have shown how expert medical practitioners are often influenced by both common human biases and industry connections to prescribe treatments not in their patients best interests.[7] Popular public intellectual Nassim Nicholas Taleb made his claim to fame tearing down the models and methods of Wall Street's top financial experts, maintaining that all narratives used by experts to explain the world are post-hoc constructions used to hide their own lack of knowledge. [8]  James C Scott has shown how, despite any amount of study, training, or advance knowledge managers are given, the complexity of the systems expert bureaucrats are asked to manage are often beyond understanding, and attempts to merely comprehend (much less manage) these stewardship are doomed to distort and weaken them. [9]

This list is not comprehensive: it is limited to a few of the more stunning examples that have emerged over the last decade (and does not include all of those). But in many ways this is a very old critique. Men like Friedrich Hayek [10], Hermann Kahn [11], and Paul Meehl [12] made similar points (or in Meehl's case, conducted similar studies) decades ago. Their skepticism has deep roots in Western culture; the Western tradition of free inquiry began with a man condemned to death for exposing how little his society's elites actually knew. [13] Thoughtful people have been rejecting expert opinion for two millenia. 


All of this leaves us with an important question: if experts are no better at making sense of the world than the rest of us, what are they good for?

While this post has expressed some hostility towards expert judgment, I am not an intellectual Jacobin intent upon getting rid of our experts altogether. The best evidence suggests that there is a valuable role experts can play. Indeed, some expertise does not need to be questioned at all. In their review of recent research on expert intuition, psychologists Daniel Kahneman and Gary Klein summarize the findings of James Shanteau's "cross-domain" study of expert performance:
"The importance of predictable environments and opportunities to learn them was apparent in an early review of professions in which expertise develops. Shanteau (1992) reviewed evidence showing that [real, measurable] expertise was found in livestock judges, astronomers, test pilots, soil judges, chess masters, physicists, mathematicians, accountants, grain inspectors, photo interpreters, and insurance analysts. In contrast, Shanteau noted poor performance by experienced professionals in another large set of occupations: stockbrokers, clinical psychologists, psychiatrists, college admissions officers, court judges, personnel selectors, and intelligence analysts." [14]
Mr. Kahneman and Klein conclude that an expert's judgement is most valuable in predictable environments whose patterns can be recognized, memorized, and then internalized. They call these "high validity" domains:
"Validity, as we use the term, describes the causal and statistical structure of the relevant environment. For example, it is very likely that there are early indications that a building is about to collapse in a fire or that an infant will soon show obvious symptoms of infection.... In contrast, outcomes are effectively unpredictable in zero-validity environments. To a good approximation, predictions of the future value of individual stocks and long-term forecasts of political events are made in a zero-validity environment....Validity and uncertainty are not incompatible. Some environments are both highly valid and substantially uncertain. Poker and warfare are examples. The best moves in such situations reliably increase the potential for success."  [15]
Alas, "zero-validity environments" are exactly the kind environments at the heart of this discussion with. Zero validity environments tend to fall into two categories:
 1) Environments whose size or complexity make it impossible for experts to recognize the patterns or relationships they need to understand in order to make valid judgements about the system (such as faced by economists, ecologists, and financial analysts).

2) Environments where experts must evaluate behaviors, attitudes, past history, and other personal idiosyncrasies to try and explain why individuals act as they do or how they will act in the future (such as faced by psychiatrists, college admissions officers, and court judges).

"Political analysis," which usually attempts to explain how statesmen, politicians, soldiers, or other political actors will respond to or instigate changes in world affairs, the electoral arena, battlefields, or some other political environment, falls into both categories! The expert political analyst is expected to create a reliable psychological portrait of key decision makers and understand the the numerous contingencies and complexities of the environment in which these decisions makers work. Unfortunately for the expert, this task lies beyond the limits of human cognition.  No human, no matter how learned, experienced, or credentialed, can overcome them.

This seems pretty dismal, but as I suggested earlier, our experts need not lose hope. Their advanced degrees were not attained in vain. Too many have simply been proclaiming their expertise in the wrong subjects. Experts have no advantage over the average reader of the New York Times when it comes to political judgements. They are no better--and sometimes worse--at predicting political outcomes, weighing the relative importance of events, or identifying cause and effect relationships than the rest of us. But analyst experts do have a significant advantage over the layman analyst in one domain: they know so much more. Experts can contribute a great deal to the conversation simply by telling us what they know.

An easy way to distinguish the difference between these two types of expertise is to think in terms of what and why.  Experts are at their best when they explain the "what" of the systems they have spent so much time studying. This kind of expertise is about knowledge, not judgment or analysis; its explanations are not prescriptive or predictive, but descriptive. They focus on confirming disputed facts and explaining the significance of details that layman observers do not have the knowledge to properly understand or recognize. Their job is to find the truth and make it known.

This task is far more important than it initially seems. Consider the 'red-line' kerfuffle that made headlines back in September. Several weeks before serin filled munitions were launched into a suburb outside of Damascus called Ghouta. The President of the United States had previously declared that if the Assad Regime used chemical weapons then the United States would intervene in the conflict. The world was left with a question: were these weapons launched by the Syrian Army or one of the groups opposing it?

In those days opinions on the subject flew off the presses. Most of this was political analysis par excellence--lots of talk about the various groups' "motives" or "credibility," and the "political logic" of the situation. But as the literature reviewed above suggests, once a certain level of quality was reached, none of these analyses were more reliable than the others. We had ran straight into the limits of human political judgment.

Fortunately, there was a more promising route to answering the question at hand. At the time I was closely following Eliot Higgins's Brown Moses Blog. Mr. Higgins, now recognized as an expert in the munitions used in the Syrian war [16],  put together all of the videos and pictures he could get that were in some way tied to the scene of the attacks and compared them to other munitions used in the conflict. His careful reconstruction both identified the exact munitions used in the attack and linked them to artillery and munitions used by Assad's regime.

Mr. Higgins here accomplished something only an expert could. The number of Americans who have the background knowledge necessary to identify and distinguish the dozens of munitions used by Syrian militias is limited to a few dozen experts. These men have a true "expert's advantage" that comes from gaining specialized knowledge in the what of an issue.

This advantage is not limited to the world of material objects. A recent post at Andrew Chubb's website is an excellent example of how expertise can be properly applied to human subjects. The question at hand: to what extant do the views articulated by vocal PLA 'hawks' like Luo Yuan, Dai Xu, and Zhang Zhaozhang  represent the upper levels of the People's Liberation Army as a whole? (I encourage those interesting in following this debate in full to read Mr. Chubb's original essays for the Jamestown Foundation's China Brief, a more recent review essay by Yawei Liu and Justine Zheng Ren for for the Journal of Contemporary China, and Chubb's response to this essay at South Sea Conversations). This is essentially a debate about a fairly narrow "what": what are the past and current institutional roles of the hawks? Are they in a position to know and articulate PLA strategic doctrine? [17]

As with the munitions in Syria, analysts who approach this question need a thorough command of things not commonly known: the structure of the PLA, the biographies of the officers in question, PLA-media relations procedure, and the ability to recognize those damn Chinese characters used in all of those press releases and interviews. Only those with a high level of expertise can even participate in this debate. Those of us who lack this knowledge  are well advised to take Dr. Nichols's advice to stop our "carping" and listen to what these folks have to say.


One suspects that the unpolished masses who flood Dr. Nichol's and Schindler's inboxes with insults and assertions do not do so because they have been reading Philip Tetlock's most recent research. While we have reviewed plenty of compelling evidence that experts and expert claims should be viewed with skepticism, the great majority of this research is unknown among even the more educated sections of the body politic.  What accounts for this widespread hostility towards expertise?

Dr. Nichols suggests the following:
Some of it is purely due to the globalization of communication. There are no longer any gatekeepers: the journals and op-ed pages that were once strictly edited have been drowned under the weight of self-publishable blogs (like, say, this one). There was once a time when participation in public debate required submission of a letter or an article, and that submission had to be written intelligently, pass editorial review, and stand with the author’s name and credentials attached. Even then, it was a big deal to get a letter in a major newspaper.
Now, anyone can crowd the comments section of any major publication with inane blather. We live in a huge high school boys’ room, where anyone with a marker can write anything on the wall. Sometimes, that kind of free-for-all spurs good thinking. Most of the time, it just means people can post anything they want, under any anonymous cover, and never have to defend their views or get called out for being wrong.
Another reason for the collapse of expertise lies not with the global commons but with the increasingly partisan nature of U.S. political campaigns. There was once a time when presidents would win elections and then scour universities and think-tanks for a brain trust; that’s how Henry Kissinger, Samuel Huntington, Zbigniew Brzezinski and others ended up in government service while moving between places like Harvard and Columbia.
...I also would argue that colleges have to own some of this mess. The idea of telling students that professors run the show and know better than they do strikes many students as something like uppity lip from the help, and so many profs don’t do it. Many colleges are boutiques, in which the professors are expected to be something like intellectual valets. This produces nothing but a delusion of intellectual adequacy in children who should be instructed, not catered to.

...Finally, the root of this collapse of standards lies in our manic reinterpretation of “democracy,” in which everyone must have their say, and it must not be, er, disrespected. (The verb to disrespect is one of the most obnoxious and insidious innovations in our language in years, because it really means “to fail to pay me the impossibly high requirement of respect I demand.”) [18]
All of these things may have an influence on current attitudes towards experts and educated expertise. [19] But I think Nichols has missed an important ingredient--perhaps the most important ingredient--of the hostility he and his compatriots receive.

To get a sense for what is missing from his explanation, please consider the following:

Reported Trust in Government since 1950s.

Figure 2 from Doug Sosnik, "What Side of the Barricade are You On?", Politico, 25 November 2013.
The American Public's Confidence in Assorted Public Institutions

Figure 3 from Doug Sosnik, "What Side of the Barricade are You On?", Politico, 25 November 2013.

These two images were originally presented in an astute essay that political strategist Doug Sosnik wrote for Politico. These are just two of the many data points Sosnik uses to capture the sense of alienation and outrage the American public feels towards their leaders. The picture is pretty clear: Americans do not just doubt their experts. They doubt every institution American society has invested with authority! This crises in public confidence is a storm no authority figure can run away from, experts included.

It is not difficult to understand how experts are caught up in this great swell of hostility towards American elites. "Our Republic", the narrative goes, "wasted a decade fighting wars our experts claimed would be done and over with in a few years. We still haven't picked ourselves up from a recession these experts did not see coming. Why should we trust another expert again?"

It is unfair to blame all of America's ills (or even the specific ones mentioned above) on our hapless experts. But the truthfulness of the narrative is irrelevant. What matters is how people who live far away from the ivory towers and government offices see the experts who dwell there. And in in this kind of political climate the experts who craft political analysis defending the powers that be should not be surprised when they are met with  unrestrained hostility and extreme skepticism. It is the cost of claiming expertise.     

Doug Sosnik does a fair job describing the new environment  that all people who claim some special authority their fellow citizens lack now find themselves:

"Americans’ long-brewing discontent shows clear signs of reaching a boiling point. And when it happens, the country will judge its politicians through a new filter—one that asks, “Which side of the barricade are you on? Is it the side of the out-of-touch political class that clings to the status quo by protecting those at the top and their own political agendas, or is it the side that is fighting for the kind of change that will make the government work for the people—all the people?[19]

It is not just the politicians that will be forced through the grinder. Everybody who talks politics or claims a position of special authority is going to be, or is already, facing this scrutiny. People are wondering what side of the barricade America's credentialed class of experts belong.


[1] Tom Nichols. "The Death of Expertise." The War Room (11 December 2013). 

[2] Ibid.

[3] Louis Menard. "Everybody's an Expert: Putting Political Expertise to the Test." The New Yorker (5 December 2013).

[4] Ibid.

[5] Philip Tetlock. Expert Political Judgement: How Good is it? How Can We Know? (Princeton: Princeton University Press, 2005). pp. 137-138

[6] The key articles are John Iodannis, "Why Most Published Medical Research is False," PLOS Medicine (30 August 2005); John Iodannis, et. al, "Persistence of Contradicted Claims in the Literature," Journal of American Medical Association, Vol 298, No 21 (5 December 2007); Danielle Fanelli, "How Many Scientists Falsify and Fabricate Research? A Systematic Review and Meta Analysis of Survey Data," PLOS One (29 May 2009); "'Positive' Results Increase Down the Hierarchy of Science," PLOS One (7 April 2010). 

 I strongly recommend those unfamiliar with this line of research read David Freeman's review essay for the Atlantic, "Lies, Damned Lies, and Medical Science" (4 October 2010).

[7] Ben Goldcare, "What Doctors Do Not Know About the Drugs They Proscribe," presentation given at TED Med 2012 (June 2012, pub. Sep 2012); Adriane Fugh-Berman and Shahram Ahar, "Following the Script: How Drug Reps Make Friends and Influence Doctors," PLOS Medicine (24 April 2007). 

 [8] Nassim Nicholas Taleb,  The Black Swan: The Impact of the Highly Imporbable. Rev. ed. (New York: Penguin Books, 2010). pp. 145-151.

[9] While James C. Scott's books and articles are legion, I believe  that his essay, "The Problem With the View From Above," CATO Unbound (8 September 2010), is the best introduction to his work on this topic. 

[10] Friedrich Hayek, "The Uses of Knowledge in Society," American Economic Review. Vol. XXXV, No. 4(Sep 1945). pp. 519-30. American Economic Association. 

[11]  Herman Kahn, "The Expert and Educated Incapacity" in World Economic Development: 1979 and Beyond, (Boulder, CO: Westview Press, 1979). pp. 482-484

[12] William M. Grove, "Clinical vs. Statistical Prediction: The Contributions of Paul E. Meehl," Journal of Clinical Psychology, Vol. 61, No. 10 (2005), pp. 1233–124.

[13] Plato, Apologia, 21.c-23.b

[14] Daniel Kahneman and Gary Klein, "Conditions for Intuitive Expertise: A Failure To Disagree," American Psychologist, vol 64, No. 6 (September 2009), p. 522.

[15] Ibid., p. 520, 524.

[16] I should note Mr. Higgins is a new entrant to the world of the expert, having no credentials beyond the incredible work he does. By some definitions he does not count. But most folks in the field seem to think he does. Both the New Yorker and the Huffington Post have published essays on this man and his remarkable methods that may profit those who have never heard of him:

 Bianca Bosker, "Inside the One Man Intelligence Unit That Exposed the Secrets and Atrocities of the Syria War,"  The Huffington Post (18 November 2013); Patrick Raden keefe, "Rocket Man: How An Unemployed Blogger Confirmed Syria Used Chemical Weapons," The New Yorker (25 November 2013).

[17] The full citations for the articles discussed are: Andrew Chubb, "Propaganda as Policy? Explaining the PLA's "Hawkish" Faction, pt 1" The China Brief: A Journal of Analysis and Information, Vol XIII, Issue 15 (26 July 2013), pp. 6-11;  "Propaganda as Policy? Explaining the PLA's "Hawkish" Faction, pt 2" The China Brief: A Journal of Analysis and Information, Vol XIII, Issue 16 (9 August 2013), pp. 12-16; Yawei Liu and Justine Zhang Ren, "An Emerging Consensus on the U.S. Threat: The United States According to PLA Officers," Journal of Contemporary China (19 November 2013); Andrew Chubb, "Are China's hawks actually the PLA after all? [Revised]," South Sea Conversations (or. pub 5 December 2013, rev. 17 December 2013).

[18] Tom Nichols, "The Death of Expertise."

[19] The only one of his proposed explanations I outright disagree with is the 'manic reinterpretation of democracy' he speaks of. I find this view of the matter quite peculiar; familiarity with American political history and American political discourse suggests that this is not a reinterpretation of democracy's meaning but a restoration of what the word meant for majority of this Republic's history. The move towards expert empowerment (and the deference to expertise that went along with it) is a relic of the Efficiency movement and other reformer 'movements' of the Progressive Era. Tocqueville captured the mood of the nation before those movements:
“As for the effect which one man’s intellect can have upon another’s, it is of necessity much curtailed in a country where its citizens, having become almost like each other, scrutinize each other carefully and, perceiving in not a single person in their midst any signs of undeniable greatness or superiority, constantly return to their own rationality as to the most obvious and immediate source of truth. So, it is not merely trust in any particular individual which is destroyed, but also the predilection to take the word of any man at all.
Each man thus retreats into himself where he claims to judge the world" 
-Alexis de Tocqueville, Democracy in America and Two Essays on America, trans Gerald Bevan (New York: penguin Books, 2003), p.494. See also pp. 493-503 generally.

This does not sound unlike the very attitudes that prompted Dr. Nichols to write his essay.

The men of 1834 and 2014, of course, are not quite the same.  Every man should be an expert of his own community. The average antebellum man had a great deal of control over the political realities most important to his well being. The average American of the 21st century cannot claim the same. 

[20] Doug Sosnik, "What Side of the Barricade are You On?", Politico (25 November 2013).

08 January, 2014

America Makes You Violent

Late last year Social Psychiatry and Psychiatric Epidemiology published a study titled "The Immigrant Paradox: Immigrants are Less Antisocial Than Native Born Americans." Given how closely certain sections of the blogosphere cover all things ethnic I was a tad surprised to find that no one has been talking about this paper and its conclusions. This is a shame, because the results are pretty interesting.

The researchers set out to answer a fairly simple question: are immigrants more or less prone to violent, criminal, or "antisocial" behaviors than native born Americans? Using the data collected by the National Epidemiologic Survey on Alcohol and Related Conditions interviews they were able to get a sample size large enough to answer their question. Here are their results displayed in graphic format:

As the figure suggests, our researchers found that:
 "Across the board, the prevalence of antisocial behavior among native-born Americans was greater than that of immigrants. Particularly large differences were observed in terms of involvement in behaviors that could easily hurt oneself/others, truancy, staying out late without permission from one’s parents, quitting a job without having other options, shoplifting, and taking part in illegal behaviors that could get one arrested." [1]

While the few media pieces that show cased the study described it as turning "traditional theories on its head" [2], these results should not come as a surprise to those who have followed this issue closely. Over the last decade a host of studies have shown that Hispanic immigrants are less violent than the American whites and substantially less violent than the American blacks who share their income bracket [3]. But this study does not limit itself to analysis of Hispanic immigrants:

Africans, it seems, are the most pro-social immigrants in America!

The most intriguing aspect of this study, however, barely made the press reports. To quote:
"In these analyses, we wanted to examine whether the age of immigration altered the relationship between immigrant status and nonviolent and violent antisocial behavior. We contrasted these relationships among individuals who had immigrated before the age of 13 and after the age of 13. Controlling for all the same factors presented in our main findings, immigrants who came to the United States at the age of 12 or younger were significantly more likely to report involvement in at least one of the violent (AOR=2.01, 95 % CI=1.87–2.15) or nonviolent (AOR=1.80, 95 % CI=1.71–1.89) antisocial behaviors as compared with immigrants who arrived at the age of 13 or older. However, when compared to native-born Americans, immigrants who arrived as children or arrived at the age of 13 or older are still significantly less likely to take part in violent and nonviolent antisocial behavior than Native-born Americans, though the latter group begins to somewhat resemble the native-born behaviorally. Finally, for all immigrants regardless of age, we estimated what each year in the US translates to with respect to an increased probability of reporting an  antisocial act. Results showed that each additional year an immigrant has lived in the United States is associated with a 1.9 % increase in the likelihood of violence and a 0.9 % increase in the likelihood of nonviolent antisociality." [4]
In other words, immigrants are not making America a more criminal place. America makes her immigrants become more criminal people! 

It is not uncommon for conservatives to bewail the many immigrants America has who have not properly assimilated into broader American culture. These concerns are not without merit. Yet when I think about assimilation my thoughts usually dwell upon on a slightly different problem. I remember well the many immigrant families I worked and lived with when I was a LDS missionary tramping across America's urban ghettos. So many immigrant mothers and fathers would let us in the door because they were worried about their children. They felt like their families were being torn apart, parents and children living in completely different worlds--and reflecting upon it now, it is not difficult to see why they felt this way.  Particularly striking were the Haitian families whose parents took pride in their educated French but whose children could only speak the English of the ghetto.

Perhaps we should be less concerned with whether immigrants can assimilate into American culture and more concerned with which American culture immigrants are assimilating into.

EDIT (8 Jan 2013): see also Tyler Cohen's recent post on 'downward assimilation' among African immigrants for more research that echoes these themes.


[1] Michael G. Vaughn, Christopher P. Salas-Wright, Matt DeLisi, and Brandy R. Maynard. "The immigrant paradox: immigrants are less antisocial than native-born Americans." Social Psychiatry and Psychiatric Epidemiology. Vol. 48, Issue 11. 17 November 2013. p. 3.

[2] Emily Alpert Reyes, "Immigrants less prone to violence, 'antisocial' behavior, study says," Los Angles Times. 3 December 2013.

[3] For example: Matthew T. Lee and Ramiro Martinez, "Immigration reduces crime: an emerging scholarly consensus" in William F. Mcdonald (ed.) Immigration, Crime and Justice (Sociology of Crime Law and Deviance, Volume 13), (Bingely: Emerald Group Publishing Limited 2009), pp. 3-16; Casey T. Harris and Ben Feldmeyer, "Latino immigration and White, Black, and Latino violent crime: A comparison of traditional and non-traditional immigrant destinations," Social Science Research, Vol. 42, Issue 1(Jan 2013), pp. 202–216; Ron Unz, "Race and Crime in America," The American Conservative. 20 July 2013.

[4] Michael G. Vaughn, et. al., "The immigrant paradox," p. 7.

02 January, 2014

I'm From Princeton, and I'm Here to Help!

I found myself immensely entertained with Faine Green's cartoon caricature of the young, progressive Ivy League graduate who arrives in Cambodia ready to save the world (and look good doing it). The caricature is smartly captioned:

"She graduated from Princeton on a mission: a mission to save the world. Preferably with microcredit and hugs, and lots of selfies with poor children who live on trash heaps." [1]

Faine Opines. 2 January 2014.

While funny, the Ivy League lament that "I should have gone into finance" is no joke.  In her ethnography of investment finance Karen Ho reports that 40% of all Princeton undergrads went to work on Wall Street after graduation. [2] The young globe trotting do-gooder caricatured here is in a definite minority. Indeed, it might do America good if more of our Princeton t-shirt donning 20-somethings ended up in hot places where they will hate the food, have their bike stolen (despite buying that iron padlock), and will spend more uncomfortable hours squatting over a toilet than they thought was possible.

It is less clear if these graduates will do Cambodia any good.

In any case, be sure to check out some of Ms. Green's other caricatures, The Terrified PhD Candidate, Australian Yobbos, American Contractors on Leave, and French People.


[1] Faine Green. "Expat Field Guide: Ivy League Grad Who Is Here To Save You." Faine Opines. 2 January 2014.

[2]Karen Ho. Liquidated: An Ethnography of Wall Street. (Durham, NC: Duke University Press, 2009), 44.