Archived Science Blog page from 2008. It stays on Science Blog so the original link still works. It is not a current article. Back to Science Blog

Field psychology

Most psychology experiments are performed in a laboratory setting. This leads critics to wonder about their ecological validity: that is, just because somebody acts one way in the lab, do you know that is how they would act in real life.

There is another problem, summarized very nicely in a recent paper by Sugiyama and colleagues. In a footnote explaining some "oddities" in the results of their study of one of the world's most remote civilizations (the Shiwiar of the Amazon), they note:

Experimentation under field conditions injects higher levels of error variance into results than are obtainable under well-controlled laboratory conditions. More significant than factors such as added distractions, interruptions, and language difficulties is the extreme cultural strangeness of experimental testing itself, with its unfamiliar necessity of adhering to formal, abstract, and seemingly arbitrary behavioral and communicative constraints. Shiwiar subjects had no prior experience with experimental test-taking situations. This situation introduces confusion into the communicative pragmatics inherent in the task situation, and error variance into results. Restricting one's responses to the question explicitly asked, and ignoring information (such as who may be exhibiting generosity to whom) that is relevant to real life but not to a test problem, is a skill one learns in classrooms and courtrooms.

I have run into this in less exotic locales than the Amazon. As part of my

, I have tested a number of native Chinese speakers who reside in the US -- mostly graduate students at Harvard. Even though these were smart, well-educated people, a number of them had great difficulty understanding how to do the experiment. Colleagues of mine who study visual perception have had similar difficulties when dealing with Chinese participants. The fact is that psychology experiments are relatively new and relatively rare in Asia, and so fewer people are familiar with what to do. No doubt we American scientists also design our experiments in ways that are culturally familiar to us (and thus not to the Chinese).

Sugiyama, L.S., Tooby, J., Cosmides, L. (2002). Cross-cultural evidence of cognitive adaptations for social exchange among the Shiwiar of Ecuadorian Amazonia.

Proceedings of the National Academy of Sciences of the United States of America, 99

For the same reasons mechanics use words like "carburetor" and doctors use words like "IV" and "echo-cardiogram" and baseball players seem to have twenty different names for nearly identical pitches. When you work within any sort of specialty, you need to make distinctions that your every-day 5th grade vocabulary just can't handle.

When I write for a general audience, I try to avoid phrases like "communicative pragmatics inherent in the task situation," but it's damn hard to do. I spent the last ten minutes trying to think of a succinct lay-person version of that phrase, and I had to give up. It is jam-packed with technical terms which are full of meaning but very hard to define.

Some scientists, like Steven Pinker, are incredibly inventive when writing for a general audience in terms of avoiding technical jargon. But when he talks to other psychologists, he uses the jargon. It's just easier.

...communicative pragmatics inherent in the task situation...

academics inflate their language so? Is it, like muscle cars with fuzzy dice, seeking to compensate for something? I've always wondered, but could never quite phrase the experiment to find out :)

Web page addresses and e-mail addresses turn into links automatically.

Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd> <blockquote>