The Focus-Group Fraud
FERGUSON, ANDREW
The Focus-Group Fraud By Andrew Ferguson It was one of the two or three oddest developments of the presidential campaign, if anyone is still keeping track. Suddenly, sometime around...
...Why do you say that...
...They suit the special demands of candidate and consultant alike...
...They’re a symptom of a weak campaign— a substitute for leadership, for devising a strategy and sticking to it...
...Frank examined his notes...
...the Washington Post commissioned a poll showing that 52 percent of Americans would prefer Clinton as foster Dad...
...It’s easy to account for the popularity of focus groups in politics...
...My 81-year-old mother-in-law,” Gingrich said, “my mom and dad in their seventies...
...It indicates that those people in those focus groups who said they would leave their kids with Bob Dole probably do trust Bob Dole...
...On another television, unseen by them but closely watched by the moderator, a graph rolls across the video image...
...TV monitors were placed before rows of chairs in a dreary conference room in the motel basement...
...Ditto the “data” it yields...
...Common-sense practical things...
...Though not at all scientific, they offer the veneer of pseudo-science...
...Fitzpatrick asked...
...In making the complaint he ignores the groveling figure of every politician and political operative in the country hunched around his feet, their eager and upturned faces smeared with the polish from his boots...
...Even better, focus groups cost less than polls while yielding lots of poll-like data...
...People hate politicians, think politics is a con...
...Tony Blankley, Gingrich’s press secretary, cornered Frank...
...Long, painful silence...
...Tell me what you think...
...Focus-group participants, male or female, seem always to be disgruntled...
...I mean, there was no blood...
...Words are very important in communicating to women,” Fitzpatrick wrote...
...They’re the hottest research mechanism going right now,” says Mark Mellman, a Democratic consultant...
...But everyone agreed, then as now, that Glenn Close is annoying...
...His speeches, with their famously stuffed sentences (“we will strengthen our families, protect our environment, care for the elderly, keep our streets safe”), sound like a focus-group transcript distilled to its essence...
...And Bill Clinton...
...the results, within a margin of error, do tell you something about the thinking of voters at large...
...I want you to feel comfortable...
...Actually, it doesn’t...
...So goes debate in a politics ruled by focus groups...
...But you can, with relative ease and little expense, bring a focus group around a table to gauge their reactions to chocolate soyflakes...
...But I’ve watched one on videotape and attended another, and I’ve begun to see the veteran’s point...
...they ask eagerly, and usually Luntz has something focus-group fresh...
...People think they’re extremely fashionable and sexy...
...Warner’s Foghorn Leghorn countenance appeared on the screen, and in the back of the room, on Luntz’s TV monitor, we could see the graph superimposed on it...
...From this roiling stew of ignorance and stupidity, the focus-group wizard is supposed to distill some populist wisdom...
...Of course, that was before they invented focus groups...
...Oh God . . .” And deep in his trance he sees the focus groups rise up . . . they are displeased . . . And here at last is the overriding irony of focus groups, of their use and abuse in contemporary politics...
...A huge tax break for the wealthiest people in this country,” said Daschle...
...Biggest polluters to dirty the air and dirty the water...
...All the lines were on 5—neutral...
...And once they’re in that role of expert, they’re no longer useful to you...
...The response a person gives to an advertisement shown in a focus group might be quite different from his more passive, less thoughtful reaction when he sees the same ad while slumped in his Barcalounger at home...
...Journalists aren’t usually admitted to political focus groups, especially in a campaign season, since the information derived from them, while mostly worthless, is deemed sensitive and proprietary...
...As it happened, Virginia senator John Warner was debating his opponent that night as well...
...But I think it indicates that people trust Bob Dole...
...Polls draw on a large, randomly selected group of respondents, who, according to probability theory, will present a statistically accurate picture of the public as a whole...
...What—to try one more time—do women want...
...Gingrich waved...
...The infelicity of the candidate’s thought experiment was immediately apparent...
...Tell me what you feel...
...What have you got for me...
...Common-sense health-insurance reform,” said Lott...
...so too Gephardt and Daschle...
...On the graph are lines reflecting the group’s reactions in real time...
...I knew—I knew—that line would go through the roof,” Luntz told me...
...Oh,” said Blankley...
...After the survey, a pollster can use a focusgroup discussion to probe confusing or contradictory results...
...You see...
...Sessions last as long as two hours, after which the lucky participants will be paid $40 or $50 for their time...
...We asked people,” said Gephardt, “‘What are your everyday problems?’” “Wasteful Washington spending,” said Lott...
...A consultant who specializes in qualitative research can plausibly claim for himself near-mystical powers of intuition and populist divination...
...Was he impugning the president’s character...
...But one truth will strike anyone who watches a focus group in action: No matter how much a moderator is getting paid for his services, it’s not enough...
...Money,” a large woman said loudly...
...Given their obstinate lack of interest in the subject, asking a group of average Americans about politics is like asking a gang of stevedores to solve a problem in astrophysics...
...A kind of sophistry quickly set in...
...Gingrich and Lott had, of course, been marinating in focus-group-approved language...
...There’s no way of knowing that they represent anything more than the opinions of twelve people sitting in a room talking to a moderator in anticipation of making forty bucks...
...Excellent...
...But when the candidate announces, “We will not give benefits to illegal aliens,” the lines on the graph smile upward...
...I myself am not a veteran, having had only two focus-group experiences...
...Warner spoke...
...Not so with focus groups...
...And that’s all it indicates...
...Speak softly, speak of consensus and cooperation, and the lines will climb like rockets...
...Frank ran up...
...No product is brought to market these days without extensive focus-group testing...
...Ergo et QED...
...In their hands they hold dials wired to a computer...
...Also, elections often turn on the votes of the undecided and unaffiliated and downright alienated...
...Owing perhaps to the occasional Democratic negativity, the Republicans, and particularly Gingrich, scored far better than the Democrats...
...And the average voter heartily concurs...
...The focus group was happy...
...Gingrich beamed...
...But they are dangerous, even destructive, when you’re using them to make judgments for you, particularly on matters they haven’t thought very much about...
...As recently as twenty years ago, focus groups were an obscure technique used by researchers in the field of retail marketing...
...These days Luntz specializes in “instant response,” a sub-genre of focus groups, a craze within the craze...
...Even some political consultants—even some political consultants who themselves use focus groups—have grown uneasy with the technique, and their objections run deeper than the simple issue of projectability...
...Unlike polls, which have statistical safeguards, a focus group can’t be replicated...
...Frank was beside himself...
...Not surprisingly, then, the videotaped focus group soon enough degenerated into a gripe session, a watercooler chin-wag in which the cooler pours out nothing but bile...
...Big money,” another large woman spat out...
...In the end the client has a more complete understanding of the tastes and preferences of his potential consumers...
...He takes credit, most recently, for shaping the Republican vow to “end the IRS as we know it”—a vow that brought down the house when it bellowed forth from both Jack Kemp and Bob Dole during their acceptance speeches in San Diego...
...Polls are useful, indeed indispensable, for a market researcher, but they have their limitations...
...The two Republicans smiled at the two Democrats across a table, as they pelted each other with little marshmallows of rhetoric...
...React to every single thing he says,” Frank called out...
...Quotes from real live people were included to obscure the article’s only indisputable fact, which was that the reporter had made a judgment about public opinion at large on the basis of a relatively small number of interviews...
...Deep cuts in Medicare to pay for tax cuts for the wealthiest Americans,” said Gephardt...
...It’s ’cause that’s how it is,” and soon they were all talking at once...
...We need Families First,” said Daschle...
...A group of ten to fifteen consumers sharing some characteristic—middleaged housewives, teenage girls with disposable income, suburban men with young children— might be selected through a phone survey and brought together to taste a new breakfast cereal, compare proposed ad campaigns, or judge the new logo for a box of Goobers...
...Focus groups, wrote the political analyst Stuart Rothenberg in a recent Roll Call, “are the most misused and fraudulent political technique of the decade...
...Wasteful Washington spending,” said Gingrich...
...But you’re asking them to be instant experts...
...For as Winston Churchill famously wrote in Bartlett’s Familiar Quotations, “Democracy is the worst form of government, except for all the others...
...You’d have to ask the people in the focus groups,” he replied...
...And the lines spiked up...
...Blankley nodded...
...And perhaps best of all, they offer the candidate instant gratification...
...They cheer bipartisan compromise and disdain congressmen who won’t stand on principle...
...This may have something to do with a process of self-selection, since the kinds of people who are willing to drive after work to a sparsely furnished, overlit room to talk to a group of strangers for two hours about a subject they care little and know nothing about do not, as a rule, lead lives filled with sunshine and song...
...One charge in the general indictment of focus groups doesn’t stand up...
...And announced: “Mr...
...As critics of focus groups often point out, it is difficult to grasp what people are thinking when they aren’t...
...When the lines curve above 5, heading toward 10, it means the participants like what they see and hear...
...All these elements of group dynamics make the conclusions drawn from focus groups highly suspect...
...It is now routine for newspaper reporters to build entire stories around the projectability fallacy...
...Me, I vote for the person—doesn’t matter if they’re Democrat or Republican...
...You just have to know what to look for...
...Some hard and fast rules: Never say ‘Tax Cut’ without preceding it with ‘Middle Class.’ Never Say ‘Cut Government Spending’ without calling it ‘Wasteful...
...They think the mainstream press is wholly biased and inaccurate and rely on it for all their information...
...Tax relief...
...Recently—to take an example almost at random—the New York Times sent a reporter to trail Bob Dole through the Midwest...
...Didn’t I say ‘cut wasteful government spending...
...They say that politicians tell them only what they want to hear and wonder why politicians never listen to them...
...Was it ‘middle-class tax relief ’ or ‘tax cut for working families...
...But they’ve got to remember, tax relief, not tax cuts...
...He is widely credited with designing the Contract with America, which, in turn, is widely credited with the GOP victory in 1994...
...And no one doubts the usefulness of focus groups in the testing of consumer products...
...They just tell you what you want to hear...
...Her report closed with a section on “communicating to women voters,” designed for sweaty-palmed congressmen desperate to please the ladies back home...
...The lines rose into favorable territory...
...Dole’s effort to [explain his tax cut] has yielded more frustration than votes...
...Afocus-group veteran once said to me: “You sit in enough of these things, and the sad truth is, you end up really despising people as a class...
...You must give me your reaction on a secondby-second basis,” he told them now, explaining how the dials worked...
...He was making a common error, another symptom of the latest disease to afflict the world of politics: focus-group hysteria...
...A focus group can influence everything from the color of the shirt a candidate wears to the part in his hair to which issues he dwells upon and which he avoids...
...Even an outsider can tell when a campaign is relying overmuch on focus-group research...
...lines sinking below 5 show they’re not happy...
...Has he caused more pain or has he felt it...
...Indeed, before you could say “Gotcha...
...A few weeks ago he discovered that focus groups don’t like it when a candidate says, “We will deny benefits to illegal aliens...
...A common-sense approach...
...You can observe how people immediately react to a particular product, for example...
...TV news anchors are often chosen or dumped based on focus-group research...
...23 preparing Gingrich for a debate in Williamsburg, Va., with Trent Lott, Tom Daschle, and Dick Gephardt...
...Most focus groups are held in offices designed for the purpose, with a two-way mirror on one wall...
...Only occasionally did the lines frown, when the Democrats would turn dark, forgetting their focus groups...
...As a key swing district in national elections, the original home of the Reagan Democrat and other beasts of political mythology, Macomb County is the political consultant’s Holy Land, Disney World, and Lourdes, all in one...
...He went off with Gingrich that night to explain his findings further, and perhaps to celebrate their triumph, and by now he has surely written his standard three-page report, to be distributed to anxious candidates...
...So what’s the problem...
...No, for them...
...The reporter talked to voters...
...In comparing notes with focus-group vets, I’ve discovered several universal themes...
...There’s a lot here,” he said...
...Because I tested it...
...Once an instrument of national campaigns exclusively, they have become popular at every level of electioneering in the 1990s...
...They hate negative campaigning and, as the campaign progresses, remember only the negative things they hear...
...Combining her focus-group research with poll results, Fitzpatrick composed a “playbook for Republicans” called “Winning the Women’s Vote...
...This is not always for the best...
...Wasteful Washington spending—very good...
...What about that...
...My mother is 83 years of age,” said Lott...
...I wasn’t in the focus groups...
...The Gingrich debate was a focus group’s dream...
...a poll begins at $12,000...
...Didn’t I tell you...
...And it is an increasingly common mistake...
...They want to balance the budget by cutting congressional perks...
...she would ask...
...It was held last spring in Macomb County, Mich...
...Focus groups, especially with swing voters, complain incessantly about the incivility, the partisanship, in politics...
...He doesn’t talk about that anymore...
...The group was fielded by the Republican pollster Kellyanne Fitzpatrick, to answer the question, “Whither women...
...Language,” Frank Luntz is fond of saying, “is everything...
...My impression is that nobody hit it out of the park,” said Blankley...
...It’s just the way I feel, is all...
...He may be inhibited by their reactions to his reactions...
...If a candidate flits from issue to issue, hammering tax cuts one week, then drugs the next, then crime the next, if he frames his opponent as wishy-washy one day and a committed liberal ideologue the morning after—does any of this sound familiar?—he is probably taking his cues from focus groups...
...In the most famous example, Glenn Close’s character committed suicide in the original climax of Fatal Attraction...
...Fear not...
...Preparing” Gingrich, in this instance, meant feeding the speaker soundbites that had brought coos from focus groups around the country...
...I love this,” he said...
...he becomes as Svengali, the private role model of all political consultants...
...Many shrugs...
...It tells us nothing about the public at large...
...We want to solve the practical everyday problems that people in this country face, Families First,” said Gephardt...
...Practical solutions—yes . . .” Frank continued, as if to himself...
...And President Clinton is thought by many in the industry to be the most focus-group-obsessed politician in history...
...Finally: “I can’t give you a reason...
...Frank says I am the only one of the four whose approval went up in a statistically measurable way,” he said into the phone...
...The groups are too small...
...They can show campaign ads to test their effect...
...As a consequence the debate was sleepier than a fly-fishing show on cable...
...When focus groups objected, the ending was reshot so Michael Douglas’s wife could kill her...
...Accordingly, the group Fitzpatrick assembled was all-female, politically unaligned, bluetowhite collar, and uniformly disgruntled...
...This is supposed to be the point of focus groups, after all—to map the subterranean currents of public opinion, to divine the why beneath the what...
...But in politics today they do not seem to be treated with the suspicion they deserve...
...We call it Families First...
...It will take the best pieces and the worst pieces,” he told me, “and show how they can be used...
...Warner is a Luntz client...
...Did I miss something...
...The videotaped focus group was more typical in technique...
...And then Warner said: “I think it’s important that we end the IRS as we know it...
...hence these are the voters on whom focusgroup specialists will, um, focus...
...And Families First worked very well...
...In politics people often don’t know what they think...
...A candidate has the voyeuristic pleasure of watching those real human beings discuss him and his issues from behind the glass...
...Rothenberg’s complaint is that in all this flurry of activity candidates and consultants forget that focus-group results are not “projectable” onto the larger population...
...The night of the debate, Sept...
...One woman said her health insurance had not covered a procedure she had recently undergone...
...He’s going on about kids smoking—it’s all I hear...
...Most focus groups are held in far-flung places, so there’s travel, too...
...If something happened along the way,” Dole announced at a campaign rally, “and you had to leave your children with Bob Dole or Bill Clinton, I think you’d probably leave your children with Bob Dole...
...That, circa 1996, is democracy, which we all honor in theory and practice...
...If you’re about to come out with a new cereal—say, chocolate soyflakes (yuk)—it would be too expensive to gather a randomly selected group of a thousand cereal eaters in a single place and force-feed them your bad idea...
...I just, for me, don’t believe anything they say...
...Polls are scientifically designed to apprehend public opinion...
...My mother-in-law is 81...
...This was Bob Dole’s error in confidently volunteering to adopt America’s children...
...They have come to full flower just at the moment when conventional wisdom tells us that the system resists as never before the hopes and needs and desires of the average voter...
...And when they all reach as one for the air-sickness bags, you’ll know you should probably stick with Fruit Loops...
...You are the only one of the four whose approval went up in a statistically measurable way,” he told the speaker...
...moviemakers have even been known to reshoot the endings of their movies when focus groups have found the originals unappealing...
...I’m just repeating what focus groups said—liberals, men, women, Democrats, Republicans, conservatives...
...Frank Rizzo, the former mayor of Philadelphia, once tried to lunge through the glass at a woman who had dismissed his candidacy with an ethnic epithet...
...Common sense—worked very well...
...If you want to know how the results of focus groups are used, listen closely to your favorite politician, assuming you have one...
...In fact, profit margins are low...
...As soon as the focus group was paid off and dismissed, he rushed to tell Gingrich the good news...
...Before long they’re explaining, not merely that the moon is made of cheese, but what kind of cheese it is, and whether it is properly aged, and how it would taste on a Trisket...
...Did it mean that Clinton’s not a good person...
...Suddenly, sometime around midApril, Bob Dole uncorked a new bit of rhetoric...
...Bogus though it was, the story served its purpose of misleading the paper’s readers...
...I live for this...
...Their responses are solicited by a moderator and recorded on video or audio tape...
...This is why she wants nationalized health insurance...
...During the budget crisis of late ’95, the administration was reportedly doing one focus group a night...
...It’s what a couple of people have told me who had focus groups,” he replied...
...But in the current craze it is political language that is most heavily determined by focus groups...
...Working families,” said Daschle...
...Yes, ma’am...
...The theory behind focus groups is, if you don’t have a strategy, let’s throw a bunch of people in a room and have them tell us what to do...
...I hope,” said Lott in his opening remarks, “we will not get involved in what quite often has been partisanship and name-calling...
...This semantic pearl he has dropped in the trembling hands of every grateful congressman who asks...
...You can easily imagine a hapless Republican candidate— or Democrat, too, for the Democrats are as wired with focus groups as their opponents—you can see him standing on a hay bale somewhere under a broiling autumn sun, addressing a half-interested crowd of voters, his sweaty forehead straining with the pressure of so many focus-group soundbites, and wondering: “Did I just say I’d ‘cut government spending...
...The most cringe-making moments in the Macomb County focus group came when Fitzpatrick asked the participants why they felt as they did...
...It doesn’t matter who you elect, from my opinion...
...In my experience,” says Mike Murphy, a Republican political consultant, “the campaigns that have done the most focus groups have all lost...
...only 27 percent chose Dole...
...But a consultant will have to eat more than half his price in expenses—hiring a firm to canvass and cull the participants, paying them off with their $50, renting the room, and so on...
...I’m not happy with him,” said a woman, who, incidentally, looked like she wouldn’t be happy if Ed McMahon walked in and handed her a check from Publisher’s Clearinghouse...
...Mention “Republican” or “Democrat” and the participants frown, the lines on the graph head south...
...There’s no reason to pick on Dole alone...
...The president is just a figurehead to me, it’s the Congress that does everything...
...It was a happy debate...
...Walking the halls of the Capitol with him can take time, as he is often stopped by the members...
...For us...
...29, Luntz convened an instant-response focus group of about 35 swing voters in a Williamsburg motel...
...In instant response, a large focus group, 35 to 50 people, is shown a video of a speech or commercial...
...Luntz began with a pep talk...
...You did...
...Focus groups are great for finding out what’s on the top of people’s minds,” says Sean Fitzpatrick, an ad man who worked for George Bush in 1992—and who resigned in part from frustration with the campaign’s obsession with focus groups...
...They’re no longer reacting as normal voters...
...The result is called qualitative research, to distinguish it from quantitative research, which refers to the raw data gleaned from more conventional public-opinion polling...
...Frank Luntz is the Republicans’ uncrowned king of focus groups...
...Newt Gingrich is a Luntz admirer, and Luntz spent time in the week of Sept...
...Well, whatever happened to medical reform...
...Consultants will field a focus group for a variety of purposes...
...How...
...Focus groups, Rothenberg wrote in Roll Call, “also are popular because the profit margin . . . is so high for pollsters—reportedly more than double that for quantitative studies...
...We’ve done more focus groups in the last month than we did in the entire 1986 election cycle...
...But their utility in political campaigns is more controversial...
...When I say ‘Republican,’” Fitzpatrick asked the assembled women, “what’s the first thing that comes to mind...
...The four of us can chat in a positive way,” said Gingrich...
...Focus groups have been widely used in politics for only fifteen years or so...
...Dole was asked to explain his reasoning in a TV interview...
...He just eats this stuff up...
...In the upbeat atmosphere of a campaign rally, with perky cheerleaders and brass bands poised to go giddy on cue, it’s usually considered unwise to muse aloud to parents in the audience about what would happen if they croaked and their kids were left alone in the world...
...You see...
...But they never do what they say they’re going to do...
...How, to be more precise, could the Republican party tailor its message to attract female voters...
...I need to let them know that they can’t pull one over on me,” he had told me earlier...
...Pollsters, before conducting a survey, might use a focus group to test ideas about what to ask and how to ask it...
...We have got to deal with people’s practical everyday problems,” said Gephardt...
...Blankley said, hopefully...
...And one other thing: education...
...All national politicians in 1996 are focus groupies...
...But why be pedantic...
...Luntz’s research and Luntz himself hold many congressional Republicans in thrall...
...We found the speaker talking on a pay phone outside the press briefing room in another hotel...
...At the end of the process the candidate receives easytoread reports peppered with illustrative quotes and anecdotes from real human beings, plus lots of phrases tested for use in speeches...
...I paraphrase...
...And “politician...
...Frank switched on the last few minutes of the Warner debate to warm up the group and gauge their reaction...
...A focus group will cost you between $5,000 and $6,000...
...Frank whispered to me excitedly...
...In the artificial setting of a focus group, he can be steered one way or another by the moderator, or by his fellow respondents...
Vol. 2 • October 1996 • No. 5
