USA TODAY

Wednesday, September 29, 2004, page 6A

Politics

 

Gallup defends results against MoveOn.org attack

 

Liberal critics argue that pollster's methods give Republicans advantage

 

By Mark Memmott, USA TODAY

 

This year's USA TODAY/CNN/Gallup polling on the presidential race is coming under attack from liberal critics who say Gallup's methods produce results that are biased in favor of President Bush.

 

Gallup says it stands by its work, which Tuesday showed Bush ahead of Sen. John Kerry by 8 percentage points among likely voters -- if the election were held "today." That was down from a 13-point lead for Bush two weeks earlier. Gallup's recent polls have consistently shown Bush further ahead than he is in other surveys.

 

USA TODAY said Tuesday it remains confident in Gallup.

 

The firm, USA TODAY Polling Editor Jim Norman said, "has been doing USA TODAY's political polling since 1988. ... I'm impressed by the constant testing and retesting they do of their methodology to make sure they get it right."

 

CNN spokesmen were unavailable for comment.

 

In recent weeks, complaints about the USA TODAY/CNN/Gallup Polls had mostly been aired in "blogs," or online diaries.  On Tuesday, the issue spilled into the "mainstream media." MoveOn.org, a liberal advocacy group, paid $68,000 to run a full-page ad in The New York Times. The ad's headline: Gallup-ing to the Right. Why does America's top pollster keep getting it wrong?"

 

The ad goes on to say that "two media outlets, CNN and USA TODAY, bear special responsibility" because "they pay for many of Gallup's surveys."

 

At issue: Whether too many Republicans end up being counted as "likely voters" in Gallup's polls. In the past six USA TODAY/CNN/Gallup Polls this year, about 40% of the likely voters in the surveys said they considered themselves to be Republicans. By one measure, that's higher than might be expected: Exit polls after the past three presidential elections showed that about 35% of voters in those years said they were Republicans.

 

Peter Schurman, MoveOn.org's director, said Tuesday that Gallup "should admit its mistake and correct it by using samples that more closely reflect" likely turnout.

 

Frank Newport, editor in chief of the Gallup Poll, said the critics don't understand the science behind the polls. "This issue has been the subject of intense scholarly discussion and years of research. We're confident in what we're doing," he said.

 

Actually, it's what Gallup doesn't do that is at the heart of the debate. The polling firm does not adjust its "pool" of voters to add or subtract Republicans or Democrats in an effort to mirror those parties' estimated makeups.

 

Among the reasons Gallup doesn't try to do that:

 

--It believes there are no reliable data on which to estimate exactly how many Republicans or Democrats there are in the country. Some states, for example, don't require voters to register by party affiliation. Basing an adjustment on previous year's exit polls, "means you're 'weighting' one poll based on the results of another poll, which has its own built-in sampling error," Newport said.

 

--It believes that party affiliation "is an attitude, not a demographic trait" and that voters can change their minds about which party they identify with more than once during an election year, Newport said. That would explain, he said, why the number of people who identified themselves as Republicans went down during this year's Democratic primaries, when Kerry and his competitors were in the news.

 

Most polling firms use the same methods as Gallup when identifying party affiliations. Among those are the surveys done by the Pew Research Center for the People and the Press. Andrew Kohut, the center's director, said in a statement last week that "important shifts in voter sentiment" could be missed if pollsters tried to apply rigid party formulas to results.

 

But not all pollsters agree with Gallup’s approach. John Zogby is CEO of the independent polling firm Zogby International.

 

He adjusts the voter pools in his surveys to mirror party affiliations expressed in earlier exit polls. "I am one of the heretics in the polling industry," he said Tuesday. He maintains that there are variations in people’s party affiliations, but they aren't changing much daily, weekly, or even monthly."

 

Critics say the debate over Gallup's work is important because the media's reporting of polls can affect the dynamics of a campaign. "We need the most accurate information possible. Next week, the stories could be 'Kerry's surging in the polls,' but would that be true?" asks Markos Moulitsas Zuniga, who's dailykos.com blog is a popular site among liberals.

 

Norman, however, said that the Gallup's "overall record since 1988 on presidential elections, senate races and the national vote on congressional elections is as good as anyone's. And their record in the 2002 elections was clearly the best."

 

GOP represented in greater numbers

 

The Gallup Poll asks voters to identify their party affiliation after they tell pollsters whom they would vote for if the election were that day. How the party affiliations compare with poll results among likely voters:

 

Source: Gallup Polls; those marked with an asterisk were conducted independent of USA TODAY and CNN

 

Poll

Republican respondents

Independent respondents

Democratic respondents

GOP advantage over Democrats

Bush support

Kerry support

Jan. 9-11

39%

30%

31%

8%

55%

43%

Jan.29-Feb.1

36%

30%

35%

1%

46%

53%

Feb. 6-8

37%

31%

32%

5%

49%

48%

Feb. 16-17

32%

33%

36%

-4%

43%

55%

Mar. 5-7

35%

26%

40%

-5%

44%

52%

Mar. 26-28

44%

23%

32%

12%

51%

47%

Apr. 5-8*

41%

24%

34%

7%

48%

45%

Apr. 16-18

41%

25%

34%

7%

51%

46%

May 2-4*

38%

23%

38%

0%

48%

49%

May 7-9

37%

30%

33%

4%

48%

47%

May 21-23

38%

26%

34%

4%

47%

49%

June 3-6*

36%

27%

36%

0%

44%

50%

June 21-23

36%

28%

37%

-1%

49%

48%

July 8-11

38%

24%

38%

0%

46%

50%

July 19-21

41%

23%

35%

6%

47%

49%

July30-Aug.1

42%

23%

34%

8%

51%

47%

Aug. 9-11*

40%

25%

34%

6%

50%

47%

Aug. 23-25

38%

29%

32%

6%

50%

47%

Sept. 3-5

40%

27%

33%

7%

52%

45%

Sept. 13-15

40%

27%

33%

7%

55%

42%

Sept. 24-26

43%

25%

31%

12%

52%

44%