Polls Kablooey

wirelessonly.jpg

While we did extraordinarily well in 2006, there were several House races left on the table.  Candidates like Eric Massa and Larry Kissell came very close, and with DCCC support, could have won their districts.  In the case of Kissell, I've talked to two people in high level party positions - one local to North Carolina and one in DC - who told me the same thing about why they didn't put more into that race.  Polling.  They did polls one or more weeks before the election, and it just looked out of reach by six or more points.  In a case where you are moving resources around the country, it's hard to make a call to support someone like Kissell when your data says otherwise.  So I want to circle back to the wireless only problem I highlighted yesterday. It looks like that population is growing by 3-3.5 percent a year, which means by 2008 the wireless only population could hit 20%.  This is a population that cannot be polled by traditional phone techniques.

Meelar in the comments added some interesting thoughts:

Right now, the default assumption is to simply assume that excluding them won't matter, due to some combination of a) The wireless-only people are more or less similar to the population with landlines that we can reach, b) The wireless only people are less likely to vote and c) There aren't enough wireless-only people to be important.  Moreover, wireless-only is only one of the problems that cause sampling to not be truly random; others include people who work nights, low response rates, call-screening, and so on.

The problem is that all these other problems are getting worse as well (response rates are low and dropping, call-screening is on the rise, etc.)  So over the next, say, 5 years, there's going to be a lot of development in the field.  The place it's farthest along is Zogby, which currently uses email-based polling and heavily weights the data it gets based on a ton of demographics.  This sort of approach will probably get more and more common. Of course this introduces its own problems...we live in interesting times.

I don't trust Zogby, but there are plenty of commercial sector market research firms doing and using internet research.  This cycle, I hope we begin to see more of it in the political space.  Internet polling can test rich video and sophisticated messaging, and it can use psychological symbols unavailable to phone bankers.  It may also reduce dishonesty in responses, since people are less likely to lie to a computer than another human being.

The problem with traditional polling is compounded by a changing electorate.  There are going to be some really interesting GOTV tools rolled out this cycle, and I expect that the youth voting surge is going to increase.  Already, last cycle the polling on individual House races was so unreliable it led to some poor decision-making, underestimating turnout in grassroots campaigns like those of Massa and Kissell.  While you can compensate this by averaging across different polls on a national level and extrapolate support, in most Congressional and even Senate races there aren't multiple polling firms in the field with public results.

We need to figure out new metrics for receiving party support aside from money and polling.  Perhaps opt-in email addresses acquired?  Friends on MySpace?  Newly registered voters (I like this one)?  Chatter across blogs using sites such as Blogpulse?

I'm not sure, but the whole landscape of politics is shifting.  It's like an entirely new grammar is emerging, but we're not there yet.

Update [2007-5-16 13:41:0 by Matt Stoller]:: David Kowalski makes the interesting point in the comments that Republicans assumed that Jim Leach received no help from the NRCC and seemed 'safe'.

Tags: polling (all tags)

Comments

18 Comments

I would like to ask what your reaction...

....would be to getting a random call on your cellphone from a pollster.

Speaking as someone without a land-line, while I would like it (I really really want to be polled, I got polled only once before) I'd guess most people would be quite annoyed more than when they get called on a land-line. In fact, that may be one reason these people don't even have a land-line, it's harder  for people to get your phone number. I know I have certainly been annoyed by times I've been called by campaigns or Dem party officials at exactly the wrong time and I answer before checking who it is and sending them to voicemail.

by MNPundit 2007-05-16 07:49AM | 0 recs
Re: I would like to ask what your reaction...

I have a landline, but keep it unplugged (need it for DSL), so I can only HOPE that a pollster will call my cell phone! They have before. I've been polled twice, one regarding CA politics over my landline, and once was a push poll for a local SF candidate on my cell phone.

by LandStander 2007-05-16 07:54AM | 0 recs
Re: I would like to ask what your reaction...

I actually wouldn't mind.

Something happened about six months ago and suddenly I'm getting phone spam (God, I don't even remember what the proper term is for that, it's been so long since I had a land line) on my cell phone again. Usually, for some reason, the phone spam is usually in Spanish. (I don't even speak Spanish very well.) I need to figure out how to get on the no-call list or whatever now that just having a cell phone doesn't seem to be enough. Either way, I think at this point I'd almost be happy to get a poll call just because it wouldn't be selling me something.

At one point recently I actually did get a phone call from a man who asked if I'd be willing to participate in a poll, and I said sure. But then it turned out he actually wanted to sell me a mortgage, so I hung up.

by Silent sound 2007-05-16 10:29AM | 0 recs
Re: Polls Kablooey

"since people are less likely to lie to a computer than another human being"

Do we have proof of this?  (Meant to be a neutral question:  I'd be astonished, and impressed, if someone had done a reliable study on the matter.)

by Transmission 2007-05-16 07:55AM | 0 recs
Re: Polls Kablooey

I'd think it would be the opposite, people are more truthful in an anonymous environment, and internet has a greater degree of anonymity than talking to someone on the phone.  I'd actually think people would be more likely to tell polsters one thing on the phone, and then do something else in the voting booth.  An internet survey is a closer model of a voting booth.

by enarjay 2007-05-16 08:04AM | 0 recs
Re: Polls Kablooey

We agree.

by Matt Stoller 2007-05-16 08:12AM | 0 recs
Re: Polls Kablooey

ahh we do.

I have seen psychology studies to this effect.

My former professor write this:
http://psp.sagepub.com/cgi/content/abstr act/29/2/273

In Study 1, White participants who completed the study in the laboratory evaluated Black targets more favorably than White targets. This unexpected "outgroup-favoring" pattern occurred in both pencil-and-paper and Internet versions of the study, showing that modality did not produce it; but when participants worked outside the laboratory via the Internet, this pattern disappeared. Study 2 replicated the above findings and further indicated that the reduced distortion in Internet-based studies was due to the removal of the experimenter rather than removing the participants from the laboratory environment.

It's more about knowing that someone isn't looking over your shoulder than about actually doing the study on a computer.

by enarjay 2007-05-16 08:31AM | 0 recs
Re: Polls Kablooey

I seem to remember seeing something about a study that did something like conduct a fake "poll" by both automated and human-driven means, where one of the questions was "did you vote in the last election?". They then went back and double-checked the voter rolls to see how many of these people were telling the truth, and found that people were more likely to falsely claim to have voted when they were speaking to a human rather than a computer.

Am I remembering this right?

by Silent sound 2007-05-16 10:34AM | 0 recs
Re: Polls Kablooey

I wanted to see how many have internet connections but all i could find was this Pew survey.

http://www.pewinternet.org/pdfs/PIP_ICT_ Typology.pdf

It seems only 15% have no access to the web.

62% -- Go online for no particular reason, just for fun or to pass the time.

That seems to me like an internet sample could be fairly reliable, and the number who are connected to the internet, may soon eclipse the number who have conventional land line phones.

by enarjay 2007-05-16 08:13AM | 0 recs
Re: Polls Kablooey

At least one GOP candidate , Jim Leach of Iowa, came out with a "safe" margin and received no help from the NRCC as a result.  I would suspect that this was the case for Jeb Bradley as well (poll only).  Bradley was upset by Carol Shea-Porter.

by David Kowalski 2007-05-16 09:13AM | 0 recs
The Young Adult Perspective

I think younger people tend to do without landlines more than average.  I base this solely on anecdotal evidence.

For one, I'm one of those young people.  I'm 21, and live with two other people my age.  All three of us solely use cell phones.  But it goes farther than that; every one of my friends that does not live "at home" with their parents went without the landline and relies solely on their cell phone.

It's just seen as an extra charge that we don't need.  Our cell phones are our home phones -- home phones that are always with us.  

That's just my two cents on the issue.

by fbihop 2007-05-16 10:20AM | 0 recs
Re: The Young Adult Perspective

Same here, I truly think that the under 30 crowd is more likely to be under sampled by these polls, simply because a large portion don't have regular phones.

Also I think these tend to be the high information voters that are breaking from Hillary.

by enarjay 2007-05-16 10:31AM | 0 recs
Re: The Young Adult Perspective

High info?  I completely disagree.  Most young people I know (and I'm 21, like fbihop), don't know much at all about the candidates.

by jallen 2007-05-16 10:35AM | 0 recs
Re: The Young Adult Perspective

He means: High Information Voters who are Under 30 are Breaking from Clinton.

Not: Voters Under 30 are High Information Voters Who are Breaking from Clinton.

by MNPundit 2007-05-16 10:58AM | 0 recs
Re: The Young Adult Perspective

Regardless, to demonstrate my point, one of my friends (from Arizona) thought that McCain was against the war.  She doesn't like the Clintons, though.

by jallen 2007-05-16 03:54PM | 0 recs
Re: Polls Kablooey

I'm well past 30 and I dropped my landline once I no longer needed it (I had it solely for myhome security system, now I live in an apartment). It's great not to get phone spam (which even a no-call list doesn't eliminate). Without landlines, campaigns need to use new media via the internet. they also have to go back to grassroots, which is what they should be doing anyway.

by rich 2007-05-16 12:59PM | 0 recs
Re: Polls Kablooey

Since Kissell is the example given, let's talk NC-08. While there's a great national case for cell phone or Internet polling being more accurate, this would NOT be the case in a rural district.

But that's not to say the outsider polls (by which I mean the DCCC, etc) weren't flawed.

As I recall every single independent poll released by Kissell was dead on. Trailing, getting closer, getting closer, then dead even. Which as it turns out was true.

D-trip does flash polls. Poorly. And God help us if they called on Wednesday night when all the good Democrats were in Church. Or during a NASCAR race. No wonder they screwed the pooch so bad.

I'm not saying campaign polls are the best, but an honest campaign, hiring an honest independent firm THAT KNOWS THE DISTRICT will always yield a more reliable poll than any outsider snapshot.

Cell phones had nothing to do with it in NC-08. Nor did the internets. The Kissell campaign couldn't have possibly screamed what was happening in the District any louder.

I got a fundraising letter releasing their final poll data just before the election. The front said something like, do you want to win or lose by 500 votes... it's going to be that close.

God I hate D-trip.

by CarolinaCrush 2007-05-16 01:27PM | 0 recs
Tracking, tracking, tracking...is key.

Just say no to flash.

Know your universe or stay out of it.

by CarolinaCrush 2007-05-16 01:46PM | 0 recs

Diaries

Advertise Blogads


----------- myDD - skin -----------