Election Polling Representativeness

Updated · 1 episodes · 1 show · 1 source notes

concept Topics: Politics

Definition

Election polling representativeness is the degree to which a survey’s effective sample reflects the electorate relevant to the estimate, including differences in who can be contacted, who responds, how responses are weighted, and who ultimately votes.

Current Synthesis

Representativeness is not guaranteed by a large response count. Biased frames, interviewer selection, unequal nonresponse, contact-mode constraints, and incorrect adjustment variables can all create systematic error. Random selection reduces discretionary selection bias, while weighting can repair measured imbalances; neither solves differences that are unobserved or wrongly modeled.

Key Claims

  • Sample composition matters more to population inference than raw sample size alone.
  • Random selection limits interviewer choice but cannot force selected people to answer.
  • Nonresponse becomes bias when willingness or ability to participate correlates with political preference or turnout.
  • Weighting can correct known imbalance only through variables that meaningfully distinguish respondents from missing voters.
  • Poll accuracy therefore depends on contact operations, measurement design, adjustment, and turnout modeling as a linked system.

Evidence

Sampling frames and selection

  • We try to fix election polling (update) contrasts the huge but affluent-skewed 1936 Literary Digest sample with a much smaller sample that correctly predicted Franklin D. Roosevelt’s victory, then describes interviewer-filled quotas as a source of discretionary bias in 1948.

Contemporary nonresponse and adjustment

  • We try to fix election polling (update) reports very low telephone response, especially difficult access to younger and rural voters, higher manual-dialing costs, and Marist’s use of race, education, geography, and exploratory psychographic variables in weighting.

Counterevidence & Qualifications

  • The episode supplies illustrative history and one field experiment, not a comparative audit of polling organizations or a formal error decomposition.
  • Its response-rate, cost, and group-response claims are source-reported and may vary by survey design and election cycle.
  • A close forecast can result from offsetting errors, so accuracy alone does not prove that a sample or model is unbiased.
  • Text outreach can change coverage and response behavior; it should not be assumed equivalent to telephone interviewing without validation.

What Changed

  • Added a polling-specific synthesis that separates random selection, nonresponse, weighting, and turnout as distinct sources of representativeness error.
  • Established that weighting repairs modeled imbalance but cannot automatically recover unobserved missing groups.
  • Scientific Sampling Discipline - supplies the broader rule that appropriate evidence composition governs generalization.
  • Survey Mode Effects - explains how telephone, text, or device changes can alter participation or answers.
  • Crowd-Wisdom Polling - attempts to extract network information after direct respondent sampling but introduces different biases.
  • Marist Poll - provides the episode’s operational case for managing representativeness.

Sources

1 source notes across 1 show
  1. We try to fix election polling (update) Planet Money