Methodology › 2020 Methodology

2020 Methodology

The 2020 American Values Atlas (AVA) is a project of PRRI. Results for all demographic, religious affiliation, and political affiliation questions were based on 50,334 bilingual telephone interviews (including 35,212 cell phone interviews) conducted between January 7, 2020 and December 20, 2020 by professional interviewers under the direction of SSRS. National results for questions on specific issues are based on a subset of 10,052 telephone interviews (including 6,981 cell phone interviews) conducted in 10 weeks spread across the year. State level results for questions on specific issues are based on the national subset plus an oversample of 10 key states in 30 additional weeks, resulting in 23,536 interviews across all 50 states plus the District of Columbia (including 16,848 cell phone interviews). Key states include Arizona, California, Florida, Georgia, Michigan, North Carolina, New Mexico, Ohio, Texas, and Utah. The survey was made possible by generous support from the Arcus Foundation, the Evelyn and Walter Haas, Jr. Fund, the Gill Foundation, and Unitarian Universalist Veatch Program at Shelter Rock.

Throughout 2020, at least 1,000 interviews were completed each week, with about 700 interviews conducted among respondents on their cell phones. Mid-year, the cell phone proportion was increased to about 700 per week. Each week, interviewing occurred over a five- or six-day period, starting Tuesdays or Wednesdays and going through Sunday or Monday. The selection of respondents within households was accomplished by randomly requesting to speak with the youngest adult male or female currently living in the household.

Data collection was based on stratified, single-stage, random-digit-dialing (RDD) of landline telephone households and randomly generated cell phone numbers. The sample was designed to represent the total U.S. adult population from all 50 states, including Hawaii and Alaska, and the District of Columbia. The landline and cell phone samples were provided by Marketing Systems Group.

The weighting was accomplished in two separate stages. The first stage of weighting corrects for different probabilities of selection associated with the number of adults in each household and each respondent’s telephone usage patterns. In the second stage, sample demographics were balanced to match target population parameters for gender, age, education, race and Hispanic ethnicity, region (U.S. Census definitions), population density, and telephone usage. The population density parameter was derived from 2010 Census data. The telephone usage parameter came from an analysis of the January-June 2018 National Health Interview Survey. All other weighting parameters were derived from an analysis of the U.S. Census Bureau’s March 2018 Current Population Survey.

The sample weighting was accomplished using iterative proportional fitting (IFP), a process that simultaneously balances the distributions of all variables. Weights are trimmed so that they do not exceed 4.0 or fall below 0.25 to prevent individual interviews from having too much influence on the final results. The use of these weights in statistical analysis ensures that the demographic characteristics of the sample closely approximate the demographic characteristics of the target populations.

The table below shows the sample sizes for all 50 states for both sample and issue subsample. The margin of error for the total sample is +/- 0.5 percentage points at the 95% level of confidence. The margin of error for the national issue subsample is +/- 1.1 percentage points at the 95% level of confidence. The design effect of 1.3 is included in the margins of error. In addition to sampling error, surveys may also be subject to error or bias due to question wording, context, and order effects.

Sample Sizes for the United States

Region Total Sample Issue Subsample
United States 50,334 10,052
Region Total Sample Issue Subsample
U.S. plus 10 state oversamples 50,334 23,536

Sample Sizes for Individual States

State Total Sample Issue Subsample
Alabama 753 152
Alaska 186 29
Arizona 1,126 888
Arkansas 439 85
California 5,415 4,474
Colorado 991 192
Connecticut 521 115
Delaware 192 61
District of Columbia 226 74
Florida 3,613 2,918
Georgia 1,770 1,495
Hawaii 176 59
Idaho 349 63
Illinois 1,577 295
Indiana 1,083 217
Iowa 528 108
Kansas 425 82
Kentucky 711 147
Louisiana 549 114
Maine 214 46
Maryland 1,037 195
Massachusetts 1,017 195
Michigan 1,670 1,357
Minnesota 886 164
Mississippi 286 58
State Total Sample Issue Subsample
Missouri 816 144
Montana 254 29
Nebraska 348 68
Nevada 492 109
New Hampshire 238 62
New Jersey 1,344 288
New Mexico 397 316
New York 3,079 586
North Carolina 1,730 1,421
North Dakota 151 46
Ohio 1,894 1,549
Oklahoma 529 112
Oregon 839 176
Pennsylvania 2,053 399
Rhode Island 139 40
South Carolina 944 183
South Dakota 144 53
Tennessee 1,005 209
Texas 3,440 2,808
Utah 554 448
Vermont 115 39
Virginia 1,555 299
Washington 1,310 309
West Virginia 296 51
Wisconsin 823 168
Wyoming 105 41

Sample Sizes for Metropolitan Areas

Metro Area Substantive Questions Demographics
Albany 38 185
Albuquerque 35 174
Allentown 38 155
Atlanta 240 1,070
Austin 56 266
Baltimore 85 460
Birmingham 31 194
Boston 133 674
Buffalo 33 206
Charlotte 82 383
Chicago 223 1,167
Cincinnati 74 358
Cleveland 72 330
Columbus 62 360
Dallas 167 922
Denver 97 508
Detroit 129 728
Fresno 28 126
Grand Rapids 30 149
Hartford 31 187
Houston 138 782
Indianapolis 74 393
Jacksonville 52 270
Kansas City 59 280
Knoxville 29 155
Las Vegas 66 317
Los Angeles 384 1 781
Louisville 41 229
Memphis 34 160
Miami 185 974
Metro Area Substantive Questions Demographics
Milwaukee 44 245
Minneapolis-St. Paul 107 587
Nashville 49 262
New Orleans 29 168
New York City 588 3,004
Oklahoma City 42 188
Omaha 23 149
Orlando 88 446
Philadelphia 193 937
Phoenix 133 724
Pittsburgh 82 427
Portland 88 464
Providence 38 212
Raleigh 51 232
Richmond 39 189
Riverside 117 544
Rochester 29 170
Sacramento 66 348
Salt Lake City 30 209
San Antonio 59 326
San Diego 96 461
San Francisco 156 703
San Jose 42 220
Seattle 169 656
St. Louis 71 400
Tampa-St.Petersburg 116 566
Tucson 37 194
Virginia Beach 60 316
Washington DC 217 1,174
Other/Not in metro area 4,447 21,870