The survey was designed and conducted by PRRI among a random sample of 22,465 adults (age 18 and up) living in all 50 states in the United States. Among those, 20,799 are part of Ipsos's Knowledge Panel and an additional 1,666 were recruited by Ipsos using opt-in survey panels to increase the sample sizes in smaller states. Interviews were conducted online between March 9 and December 7, 2023.
Respondents are recruited to the KnowledgePanel using an addressed-based sampling methodology from the Delivery Sequence File of the USPS - a database with full coverage of all delivery addresses in the U.S. As such, it covers all households regardless of their phone status, providing a representative online sample. Unlike opt-in panels, households are not permitted to "self-select" into the panel; and are generally limited to how many surveys they can take within a given time period.
The initial sample drawn from the KnowledgePanel was adjusted using pre-stratification weights so that it approximates the adult U.S. population defined by the 2022 March Supplement of the Current Population Survey (CPS), except language proficiency , which is not available from CPS, were obtained from the 2021 American Community Survey (ACS). Next, a probability proportional to size (PPS) sampling scheme was used to select a representative sample.
To reduce the effects of any non-response bias, a post-stratification adjustment was applied based on demographic distributions from the CPS. The post-stratification weight rebalanced the sample based on the following benchmarks: age, race and ethnicity, gender, Census division, metro area, education, and income. The sample weighting was accomplished using an iterative proportional fitting (IFP) process that simultaneously balances the distributions of all variables. Weights were trimmed to prevent individual interviews from having too much influence on the final results. In addition to an overall national weight, separate weights were computed for each state to ensure that the demographic characteristics of the sample closely approximate the demographic characteristics of the target populations. The state-level post-stratification weights rebalanced the sample based on the following benchmarks: age, race and ethnicity, gender, education, and income.
These weights from the KnowledgePanel cases were then used as the benchmarks for the additional opt-in sample in a process called ''calibration.'' This calibration process is used to correct for inherent biases associated with nonprobability opt-in panels. The calibration methodology aims to realign respondents from nonprobability samples with respect to a multidimensional set of measures to improve their representation.
The margin of error for the national survey is +/- 0.82 percentage points at the 95% level of confidence, including the design effect for the survey of 1.56. In addition to sampling error, surveys may also be subject to error or bias due to question wording, context, and order effects. Additional details about the KnowledgePanel can be found on the Ipsos website: https://www.ipsos.com/en-us/solution/knowledgepanel