Artwork

Player FM - Internet Radio Done Right
Checked 23d ago
Added one year ago
Content provided by Dr. Azdren Coma and Dr. Seon Yup Lee, Dr. Azdren Coma, and Dr. Seon Yup Lee. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Dr. Azdren Coma and Dr. Seon Yup Lee, Dr. Azdren Coma, and Dr. Seon Yup Lee or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!
icon Daily Deals

Sample Design - Part 1. Sample Size - or why just over 1000 responses is enough to generalize findings to millions of people!

13:18
 
Share
 

Manage episode 421733344 series 3573207
Content provided by Dr. Azdren Coma and Dr. Seon Yup Lee, Dr. Azdren Coma, and Dr. Seon Yup Lee. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Dr. Azdren Coma and Dr. Seon Yup Lee, Dr. Azdren Coma, and Dr. Seon Yup Lee or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.

In this episode of the Total Survey Design Podcast, we explore the fascinating concept of sample size and its impact on survey accuracy. Discover why just about 1000 responses can represent the views of millions, debunking common misconceptions about survey sampling. We'll dive into the key parameters for calculating sample size, such as margin of error, confidence level, predicted variance, and target population size. Learn how a small, well-chosen sample can provide precise and reliable data, making large-scale surveys both practical and cost-effective. Tune in to understand the math behind the magic!
Here's a general formula commonly used for calculating sample size for simple random sampling:
𝑛=𝑍^2*𝑃*(1−𝑃)/𝐸^2
Where:
𝑛 = required sample size
𝑍 = Z-value (the number of standard deviations from the mean corresponding to the desired confidence level)
For a 95% confidence level, 𝑍≈1.96
𝑃 = estimated proportion of the population (if unknown, 𝑃 is often assumed to be 0.5 to maximize the sample size)
𝐸 = margin of error (the desired level of precision, expressed as a decimal)

Support the show

Find us online at: instagram.com/totalsurveydesign/
https://taplink.cc/totalsurveydesign
Contact us at: totalsurveydesign@gmail.com

  continue reading

20 episodes

Artwork
iconShare
 
Manage episode 421733344 series 3573207
Content provided by Dr. Azdren Coma and Dr. Seon Yup Lee, Dr. Azdren Coma, and Dr. Seon Yup Lee. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Dr. Azdren Coma and Dr. Seon Yup Lee, Dr. Azdren Coma, and Dr. Seon Yup Lee or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.

In this episode of the Total Survey Design Podcast, we explore the fascinating concept of sample size and its impact on survey accuracy. Discover why just about 1000 responses can represent the views of millions, debunking common misconceptions about survey sampling. We'll dive into the key parameters for calculating sample size, such as margin of error, confidence level, predicted variance, and target population size. Learn how a small, well-chosen sample can provide precise and reliable data, making large-scale surveys both practical and cost-effective. Tune in to understand the math behind the magic!
Here's a general formula commonly used for calculating sample size for simple random sampling:
𝑛=𝑍^2*𝑃*(1−𝑃)/𝐸^2
Where:
𝑛 = required sample size
𝑍 = Z-value (the number of standard deviations from the mean corresponding to the desired confidence level)
For a 95% confidence level, 𝑍≈1.96
𝑃 = estimated proportion of the population (if unknown, 𝑃 is often assumed to be 0.5 to maximize the sample size)
𝐸 = margin of error (the desired level of precision, expressed as a decimal)

Support the show

Find us online at: instagram.com/totalsurveydesign/
https://taplink.cc/totalsurveydesign
Contact us at: totalsurveydesign@gmail.com

  continue reading

20 episodes

All episodes

×
 
In this episode of Total Survey Design, Dr. Azdren Coma and Dr. Seon Yup Lee interview Dr. Jon Krosnick, a leading expert on political behavior, survey methodology, and public opinion. Dr. Krosnick is a professor at Stanford University who has advised the U.S. Census Bureau, led national studies on voting behavior and climate change, and published extensively on how people form attitudes and make decisions. Recorded at the historic St. Louis Union Station Hotel during the 2025 AAPOR conference, this conversation covers Dr. Krosnick’s career path, the role of mentorship, and his research on trust and measurement validity. The episode also addresses broader topics in academia, such as the pressures of publishing, the importance of constructive feedback, and the value of humility and replication in science. Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
In this episode I sat down with Thom to talk about surveys. We talked about his time at the Social and Economic Sciences Research Center, working with Don Dillman on various projects including the 2000 U.S. Census, some of his favorite projects, my dissertation survey, the application of the Tailored Design Method on a wide variety of cultures, and much more. Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
In this episode, we do a small retrospective on the first season. We also look ahead to see what is to come. We also give a call to action, seeking your support to ensure that this project continues to exist into the future. If you would like to support us, you can do so by visiting our Ko-fi page at: https://ko-fi.com/totalsurveydesign Thank you. Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
In this episode, we explore essential considerations for crafting effective surveys. We begin by emphasizing the importance of defining the purpose of your survey, which serves as a guide through each step of its creation. We discuss how understanding your main goal—whether it's measuring customer satisfaction or academic variables—shapes your questions and improves data quality. Additionally, we highlight the significance of knowing your target population, budget, and timeframe. By the episode's end, we offer practical advice on streamlining your survey to avoid unnecessary questions, reduce costs, and enhance response quality. Join us to learn how to design your survey with precision and purpose. Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
In this episode, we discuss the target population. We emphasize the importance of a well-defined target population, in context of the goal of your survey, and in relation to your sampling frame. We offer examples of target populations of various studies, and offer suggestions for the types of variables that you may want to consider when thinking about your target population. Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
In this episode, we interview James McCall, a survey methodologist at Westat. James shares what first drew him to surveys, and what drove him into a career of surveys. We talk about his role as a survey methodologist in industry. We discuss cognitive testing, data scripts, and other elements of the art and science of survey design. We also discuss our pet-peeves, such as matrix questions, check-all-that-apply questions, pre-testing, having too-short timelines, and more. James also shares advice for social scientists who are interested in pursuing a career in survey methodology. Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
In this episode, we explore the key design elements of effective surveys, emphasizing the importance of user-friendly experiences and reliable data collection. But first, in our free talk segment we discuss the compensation structure of the YouGov platform. Then, we highlight practical tips like strategic question ordering, clear language use, and consistent visual design. Additionally, the episode discusses behavioral aspects such as the appropriate use of forced responses and fair uses of attention checks to maintain respondent engagement without compromising data quality. Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
In this episode, we introduce a new free talk segment, where we discuss and celebrate Seon Yup's new job as chief survey methodologist at Kansas State University. We then explore why many people distrust surveys and some things we can do to regain their trust. We discuss key issues like sensitive topics, the impact of interviewer identity, and the prevalence of poorly designed surveys that fail to effect change. We also provide tips on recognizing legitimate surveys, emphasizing secure and ethically conducted inquiries. Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
In this episode, we explore the costs associated with conducting surveys. We start by debunking the common misconception that surveys are free, highlighting the significant expenses involved in various survey methods—from internet to mixed-mode surveys which are needed to collect useful data. We explore the astronomical costs of large-scale efforts like the U.S. Census, which can reach billions, and contrast these with more modest academic research surveys, which can still run into thousands of dollars. Special attention is given to the balance between cost and quality, underscoring that a higher investment often means better data. Through specific examples and a detailed breakdown of costs in both large and small-scale surveys, this episode provides a comprehensive overview of what it truly costs to gather reliable data. Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
In our second episode focusing on sample design, we dive into the intricacies of creating a sampling frame. We explain what a sampling frame is and why it's crucial for ensuring your survey reaches the right target population. We discuss the four key elements of an ideal sampling frame: comprehensiveness, accuracy, specificity, and accessibility. Additionally, we highlight real-world examples and practical tips for researchers, from using address-based databases to leveraging online survey platforms. The episode concludes with brief phone interviews with listeners, emphasizing the potential biases in online panels and the importance of a well-constructed sampling frame. And thank you to our listeners and friends who joined us for this episode. Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
This episode is the second in a series of writing good survey questions, where we dive deep into the intricacies of response options for survey questions, a crucial component often overlooked in survey design. We explore the significance of well-constructed response options in enhancing data quality and the pitfalls of poorly designed ones that can lead to confusion. Our focus will primarily be on closed-ended questions, discussing the different types of scales like categorical and continuous, and how to balance the resolution of your options to capture necessary details without overwhelming respondents. Join us as we unpack strategies to make your survey options exhaustive, exclusive, and free from bias. Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
In this episode, we delve into the art of crafting effective survey questions. We discuss the importance of clear and precise wording, avoiding biases, and the impact of question formats on data quality. Learn practical tips for designing questions that yield accurate and meaningful data, whether for academic research, market analysis, or feedback collection. Join us as we explore examples and demonstrate how to refine a simple question into a well-crafted survey item. Perfect for anyone looking to improve their survey design skills! Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
In this episode, we explore the Total Survey Design Method to maximize data quality. Discover how reducing errors, rooted in social exchange theory, can enhance your survey's effectiveness. We'll delve into the three key factors—cost, benefit, and trust—discussing strategies to minimize respondent burden, highlight benefits, and establish trust. Learn practical tips on simplifying surveys, using incentives, and emphasizing legitimacy. Perfect for anyone aiming to improve survey response rates and data accuracy. Tune in for an in-depth look at creating high-quality surveys! Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
This episode is a tribute and commemoration of Don Dillman, who is known for his contributions to survey methodology, particularly the development of the Tailored Design Method (TDM) for conducting surveys. The episode reflects on his work as a professor and a mentor, his impact on our careers, and his legacy. Our unscripted conversation includes personal anecdotes, discussions on his methodologies, and a reflection on Don's influence on our work. Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
In this episode of the Total Survey Design Podcast, we explore the four main sources of survey error through the engaging story of Mario, a local pizzeria owner aiming to conduct an ethical survey. We delve into coverage error, sampling error, measurement error, and non-response error, explaining how each can distort survey results. By using Mario's quest to honestly determine if his pizzeria is the best in town, we illustrate practical strategies for reducing these errors, offering listeners valuable insights into improving survey accuracy and reliability. Join us as we unravel the complexities of total survey error and its impact on survey design. Support the show Find us online at: instagram.com/totalsurveydesign/ https://taplink.cc/totalsurveydesign Contact us at: totalsurveydesign@gmail.com…
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

icon Daily Deals
icon Daily Deals
icon Daily Deals

Quick Reference Guide

Copyright 2025 | Privacy Policy | Terms of Service | | Copyright
Listen to this show while you explore
Play