LESSON 12 - QUANTITATIVE RESEARCH DESIGNS: SURVEY, EX POST FACTO & EXPERIMENTAL
Based on RESEARCH METHODS CLASS WITH PROF. LYDIAH WAMBUGU's video on YouTube. If you like this content, support the original creators by watching, liking and subscribing to their content.
A research design is a master plan that specifies how and where data will be collected and analyzed to answer research questions or test hypotheses.
Briefing
Quantitative research design is the “master plan” that dictates how data will be collected, analyzed, and reported to answer research questions or test hypotheses—and choosing the right design depends on the problem, the study’s purpose, researcher expertise, the target population, available resources, and who will use the findings. Without a plan, data collection and analysis become aimless; with one, researchers can align sampling, instruments, and statistical tools to the kind of evidence needed.
A research design is defined as procedures and a blueprint for collecting, analyzing, interpreting, and reporting data. It also guides practical decisions such as sample selection methods, the instruments used to measure variables, and the statistical techniques applied during analysis. The lesson breaks design down into core elements: (1) the research approach (quantitative, qualitative, mixed), (2) data collection methods (including instrument development, administration, and timing), (3) the population and sample size with sampling techniques, and (4) data analysis strategy—statistical procedures for quantitative data, inductive analysis for qualitative data, or a combination for mixed methods.
Selection of a design starts with the research problem: whether it calls for quantitative data, qualitative data, or both. Next comes the purpose of the study—descriptive, explanatory, or exploratory—which narrows the design choice. Researcher knowledge and experience matter too, since comfort with quantitative or qualitative data collection and analysis affects feasibility. The population of interest also shapes the decision: accessible large populations often fit quantitative approaches, while smaller, information-rich groups are more common in qualitative work. Constraints like time and money influence what can realistically be conducted, and the intended audience’s preferences—narrative versus statistical reporting—can further steer the choice.
The lesson then lays out three main quantitative designs used in social science. First is the survey, a non-experimental design that questions people and records responses to describe population characteristics. Surveys typically rely on probability sampling for large populations, use structured questionnaires or schedules (including interview or observation schedules), and measure variables numerically. Survey analysis uses statistical methods to describe trends and test hypotheses. Three survey types are highlighted: cross-sectional surveys (one point in time), correlational surveys (quantifying the degree of relationship between variables without implying causality), and longitudinal surveys (follow-ups over time). Longitudinal work includes trend analysis (tracking changes in a population over time), cohort studies (following groups with shared characteristics using different samples across periods), and panel studies (following the same sample over time).
Second is the ex post facto (causal comparative) design, which studies variables after the fact—when the “exposure” has already occurred and the researcher looks back to identify factors behind changes in a dependent variable. Because researchers do not manipulate the independent variable, groups are pre-existing, and the design mimics experiments through comparisons of similar groups. Limitations are emphasized: lack of control over groups, risk of spurious or reversed cause-and-effect relationships, and the need for repeated measures to strengthen conclusions. Third is the experimental design, which determines cause-and-effect through manipulation; detailed coverage is reserved for the next lesson.
Cornell Notes
Quantitative research design is the master plan for how and where data will be collected, analyzed, and reported to answer research questions or test hypotheses. Design choice depends on the research problem, the study’s purpose (descriptive, explanatory, exploratory), researcher experience, the population and sampling feasibility, available resources, and what the findings’ consumers prefer (narrative vs statistical reporting). The lesson identifies three main quantitative designs: surveys (non-experimental, often probability-sampled and numerically measured), ex post facto/causal comparative (after-the-fact comparisons of pre-existing groups without independent-variable manipulation), and experimental designs (cause-and-effect through manipulation). Surveys can be cross-sectional, correlational, or longitudinal (trend, cohort, panel).
What makes a research design more than a “plan to collect data”?
How do the lesson’s elements of a research design connect to real decisions during a study?
Why does a correlational survey not establish causality?
What distinguishes trend analysis, cohort studies, and panel studies within longitudinal surveys?
What does “ex post facto” mean, and why does it limit causal claims?
How does an experimental design differ from ex post facto in establishing causality?
Review Questions
- In your own words, list the four elements of a research design and match each element to a practical decision a researcher must make.
- Compare survey, ex post facto/causal comparative, and experimental designs: what is manipulated (if anything), what is being compared, and what kind of conclusions each design supports.
- Give an example of when a correlational survey would be appropriate and explain why it would not be used to prove causality.
Key Points
- 1
A research design is a master plan that specifies how and where data will be collected and analyzed to answer research questions or test hypotheses.
- 2
Design decisions should align with the research problem, the study’s purpose (descriptive, explanatory, exploratory), and the researcher’s experience with quantitative vs qualitative work.
- 3
Sampling strategy, instrument development/administration, and analysis method are core parts of a quantitative research design.
- 4
Surveys are non-experimental quantitative designs used to describe population characteristics, typically using structured questionnaires and numerical measurement.
- 5
Correlational surveys measure relationships between variables without implying causality because no independent-variable manipulation occurs.
- 6
Ex post facto (causal comparative) designs study after-the-fact changes by comparing pre-existing groups, but they face limitations such as lack of control and risks of spurious or reversed causality.
- 7
Experimental designs determine causality through manipulation, which is why they are reserved for detailed treatment next.