Get AI summaries of any video or article — Sign up free
LESSON 12 - QUANTITATIVE RESEARCH DESIGNS: SURVEY, EX POST FACTO & EXPERIMENTAL thumbnail

LESSON 12 - QUANTITATIVE RESEARCH DESIGNS: SURVEY, EX POST FACTO & EXPERIMENTAL

5 min read

Based on RESEARCH METHODS CLASS WITH PROF. LYDIAH WAMBUGU's video on YouTube. If you like this content, support the original creators by watching, liking and subscribing to their content.

TL;DR

A research design is a master plan that specifies how and where data will be collected and analyzed to answer research questions or test hypotheses.

Briefing

Quantitative research design is the “master plan” that dictates how data will be collected, analyzed, and reported to answer research questions or test hypotheses—and choosing the right design depends on the problem, the study’s purpose, researcher expertise, the target population, available resources, and who will use the findings. Without a plan, data collection and analysis become aimless; with one, researchers can align sampling, instruments, and statistical tools to the kind of evidence needed.

A research design is defined as procedures and a blueprint for collecting, analyzing, interpreting, and reporting data. It also guides practical decisions such as sample selection methods, the instruments used to measure variables, and the statistical techniques applied during analysis. The lesson breaks design down into core elements: (1) the research approach (quantitative, qualitative, mixed), (2) data collection methods (including instrument development, administration, and timing), (3) the population and sample size with sampling techniques, and (4) data analysis strategy—statistical procedures for quantitative data, inductive analysis for qualitative data, or a combination for mixed methods.

Selection of a design starts with the research problem: whether it calls for quantitative data, qualitative data, or both. Next comes the purpose of the study—descriptive, explanatory, or exploratory—which narrows the design choice. Researcher knowledge and experience matter too, since comfort with quantitative or qualitative data collection and analysis affects feasibility. The population of interest also shapes the decision: accessible large populations often fit quantitative approaches, while smaller, information-rich groups are more common in qualitative work. Constraints like time and money influence what can realistically be conducted, and the intended audience’s preferences—narrative versus statistical reporting—can further steer the choice.

The lesson then lays out three main quantitative designs used in social science. First is the survey, a non-experimental design that questions people and records responses to describe population characteristics. Surveys typically rely on probability sampling for large populations, use structured questionnaires or schedules (including interview or observation schedules), and measure variables numerically. Survey analysis uses statistical methods to describe trends and test hypotheses. Three survey types are highlighted: cross-sectional surveys (one point in time), correlational surveys (quantifying the degree of relationship between variables without implying causality), and longitudinal surveys (follow-ups over time). Longitudinal work includes trend analysis (tracking changes in a population over time), cohort studies (following groups with shared characteristics using different samples across periods), and panel studies (following the same sample over time).

Second is the ex post facto (causal comparative) design, which studies variables after the fact—when the “exposure” has already occurred and the researcher looks back to identify factors behind changes in a dependent variable. Because researchers do not manipulate the independent variable, groups are pre-existing, and the design mimics experiments through comparisons of similar groups. Limitations are emphasized: lack of control over groups, risk of spurious or reversed cause-and-effect relationships, and the need for repeated measures to strengthen conclusions. Third is the experimental design, which determines cause-and-effect through manipulation; detailed coverage is reserved for the next lesson.

Cornell Notes

Quantitative research design is the master plan for how and where data will be collected, analyzed, and reported to answer research questions or test hypotheses. Design choice depends on the research problem, the study’s purpose (descriptive, explanatory, exploratory), researcher experience, the population and sampling feasibility, available resources, and what the findings’ consumers prefer (narrative vs statistical reporting). The lesson identifies three main quantitative designs: surveys (non-experimental, often probability-sampled and numerically measured), ex post facto/causal comparative (after-the-fact comparisons of pre-existing groups without independent-variable manipulation), and experimental designs (cause-and-effect through manipulation). Surveys can be cross-sectional, correlational, or longitudinal (trend, cohort, panel).

What makes a research design more than a “plan to collect data”?

A research design is a master plan that specifies how and where data will be collected and analyzed to answer research questions or test hypotheses. It also guides procedures for sampling (who is selected and how), instrument choice and administration (what is measured and when), and the analysis approach (statistical procedures for quantitative data, inductive analysis for qualitative data, or both for mixed methods).

How do the lesson’s elements of a research design connect to real decisions during a study?

The elements translate into concrete choices: the research approach determines whether the study uses quantitative, qualitative, or mixed methods; data collection methods determine how instruments are developed, administered, and timed; the population and sample size determine sampling techniques and feasibility; and data analysis methods determine whether statistical procedures, inductive analysis, or a combination will be used based on the type of data collected.

Why does a correlational survey not establish causality?

Correlational surveys quantify the degree of relationship between two or more variables in a population, but they do not manipulate variables. Because the relationship is measured rather than caused through intervention, the results describe association only and cannot confirm that one variable produces the other.

What distinguishes trend analysis, cohort studies, and panel studies within longitudinal surveys?

Trend analysis tracks how a population changes over time by repeatedly surveying the population’s characteristics across periods. Cohort studies follow groups sharing the same characteristics over time, but they use different samples at different periods while keeping the population definition constant. Panel studies follow the same sample over time, repeatedly measuring the same individuals across multiple time points.

What does “ex post facto” mean, and why does it limit causal claims?

“Ex post facto” means “from after the fact.” The researcher studies variables after an exposure or intervention has already occurred, then looks back to identify factors behind observed changes in the dependent variable. Since the independent variable is not manipulated and groups are pre-existing, the researcher lacks control, increasing the risk of spurious relationships or reversed cause-and-effect.

How does an experimental design differ from ex post facto in establishing causality?

Experimental designs determine cause-and-effect by manipulating the independent variable, allowing researchers to compare outcomes under different controlled conditions. Ex post facto designs compare pre-existing groups without manipulation, so they can suggest relationships but face stronger threats to causal interpretation.

Review Questions

  1. In your own words, list the four elements of a research design and match each element to a practical decision a researcher must make.
  2. Compare survey, ex post facto/causal comparative, and experimental designs: what is manipulated (if anything), what is being compared, and what kind of conclusions each design supports.
  3. Give an example of when a correlational survey would be appropriate and explain why it would not be used to prove causality.

Key Points

  1. 1

    A research design is a master plan that specifies how and where data will be collected and analyzed to answer research questions or test hypotheses.

  2. 2

    Design decisions should align with the research problem, the study’s purpose (descriptive, explanatory, exploratory), and the researcher’s experience with quantitative vs qualitative work.

  3. 3

    Sampling strategy, instrument development/administration, and analysis method are core parts of a quantitative research design.

  4. 4

    Surveys are non-experimental quantitative designs used to describe population characteristics, typically using structured questionnaires and numerical measurement.

  5. 5

    Correlational surveys measure relationships between variables without implying causality because no independent-variable manipulation occurs.

  6. 6

    Ex post facto (causal comparative) designs study after-the-fact changes by comparing pre-existing groups, but they face limitations such as lack of control and risks of spurious or reversed causality.

  7. 7

    Experimental designs determine causality through manipulation, which is why they are reserved for detailed treatment next.

Highlights

Research design functions like a blueprint: it coordinates sampling, instruments, timing, and statistical analysis so the study can answer the research question.
Surveys can be cross-sectional, correlational, or longitudinal; longitudinal work splits into trend analysis, cohort studies, and panel studies.
Ex post facto research looks backward—after exposure has already happened—so causal conclusions are inherently more tentative than in experiments.

Topics

Mentioned