Get AI summaries of any video or article — Sign up free
Systematic map -Frequently asked questions thumbnail

Systematic map -Frequently asked questions

6 min read

Based on Systematic review and Primary research - Q & A's video on YouTube. If you like this content, support the original creators by watching, liking and subscribing to their content.

TL;DR

Systematic maps map the breadth of evidence for broad, policy-relevant questions by cataloging studies across interventions, populations, outcomes, and designs.

Briefing

Systematic maps are designed to map the breadth of evidence on a topic—often for policy questions—by cataloging studies across interventions, populations, outcomes, and study designs, then highlighting where evidence is abundant, thin, or missing. Like systematic reviews, they follow a rigorous, transparent process, but they prioritize coverage over synthesis. That makes them especially useful when a topic is broad or multifaceted—such as involving multiple interventions, multiple populations, multiple outcomes, or evidence that isn’t limited to primary studies.

The core purpose is practical: systematic maps help teams understand the state of knowledge, locate policy-relevant evidence, and surface knowledge gaps and “knowledge clusters” that may later be suitable for deeper secondary research. A common pathway is a two-stage approach: first use a systematic map to characterize the evidence base, then select smaller subsets of studies that can answer narrower questions through a full systematic review. In other words, systematic maps act as an evidence-scanning tool that can guide where more intensive synthesis is worth the effort.

A systematic map typically presents evidence in a structured matrix—intervention categories as rows and outcome domains as columns—so patterns become visible at a glance. The map can also include counts such as the number of articles, publications per year, studies by country, intervention types, and study designs. Trends over time, knowledge gaps, and knowledge clusters are identified by examining these distributions.

Many systematic maps use a “traffic light” quality scheme: red indicates low-quality evidence and green indicates high-quality evidence. Circle size often represents the volume of evidence, so areas with lots of studies stand out from those with sparse coverage. Filters—such as region, population subgroup, or study design—allow users to zoom in on specific slices of the evidence base. User-friendly features like summaries and links back to sources are also common, helping readers move from the map to the underlying studies.

Key distinctions separate systematic maps from systematic reviews. Systematic maps usually use broader, more descriptive map questions, while systematic reviews tend to focus on narrower questions that support qualitative, quantitative, or mixed-method synthesis. Search strategies in systematic maps can include both primary and secondary research without the same design restrictions that often apply in systematic reviews (for example, limiting to randomized controlled trials or to qualitative studies). Screening and data extraction in maps can rely on limited information rather than requiring full-text for every included record. Critical appraisal is optional in systematic maps, whereas it is compulsory in systematic reviews. Finally, systematic maps generally do not synthesize study results; they instead report trends, gaps, and clusters.

The transcript also distinguishes related approaches: evidence gap maps (developed by 3ie, the International Initiative for Impact Evaluation) are thematic collections of completed and ongoing systematic reviews and impact evaluations, built with similar mapping methods. Broader variants include “mega maps,” which cover large sectors and include only systematic reviews and other maps, and “maps of maps,” which aggregate maps across many sectors.

Methodologically, systematic maps follow six stages: forming the review team and stakeholders, searching for evidence, screening, coding, optional critical appraisal, and finally describing and visualizing the map. Protocols and frameworks (often using PEOS—population, exposure/intervention, outcomes, and study design—dimensions) guide how rows and columns are defined, how coding forms are built, and how results are analyzed and reported. Software tools mentioned include EP mapper (from EPPI-Centre/EP reviewer ecosystem), Tableau, and tools used by 3ie for evidence gap maps. The transcript closes with examples of published systematic maps and evidence gap maps in journals and on organizational websites, underscoring that these products can be disseminated as journal articles or guidance-linked reports.

Cornell Notes

Systematic maps provide a structured, visual inventory of research evidence across a topic, typically using intervention categories as rows and outcome domains as columns. They are built to answer broad, policy-relevant questions by showing evidence quantity, quality (often via traffic-light colors), and patterns over time, while also flagging knowledge gaps and clusters. Unlike systematic reviews, systematic maps usually do not synthesize results; they catalog and characterize the evidence base so teams can later select subsets for deeper systematic review. Evidence gap maps are a related approach developed by 3ie, focusing on thematic collections of completed and ongoing systematic reviews and impact evaluations. Protocols and frameworks (often PEOS-based) guide scope, coding, and reporting, and tools like EP mapper and Tableau support visualization.

Why do teams use a systematic map instead of going straight to a systematic review?

Systematic maps are built for broad, multifaceted questions—especially when multiple interventions, populations, or outcomes are involved, or when evidence isn’t limited to primary studies. By cataloging the evidence base first, they reveal where evidence is plentiful, where it is weak, and where gaps exist. That characterization can then drive a two-stage strategy: identify smaller, focused subsets of studies and run systematic reviews on those targeted areas.

What does a typical systematic map look like, and how do readers interpret it?

A common format is a matrix: intervention categories on one axis (rows) and outcome domains on the other (columns). Evidence is often displayed with colored circles for quality (red for low quality, green for high quality) and circle size for volume (larger circles mean more evidence). Filters such as region, population subgroup, or study design help users examine specific slices, while summaries and links connect the map back to source studies.

How do systematic maps differ from systematic reviews in scope, methods, and outputs?

Systematic maps use broader map questions and can include both primary and secondary research without the same design restrictions often used in systematic reviews. Screening and data extraction can rely on limited information in maps, whereas systematic reviews typically require full text for included studies and extract more detailed findings. Critical appraisal is optional in maps but compulsory in systematic reviews. Most importantly, systematic reviews synthesize results (qualitative, quantitative, or mixed), while systematic maps generally report trends, gaps, and clusters without synthesizing outcomes.

What is an evidence gap map, and how is it related to systematic mapping?

An evidence gap map is a thematic collection of completed and ongoing systematic reviews and impact evaluations, developed by 3ie (International Initiative for Impact Evaluation). It uses similar mapping mechanics—searching, screening, and cataloging evidence—but uses 3ie terminology. The transcript also notes related terms: mega maps (broader sector coverage including systematic reviews and other maps) and maps of maps (very broad scope that includes only other maps).

What are the main stages in producing a systematic map?

The process is summarized in six stages: (1) establish the review team, engage stakeholders, set scope and map question, define inclusion criteria, and develop a protocol; (2) search for evidence; (3) screen evidence; (4) code; (5) optionally conduct critical appraisal; and (6) describe and visualize the map in the reporting stage.

Which software tools are mentioned for building maps, and what are they used for?

EP mapper is highlighted as a tool associated with EPPI-Centre/EP reviewer users, used to visualize systematic maps and evidence. Tableau is mentioned as a visualization-focused option. For evidence gap maps, 3ie has its own software and guidance, with details available on the 3ie website and Campbell guidance for Campbell evidence gap maps.

Review Questions

  1. What design features (axes, color/size conventions, filters) help a systematic map communicate evidence quantity, quality, and gaps?
  2. List at least three methodological differences between systematic maps and systematic reviews described in the transcript.
  3. How does a protocol and a framework (such as PEOS) shape the coding and reporting of a systematic map?

Key Points

  1. 1

    Systematic maps map the breadth of evidence for broad, policy-relevant questions by cataloging studies across interventions, populations, outcomes, and designs.

  2. 2

    A common two-stage workflow uses a systematic map to characterize the evidence base, then selects subsets for focused systematic reviews.

  3. 3

    Systematic maps often use a matrix layout (intervention categories vs outcome domains) with traffic-light quality coding and circle size to represent evidence volume.

  4. 4

    Systematic maps typically do not synthesize study results; they report trends, knowledge gaps, and knowledge clusters instead.

  5. 5

    Compared with systematic reviews, systematic maps can include both primary and secondary research, may use limited data extraction, and treat critical appraisal as optional.

  6. 6

    Evidence gap maps (3ie) are thematic collections of completed and ongoing systematic reviews and impact evaluations built with similar mapping methods.

  7. 7

    Tools like EP mapper and Tableau support visualization, while 3ie and Campbell provide guidance and software for evidence gap maps and related products.

Highlights

Systematic maps are built for breadth: they reveal where evidence exists, where it’s weak, and where policy-relevant knowledge gaps remain—without performing outcome synthesis.
Traffic-light quality coding (red low, green high) combined with circle size (evidence volume) turns complex evidence landscapes into an interpretable visual grid.
A two-stage strategy is central: map first to characterize the evidence base, then run systematic reviews on targeted clusters.
Evidence gap maps (3ie) extend mapping into thematic collections of systematic reviews and impact evaluations, with related formats like mega maps and maps of maps.

Topics

  • Systematic Mapping
  • Evidence Gap Maps
  • Systematic Review vs Map
  • Evidence Synthesis
  • PEOS Framework

Mentioned

  • PEOS
  • 3ie
  • EP mapper