Get AI summaries of any video or article — Sign up free
5. Complex Higher Order Construct/Second Order Analysis with 3 Hierarchical Models (See Description) thumbnail

5. Complex Higher Order Construct/Second Order Analysis with 3 Hierarchical Models (See Description)

Research With Fawad·
5 min read

Based on Research With Fawad's video on YouTube. If you like this content, support the original creators by watching, liking and subscribing to their content.

TL;DR

Use disjoint two-stage modeling: validate lower-order constructs in stage one, then validate higher-order constructs in stage two using latent variable scores as indicators.

Briefing

A complex Smart PLS model can be built and tested when constructs mix reflective–formative measurement, higher-order constructs, and moderation—by using a disjoint two-stage workflow that first validates lower-order components and then validates the higher-order constructs using latent variable scores. The key move is treating each lower-order dimension as an “indicator” for its higher-order construct in stage two, while keeping the measurement type consistent (reflective–reflective for some higher-order constructs, reflective–formative for the mediator).

The session starts with a fictitious but detailed setup: an independent variable (IV) measured as reflective–reflective higher order, a mediator measured as reflective–formative higher order, and a moderating variable measured as reflective–reflective higher order. The dependent side is represented by multiple lower-order constructs (DV1–DV4), which receive paths from the mediator and from the interaction created by moderation. The moderating variable is designed to moderate the mediator-to-dependent relationships (e.g., between the mediating variable and DV1, DV2, and so on), creating moderation effects that Smart PLS must estimate in the structural model.

To handle higher-order constructs, the workflow uses the disjoint two-stage approach. In stage one, only the lower-order constructs are modeled—without the higher-order construct nodes in the path model. Each lower-order construct is linked directly to the other theoretically related constructs. This stage focuses on reliability and validity: the presenter runs the PLS algorithm, checks discriminant validity using HTMT, and flags a problem between DV3 and DV4 when HTMT exceeds 0.90. The fix is to investigate cross-loadings and/or outer loadings (even if outer loadings look acceptable at first glance), because discriminant validity issues often come from overlap between indicators.

Stage two begins after latent variable scores are generated in stage one. Those scores—one per lower-order dimension—are exported (e.g., via Excel) and imported back into the dataset. In stage two, the higher-order constructs are reintroduced, but now their indicators are the latent variable scores from stage one. Measurement validation then differs by construct type. For reflective–reflective higher-order constructs, the checks emphasize composite reliability and convergent validity; the session notes a low loading for one IV subdimension (e.g., “complexity”), suggesting potential deletion if reliability/validity thresholds are not met. Discriminant validity is rechecked for the higher-order measurement model, again focusing on the DV3–DV4 HTMT issue.

The mediator is reflective–formative at the higher-order level, so validation shifts to collinearity and indicator contribution. The procedure includes checking VIF values (must be < 5), testing outer weights via bootstrapping, and using outer loadings as a secondary check (outer loadings ideally > 0.5; if not significant, consider removing indicators). In the example results, some outer weights are insignificant, but outer loadings are significant and VIF diagnostics show no multicollinearity, so indicators are retained.

Finally, the structural model is tested with bootstrapping (noting that complex models may take time). The results show a significant effect from IV to the mediator, and the mediator significantly affects the dependent constructs. Moderation is mixed: two moderation paths are significant while the rest are insignificant. Mediation is assessed by inspecting the indirect effects in the structural results. The overall takeaway is a practical blueprint: validate lower-order constructs first, generate latent variable scores, rebuild higher-order measurement models in stage two with the correct reflective/formative settings, then run bootstrapped structural tests including moderation.

Cornell Notes

The model is tested in Smart PLS using a disjoint two-stage approach to handle higher-order constructs plus moderation. Stage one estimates and validates only the lower-order constructs, checking reliability and validity (including HTMT discriminant validity) and generating latent variable scores. Stage two imports those latent variable scores as indicators for the higher-order constructs, then validates higher-order measurement differently by type: reflective–reflective uses composite reliability and convergent validity, while reflective–formative relies on VIF (<5), outer weights, and outer loadings (often >0.5) plus significance checks. After measurement validation, bootstrapping evaluates the structural paths, where IV affects the mediator, the mediator affects dependent constructs, and moderation produces some significant and some insignificant interaction effects.

Why does the disjoint two-stage approach matter for higher-order constructs in Smart PLS?

It prevents the higher-order construct from being included in the first-stage path model. Stage one estimates only the lower-order components and validates them directly, then produces latent variable scores. Stage two uses those scores as indicators for the higher-order construct nodes, allowing the measurement model to be validated with the correct reflective/formative rules.

What is the practical workflow for handling discriminant validity problems like HTMT > 0.90 between DV3 and DV4?

After running PLS algorithm in stage one, HTMT is checked for discriminant validity. If DV3–DV4 exceeds 0.90, the next step is to diagnose overlap: inspect cross-loadings and outer loadings to see whether indicators are loading too strongly on multiple constructs. If overlap is driven by weak or redundant indicators, indicators may need to be removed or reassigned based on the diagnostic results.

How are latent variable scores used when moving from stage one to stage two?

Each lower-order dimension becomes an “item” for its higher-order construct in stage two. After stage one, latent variable scores are generated by the PLS algorithm, exported (e.g., copied into Excel), and imported back into the dataset. In stage two, those imported latent scores are dragged and dropped as indicators for the higher-order construct nodes.

How does validation differ between reflective–reflective and reflective–formative higher-order constructs?

For reflective–reflective higher-order constructs, the checks emphasize composite reliability and convergent validity, and discriminant validity via HTMT. For reflective–formative higher-order constructs (like the mediator in the example), validation focuses on collinearity (VIF < 5), outer weights significance (from bootstrapping), and outer loadings (commonly assessed against a 0.5 threshold). Even if outer weights are insignificant, significant outer loadings can justify retaining indicators when multicollinearity is not present.

How is moderation tested once measurement models are validated?

After building the measurement model with higher-order constructs and their indicators, the structural model is bootstrapped to test paths including moderation. The example reports that IV significantly affects the mediator, the mediator significantly affects dependent constructs, and only some moderation relationships are significant—two significant moderation effects and the rest insignificant.

Review Questions

  1. In disjoint two-stage higher-order modeling, what exactly changes between stage one and stage two regarding which constructs appear in the path model?
  2. If HTMT indicates discriminant validity failure between two dependent constructs (e.g., DV3 and DV4), what diagnostics should be checked next and why?
  3. For a reflective–formative higher-order mediator, which diagnostics are most important (VIF, outer weights, outer loadings), and how do significance results influence indicator removal decisions?

Key Points

  1. 1

    Use disjoint two-stage modeling: validate lower-order constructs in stage one, then validate higher-order constructs in stage two using latent variable scores as indicators.

  2. 2

    In stage one, run PLS algorithm and check reliability and validity; use HTMT for discriminant validity and investigate cross-loadings when HTMT exceeds thresholds (e.g., >0.90).

  3. 3

    Export latent variable scores from stage one and import them into the dataset so they can serve as indicators for higher-order constructs in stage two.

  4. 4

    Validate reflective–reflective higher-order constructs with composite reliability and convergent validity, and re-check discriminant validity (HTMT) at the higher-order level.

  5. 5

    Validate reflective–formative higher-order constructs by checking VIF (<5), bootstrapped outer weights, and outer loadings (often >0.5) before deciding on indicator removal.

  6. 6

    After measurement validation, run bootstrapping for the structural model to test direct effects, mediation, and moderation; expect moderation effects to vary across dependent constructs.

Highlights

Disjoint two-stage modeling turns lower-order dimensions into latent variable score “items” for higher-order constructs in stage two.
HTMT discriminant validity can flag specific construct pairs (DV3–DV4) even when outer loadings look acceptable, forcing cross-loading diagnostics.
Reflective–formative higher-order validation can retain indicators with insignificant outer weights if outer loadings are significant and VIF shows no multicollinearity.
Moderation results can be selective: some interaction paths come out significant while others remain insignificant under bootstrapping.

Topics

Mentioned