Get AI summaries of any video or article — Sign up free
28. SEMinR Series - Higher Order Construct Analysis  - Reflective-Formative thumbnail

28. SEMinR Series - Higher Order Construct Analysis - Reflective-Formative

Research With Fawad·
5 min read

Based on Research With Fawad's video on YouTube. If you like this content, support the original creators by watching, liking and subscribing to their content.

TL;DR

Validate every lower-order reflective construct first using reliability (CR/alpha) and validity (convergent and discriminant) before assessing higher-order constructs.

Briefing

Higher-order SEMinR modeling hinges on treating each construct type differently: reflective–reflective higher-order blocks get reliability/validity checks at the second-order level, while reflective–formative higher-order blocks require formative diagnostics (VIF, outer weights, and outer loadings) rather than the usual reflective criteria. In this walkthrough, internal marketing (IM) is modeled as a reflective–reflective higher-order construct, internal service quality (ISQ) as a reflective–formative higher-order construct, and organizational performance (OP) as a lower-order reflective construct—then the model is tested with mediation, using ISQ as the mediator between IM and OP.

The process starts by validating every lower-order reflective construct, regardless of whether it later feeds into a reflective–reflective or reflective–formative higher-order model. The lower-order reflective pieces are estimated first for reliability and validity using composite reliability (CR), Cronbach’s alpha, convergent validity, and discriminant validity. In the example, IM’s reflective dimensions—vision development and rewards—are validated, and ISQ’s reflective dimensions—assurance, reliability, empathy, and responsiveness—are also validated at the lower-order level. OP is validated as a separate lower-order reflective construct as well.

With the measurement models in place, the structural model is built by linking the independent variable (IM) to the mediator (ISQ) and then linking both IM and ISQ to the dependent variable (OP). The same path pattern is applied at the dimension level: IM dimensions connect to OP and to ISQ, while ISQ dimensions connect to OP. After estimating the model, the output is checked through reflective-model evaluation outputs such as loadings, reliability, HTMT, and cross-loadings.

Next comes the second-order assessment. For the reflective–reflective higher-order construct IM, reliability and validity are assessed at the higher-order level alongside its lower-order reflective components. Because IM is reflective–reflective, it uses the default mode (no explicit weights are needed). For ISQ, the higher-order construct is reflective–formative: the arrows run from the four reflective dimensions (assurance, reliability, empathy, responsiveness) into the formative higher-order composite ISQ, so weights matter. To specify ISQ as higher-order formative in SEMinR, the model requires setting the appropriate mode (via `wids mode SC B`).

ISQ’s validation follows formative rules. Reporting of reflective validity metrics for ISQ is skipped; instead, diagnostics are used: VIF values for the formative indicators must be below the threshold (VIF < 5), outer weights are checked for significance (some indicators can be insignificant), and outer loadings must exceed 0.50 and be significant to confirm indicator contribution. Bootstrapping then supports hypothesis testing and mediation. The mediation results show a significant specific indirect effect from IM to OP through ISQ, with t statistics exceeding 1.96 and confidence intervals that do not cross zero. The workflow ends with path coefficients, confidence intervals, and R-square values for the endogenous constructs, producing a complete reflective–reflective and reflective–formative higher-order SEMinR model ready for reporting.

Cornell Notes

The workflow validates a higher-order SEMinR model by splitting tasks by construct type. First, all lower-order reflective constructs are tested for reliability and validity using CR/alpha, convergent validity, and discriminant validity. Then the second-order layer is assessed: IM is treated as reflective–reflective, so it receives reflective reliability/validity checks at the higher-order level. ISQ is treated as reflective–formative, so it is validated with formative diagnostics—VIF for indicator multicollinearity, significance of outer weights, and outer loadings (typically requiring > 0.50). After measurement validation, bootstrapping is used to test mediation, showing a significant indirect effect from IM to organizational performance through ISQ.

Why validate lower-order constructs first, even when the final model includes higher-order constructs?

Because the higher-order measurement quality depends on the quality of its components. The workflow starts by estimating and validating every lower-order reflective construct (e.g., IM’s dimensions and ISQ’s dimensions, plus OP). Reliability and validity are checked using composite reliability (CR), Cronbach’s alpha, convergent validity, and discriminant validity. Only after these lower-order blocks pass are the second-order constructs assessed.

How does the validation logic differ between a reflective–reflective higher-order construct (IM) and a reflective–formative higher-order construct (ISQ)?

IM is reflective–reflective, so it follows reflective-model evaluation at the second-order level: reliability and validity are assessed similarly to lower-order reflective constructs. ISQ is reflective–formative, so reflective validity metrics are not the focus; instead, formative diagnostics are required. ISQ’s indicators feed into the higher-order composite, so the model checks VIF (< 5), outer weights (significance), and outer loadings (generally > 0.50) to confirm that the formative dimensions contribute meaningfully.

What specific diagnostics validate the higher-order formative construct ISQ?

Three main checks: (1) VIF values for ISQ’s formative indicators must be below 5 to avoid problematic collinearity; (2) outer weights are examined for statistical significance—some indicators may be insignificant, but the next check matters; (3) outer loadings must be sufficiently large (the walkthrough uses a 0.50 threshold) and significant, confirming indicator relevance even when outer weights are not all significant.

How is mediation tested after measurement validation?

Bootstrapping is used to estimate indirect effects. With ISQ as the mediator, the specific indirect effect from IM to organizational performance through ISQ is evaluated using t statistics and bias-corrected confidence intervals. Significance is indicated when t statistics exceed 1.96 and the confidence interval does not include zero.

What gets reported for reflective–reflective vs reflective–formative higher-order constructs?

For reflective–reflective constructs, reliability/validity reporting at both lower-order and higher-order levels is emphasized (loadings, CR/alpha, HTMT, cross-loadings). For reflective–formative higher-order constructs like ISQ, reflective validity reporting for the formative higher-order block is omitted; ISQ is validated via formative diagnostics instead. In the walkthrough, ISQ is excluded from certain reflective reporting tables (e.g., reliability/validity outputs), while formative validation results (VIF, outer weights, outer loadings) are used.

Review Questions

  1. If IM is reflective–reflective and ISQ is reflective–formative, which validation metrics would you use for each at the second-order level, and why?
  2. What thresholds are used for formative validation of ISQ (VIF and outer loadings), and how do outer weights significance results affect interpretation?
  3. How do bootstrapped t statistics and confidence intervals determine whether the indirect effect from IM to OP through ISQ is significant?

Key Points

  1. 1

    Validate every lower-order reflective construct first using reliability (CR/alpha) and validity (convergent and discriminant) before assessing higher-order constructs.

  2. 2

    Build the structural model by linking IM to ISQ and OP, and linking ISQ to OP, while preserving the dimension-to-construct path pattern.

  3. 3

    Treat IM (reflective–reflective) with second-order reflective reliability/validity checks, using default mode behavior without explicit formative weights.

  4. 4

    Treat ISQ (reflective–formative) with formative diagnostics: check VIF (< 5), evaluate outer weights significance, and confirm outer loadings (≥ 0.50) for indicator adequacy.

  5. 5

    Skip reflective reliability/validity reporting for the formative higher-order block (ISQ) and instead report formative validation outputs.

  6. 6

    Use bootstrapping to test mediation; declare the indirect effect significant when t statistics exceed 1.96 and confidence intervals exclude zero.

  7. 7

    Report final path coefficients, confidence intervals, and R-square values after measurement and mediation checks pass.

Highlights

IM is handled as a reflective–reflective higher-order construct, so second-order reliability/validity checks follow reflective-model logic.
ISQ is handled as a reflective–formative higher-order construct, so validation relies on VIF, outer weights, and outer loadings rather than reflective validity metrics.
Formative validation can show mixed outer-weight significance, but outer loadings above 0.50 still support indicator contribution.
Mediation is confirmed when the bootstrapped specific indirect effect from IM to OP through ISQ has t > 1.96 and a confidence interval that does not cross zero.

Topics

  • Higher-Order SEMinR
  • Reflective–Formative Constructs
  • Reflective–Reflective Constructs
  • Formative Validation
  • Mediation Bootstrapping

Mentioned

  • SEM
  • IV
  • DV
  • CR
  • HTMT
  • VIF
  • OP
  • IM
  • ISQ