28. SEMinR Series - Higher Order Construct Analysis - Reflective-Formative
Based on Research With Fawad's video on YouTube. If you like this content, support the original creators by watching, liking and subscribing to their content.
Validate every lower-order reflective construct first using reliability (CR/alpha) and validity (convergent and discriminant) before assessing higher-order constructs.
Briefing
Higher-order SEMinR modeling hinges on treating each construct type differently: reflective–reflective higher-order blocks get reliability/validity checks at the second-order level, while reflective–formative higher-order blocks require formative diagnostics (VIF, outer weights, and outer loadings) rather than the usual reflective criteria. In this walkthrough, internal marketing (IM) is modeled as a reflective–reflective higher-order construct, internal service quality (ISQ) as a reflective–formative higher-order construct, and organizational performance (OP) as a lower-order reflective construct—then the model is tested with mediation, using ISQ as the mediator between IM and OP.
The process starts by validating every lower-order reflective construct, regardless of whether it later feeds into a reflective–reflective or reflective–formative higher-order model. The lower-order reflective pieces are estimated first for reliability and validity using composite reliability (CR), Cronbach’s alpha, convergent validity, and discriminant validity. In the example, IM’s reflective dimensions—vision development and rewards—are validated, and ISQ’s reflective dimensions—assurance, reliability, empathy, and responsiveness—are also validated at the lower-order level. OP is validated as a separate lower-order reflective construct as well.
With the measurement models in place, the structural model is built by linking the independent variable (IM) to the mediator (ISQ) and then linking both IM and ISQ to the dependent variable (OP). The same path pattern is applied at the dimension level: IM dimensions connect to OP and to ISQ, while ISQ dimensions connect to OP. After estimating the model, the output is checked through reflective-model evaluation outputs such as loadings, reliability, HTMT, and cross-loadings.
Next comes the second-order assessment. For the reflective–reflective higher-order construct IM, reliability and validity are assessed at the higher-order level alongside its lower-order reflective components. Because IM is reflective–reflective, it uses the default mode (no explicit weights are needed). For ISQ, the higher-order construct is reflective–formative: the arrows run from the four reflective dimensions (assurance, reliability, empathy, responsiveness) into the formative higher-order composite ISQ, so weights matter. To specify ISQ as higher-order formative in SEMinR, the model requires setting the appropriate mode (via `wids mode SC B`).
ISQ’s validation follows formative rules. Reporting of reflective validity metrics for ISQ is skipped; instead, diagnostics are used: VIF values for the formative indicators must be below the threshold (VIF < 5), outer weights are checked for significance (some indicators can be insignificant), and outer loadings must exceed 0.50 and be significant to confirm indicator contribution. Bootstrapping then supports hypothesis testing and mediation. The mediation results show a significant specific indirect effect from IM to OP through ISQ, with t statistics exceeding 1.96 and confidence intervals that do not cross zero. The workflow ends with path coefficients, confidence intervals, and R-square values for the endogenous constructs, producing a complete reflective–reflective and reflective–formative higher-order SEMinR model ready for reporting.
Cornell Notes
The workflow validates a higher-order SEMinR model by splitting tasks by construct type. First, all lower-order reflective constructs are tested for reliability and validity using CR/alpha, convergent validity, and discriminant validity. Then the second-order layer is assessed: IM is treated as reflective–reflective, so it receives reflective reliability/validity checks at the higher-order level. ISQ is treated as reflective–formative, so it is validated with formative diagnostics—VIF for indicator multicollinearity, significance of outer weights, and outer loadings (typically requiring > 0.50). After measurement validation, bootstrapping is used to test mediation, showing a significant indirect effect from IM to organizational performance through ISQ.
Why validate lower-order constructs first, even when the final model includes higher-order constructs?
How does the validation logic differ between a reflective–reflective higher-order construct (IM) and a reflective–formative higher-order construct (ISQ)?
What specific diagnostics validate the higher-order formative construct ISQ?
How is mediation tested after measurement validation?
What gets reported for reflective–reflective vs reflective–formative higher-order constructs?
Review Questions
- If IM is reflective–reflective and ISQ is reflective–formative, which validation metrics would you use for each at the second-order level, and why?
- What thresholds are used for formative validation of ISQ (VIF and outer loadings), and how do outer weights significance results affect interpretation?
- How do bootstrapped t statistics and confidence intervals determine whether the indirect effect from IM to OP through ISQ is significant?
Key Points
- 1
Validate every lower-order reflective construct first using reliability (CR/alpha) and validity (convergent and discriminant) before assessing higher-order constructs.
- 2
Build the structural model by linking IM to ISQ and OP, and linking ISQ to OP, while preserving the dimension-to-construct path pattern.
- 3
Treat IM (reflective–reflective) with second-order reflective reliability/validity checks, using default mode behavior without explicit formative weights.
- 4
Treat ISQ (reflective–formative) with formative diagnostics: check VIF (< 5), evaluate outer weights significance, and confirm outer loadings (≥ 0.50) for indicator adequacy.
- 5
Skip reflective reliability/validity reporting for the formative higher-order block (ISQ) and instead report formative validation outputs.
- 6
Use bootstrapping to test mediation; declare the indirect effect significant when t statistics exceed 1.96 and confidence intervals exclude zero.
- 7
Report final path coefficients, confidence intervals, and R-square values after measurement and mediation checks pass.