Get AI summaries of any video or article — Sign up free
#SmartPLS4 Series 17 - How to Report Reflective Reflective Higher Order Construct thumbnail

#SmartPLS4 Series 17 - How to Report Reflective Reflective Higher Order Construct

Research With Fawad·
4 min read

Based on Research With Fawad's video on YouTube. If you like this content, support the original creators by watching, liking and subscribing to their content.

TL;DR

Model ISQ as a reflective–reflective higher-order construct using Reliability, Assurance, Empathy, and Responsiveness as its lower-order dimensions.

Briefing

Reflective higher-order constructs in PLS-SEM should be reported using the same reliability and validity checks used for reflective lower-order constructs—then summarized with a small number of tables rather than separate sections for every statistic. In this session, the focus is on a reflective–reflective higher-order construct called Internal Service Quality (ISQ), built from four reflective lower-order dimensions: Reliability, Assurance, Empathy, and Responsiveness.

After the model is re-estimated with the lower-order dimensions treated as indicators at the higher level, the reporting process starts with the measurement results for the higher-order construct. The outer loadings (reported as factor loadings) are checked first; they should look acceptable before moving on. Next come the reliability and convergent validity metrics for the higher-order construct itself—reported in the same way as for lower-order constructs. The session emphasizes that ISQ’s higher-order validity is established by assessing factor loadings, reliability, and convergent validity using the same logic applied earlier in the series.

For reliability, the session points to the standard PLS-SEM outputs: Cronbach’s alpha (α) and composite reliability (CR). For convergent validity, it uses the Average Variance Extracted (AVE). These values are pulled directly from the PLS algorithm output and formatted into a single summary table.

Discriminant validity is then reported using two common criteria: the HTMT ratio and the Fornell–Larcker criterion. The key reporting idea is to compare the higher-order construct (ISQ) against other constructs in the model, not to re-validate the lower-order constructs again. In the example workflow, the HTMT results are copied into a “Table 9” style discriminant validity table, and the Fornell–Larcker and HTMT tables are formatted for readability. The session highlights the interpretation: within-construct variance for ISQ is higher than shared variance with other constructs, which supports discriminant validity under the Fornell–Larcker criterion.

A practical takeaway is how to present results efficiently. For lower-order constructs, the series used separate reporting structures (factor loadings, indicator multicollinearity, reliability, convergent validity, and discriminant validity). At the higher-order level, the session recommends consolidating these into one section and using one or two tables to summarize the key statistics, since most estimates repeat the same measurement-model logic and only the higher-order construct changes.

Overall, the reporting template for a reflective–reflective higher-order construct boils down to: identify the higher-order construct and its subdimensions, report outer loadings, report reliability (α and CR) and convergent validity (AVE), then report discriminant validity (HTMT and Fornell–Larcker). The session’s workflow is designed to keep the write-up consistent with earlier lower-order reporting while avoiding unnecessary duplication of headings and tables.

Cornell Notes

Internal Service Quality (ISQ) is treated as a reflective–reflective higher-order construct in a PLS-SEM model, built from four reflective dimensions: Reliability, Assurance, Empathy, and Responsiveness. After re-estimating the model with these dimensions as indicators at the higher level, reporting follows the same measurement-model logic as for reflective lower-order constructs. The write-up should include outer loadings (factor loadings), reliability (Cronbach’s alpha and composite reliability), and convergent validity (AVE). Discriminant validity is then reported using HTMT and the Fornell–Larcker criterion by comparing ISQ against other constructs. For readability, the higher-order results are best summarized in one section with a small number of tables rather than separate headings for every statistic.

How should a reflective–reflective higher-order construct like ISQ be set up and validated before writing results?

ISQ is specified as a higher-order reflective construct with four lower-order dimensions—Reliability, Assurance, Empathy, and Responsiveness. The model is re-run so the lower-order dimensions act as indicators at the higher level. Then the higher-order construct is validated by checking outer loadings, reliability (α and CR), and convergent validity (AVE), using the same reflective measurement-model criteria applied earlier for lower-order constructs.

What reliability and convergent validity metrics are reported for the higher-order construct?

Reliability is reported using Cronbach’s alpha (α) and composite reliability (CR). Convergent validity is reported using AVE (Average Variance Extracted). These values are taken from the higher-order construct’s reliability/validity output and summarized in a table alongside the outer loadings.

What discriminant validity criteria are used for the higher-order construct, and how is the comparison framed?

Discriminant validity is assessed using HTMT ratio and the Fornell–Larcker criterion. The comparisons are made between the higher-order construct (ISQ) and the other constructs in the model, rather than re-comparing lower-order constructs that have already been validated.

What does the Fornell–Larcker interpretation look like in this workflow?

The session interprets discriminant validity as supported when within-construct variance for ISQ is higher than shared variance with other constructs. In practice, this means the ISQ diagonal element (under Fornell–Larcker) exceeds the off-diagonal shared-variance entries when comparing ISQ to other constructs.

How does the recommended reporting structure for higher-order constructs differ from lower-order constructs?

Lower-order constructs are typically reported with separate sections for factor loadings, indicator multicollinearity, reliability, convergent validity, and discriminant validity. For the higher-order reflective–reflective construct, the session recommends consolidating these into a single section and using one or two summary tables, because the same types of statistics are reported and only the higher-order construct changes.

Review Questions

  1. When ISQ is modeled as a reflective–reflective higher-order construct, which four dimensions serve as its indicators?
  2. Which metrics are used to report convergent validity and reliability for the higher-order construct?
  3. For discriminant validity at the higher-order level, which two criteria are reported and what is the comparison target?

Key Points

  1. 1

    Model ISQ as a reflective–reflective higher-order construct using Reliability, Assurance, Empathy, and Responsiveness as its lower-order dimensions.

  2. 2

    Re-run the PLS algorithm after adding the lower-order dimensions as indicators at the higher level before extracting higher-order measurement results.

  3. 3

    Report outer loadings (factor loadings) for the higher-order construct first, then reliability (Cronbach’s alpha and composite reliability) and convergent validity (AVE).

  4. 4

    Assess discriminant validity for the higher-order construct using HTMT ratio and the Fornell–Larcker criterion by comparing ISQ against other constructs.

  5. 5

    Avoid duplicating the full lower-order reporting structure at the higher-order level; use one consolidated section and a small number of summary tables for readability.

  6. 6

    Interpret discriminant validity under Fornell–Larcker by checking that within-construct variance for ISQ exceeds shared variance with other constructs.

Highlights

ISQ’s higher-order measurement results should be reported using the same reflective reliability and validity checks as lower-order constructs: outer loadings, α/CR, AVE, plus discriminant validity.
Discriminant validity at the higher-order level focuses on comparing ISQ with other constructs, using HTMT ratio and Fornell–Larcker rather than re-validating lower-order pieces.
A clean write-up consolidates higher-order estimates into one section with one or two tables, instead of repeating separate headings for every statistic.
The Fornell–Larcker interpretation hinges on within-construct variance for ISQ being higher than shared variance with other constructs.

Topics

Mentioned

  • PLS-SEM
  • ISQ
  • CR
  • AVE
  • HTMT