Validation of the Digestive System Concept Scale for 7th‑Grade Students: Integrating Factor Analysis and Rasch Modeling
Humans construct knowledge by integrating new information with their existing cognitive structures (Pritchard, 2017). When a learner's prior conceptions clash with instructional materials, misconceptions arise, but resilient ideas that can obstruct understanding and hinder further learning (Duit & Treagust, 2003). Misconceptions in science are well‑documented and notoriously persistent across age groups and domains (Smith et al., 1994; Leonard et al., 2014). For instance, in biology, students tend to think that plants absorb food in the soil or that a human being breathes in oxygen and breathes out only carbon dioxide. These types of myths do not only misrepresent a learner’s understanding of the phenomena of science, but also interfere with the learner’s ability to think in an integrated manner, thus, stifling learning (Vosniadou, 2020).
Within the realm of human physiology, the digestive system is an area where misconceptions flourish. Previous studies have identified that middle‑school and high‑school students believe digestion occurs exclusively in the stomach, that chemical and physical digestion never occur concurrently, or that nutrients are completely absorbed in a single organ (Gul et al., 2024; Uğur, 2010). Educators occasionally reinforce analogous misconceptions when textbooks present vague explanations or when their own mastery of the subject matter is inadequate (Hewson & Hewson, 1983). Such inaccuracies endure within undergraduate cohorts as well as among pre-service teachers, thereby revealing the institutional rather than the incidental character of the difficulty (Griffard & Wandersee, 2001; Dry, 1998). Recognizing and addressing students' misconceptions is therefore a crucial task for science educators (Gil‑Perez & Carrascosa, 1990; Suprapto, 2020). To do so effectively requires reliable tools that can diagnose misconceptions and monitor conceptual change over time.
Assessing misconceptions poses several challenges. Misconceptions are often nuanced and context‑dependent; thus, instruments must be carefully designed to capture variations in understanding (Treagust, 1988). Because correct responses may not always reflect deep conceptual understanding, some students may guess or memorize definitions, many researchers advocate for two‑tier or two‑stage diagnostic tests that require students not only to select an answer but also to justify their choice or to select a reasoning statement (Chandrasegaran et al., 2007; Lin, 2004). The equal measure of content validity, diagnostic cognitive data, and psychometric rigor is non negotiable in every form of sound measurement. However, outlining the more recent misconception scales demonstrates the use of validity and reliability in the scales is fundamentally lacking. Even the scales of internal reliability, factor structure, and content and construct validity were found to be low and exceedingly poor affirming sets of deficiencies regarding validation (Johnson & Morgan, 2016). This study addresses these shortcomings by using modern psychometric techniques, factor analysis and Rasch modeling, to evaluate the DSCS as a diagnostic instrument.
Misconceptions in Digestive System Education
Numerous research have documented the misconceptions concerning the digestive system. Dry (1998) showed that students do not see the contribution of the mouth as an organ of digestion, seeing the liver as a digestion organ. Gul et al. (2015) showed that even after being taught, a student may hold the misconception that the entire digestion process happens in the small intestine or may confuse the mechanical and chemical stages of digestion. Recent studies have pointed out the inability to explain the functions of an enzyme, the contraption of bile, and absorption tissue (Lin et al., 2016; Roswati et al., 2019). These issues may stem from a lack of appreciation of the banal day to day activities and an oversimplistic textbook portrayal. Digestion is often illustrated as a simplistic and unnecessarily simplistically routed through the stomach. Such misconceptions may arise from the cognitive load of complex phenomena such as the process of peristalsis, hydrolysis and the absorption of nutrients (Karpudewan et al., 2017). Such misconceptions necessitate tests that target poorly conceived notions instead of simply gauging lack of depth in ideas.
Assessing Misconceptions: Psychometric Considerations
The tools designed to assess a person’s misconceptions must satisfy certain requirements grouped under Content Validity – reflecting the relevant areas (digestive systems, organs, or even digestive chemical processes). Construct Validity entails relevant scaling misconceptions appropriate to the concept (Padgett & Morgan, 2020). As reliability, which is often evaluated with the person separation reliability in Rasch analysis or in Cronbach’s alpha, She (reliability) tells us the accuracy and stability of the tool (Sijtsma 2009). In terms of reliability, α ≥ 0.70 is acceptable highly desirable, while almost perfect reliability α > 0.90 is tells it is possible that we have too many items to measure the same thing (Kaiser 1974). ¿With the use of factor analysis, we can better understand the axes of a the provided set of values. EFA (exploratory factor analysis) is used to identify latent structures without pre-defined frameworks, while CFA (Confirmatory) is used to validate pre-determined propositions (Fabrigar & Wegener, 2011; Klem, 2000). In multi-valued or Likert’s scale survey tools, it is suggested that polychoric correlations have to be used with weighted least squares estimators to filter to the ordinal values (Flora & Curran, 2004). In the case of a dichotomous variable, the use of tetrachoric correlations is suggested. Fit indices such as the comparative fit index (CFI), Tucker–Lewis index (TLI), and root mean square error of approximation (RMSEA) provide general benchmarks for model fit: values of CFI/TLI ≥ 0.90 and RMSEA ≤ 0.08 are often considered indicators of good fit.
Modern item response theory approaches, such as Rasch modeling, place persons and items on a common latent scale, enabling interval‑level measurement and providing item‑level diagnostics (Wright & Mok, 2004). In the one‑parameter logistic model (1PL), all items share the same discrimination, and the only parameter estimated is item difficulty. Item fit is typically assessed with statistics such as Infit and Outfit mean squares; values between about 0.7 and 1.3 are generally considered acceptable (Bond & Fox, 2015; Boone & Scantlebury, 2006). The person reliabilities (similar to Cronbach's alpha) along with separation indices are results of Rasch analyses which indicate the degree to which the tool can differentiate between the various levels of the trait being measured (Padgett & Morgan, 2020). One of the strongest forms of unidimensionality in scalogram analyses involves local independence: item scores must not show any unexplained correlation of association above and beyond the predicted correlations derived from the latent trait. Diagnostics such as Yen's Q3 statistic can detect local dependence; violations suggest that items may be redundant or share a common stimulus (Chen & Thissen, 1997). Rasch modeling can thus inform both the retention and revision of items during instrument development.
Theoretical Framework: Conceptual Change in Science Education
A
To understand why misconceptions stick, one must study constructivist learning theory where knowledge is added to what is already known. Children, according to Piaget, add new knowledge to their mental structures as long as it is new until it is shown that they must change the structures in order to accommodate new knowledge. Posner and the rest built on this idea to conceptual change and argued that learners must become dissatisfied with their conceptions before they can change to more scientifically accurate ones (Posner et al.,
1982). This dissatisfaction is more than often triggered by cognitive conflict situations where the current reality does not match what is believed. Cognitive conflict alone is insufficient. Therefore, learners have to deal with new explanations that are understandable, believable, and practical. The long-lasting presence of misconceptions is due to the absence of explanations, or the explanations that are provided do not fulfill requirements. (Taber,
2006). In the case of the digestive system, “digestion happens where food is stored” and “enzymes get used up like fuel” are naive heuristics that children have as explanations, and are used because they are similar to real-life. Such intuitions are hard to change because they are practical in real life and scientific phenomena that are below the surface level of life are complex and invisible. According to diSessa's phenomenological primitives theory (diSessa,
1993), such fragments of knowledge (or "p-prims") are contextually activated and need not form coherent theories. Effective conceptual change thus requires not only introducing correct information but also restructuring underlying intuitions. Strategies such as refutation texts (Tippett,
2010), which explicitly state a misconception and then refute it with evidence and other conceptual change texts can help in this process. Diagnostic tests like the DSCS provide teachers with the information necessary to tailor such interventions.
Another perspective is the resources framework, which suggests that misconceptions are not monolithic ideas but rather consist of multiple semi‑independent resources that can be activated differently across contexts (Hammer, 2000). From this viewpoint, assessment instruments need to sample understanding in varied contexts to capture the variability of student thinking. The DSCS therefore includes items that probe the same underlying concept in different ways, for example, multiple items assess understanding of chemical digestion in both the mouth and the stomach to ensure that we capture stable misconceptions rather than isolated responses. This design helps reveal whether students hold consistent misconceptions across scenarios or whether their answers vary with surface features.
Analytic Strategy
We adopted a sequential analysis plan that combined classical test theory indices, factor analyses, and item response theory. All analyses were conducted using R (version 4.2.1) with relevant packages (e.g., psych, lavaan, eRm, and mirt).
Descriptive statistics and item analysis. We first examined classical item statistics. For each item, we computed the proportion of students answering correctly (item difficulty) and the corrected item–total correlation (point-biserial correlation between the item and the total score excluding that item, often called item–rest correlation). These indices helped identify any potentially problematic items, such as those that were extremely difficult or easy (difficulty < 0.20 or > 0.80) or those that did not correlate with the overall test (item–total correlation < 0.20). Items showing extreme difficulty or poor discrimination were flagged for further scrutiny.
Suitability for factor analysis. To ensure that factor analysis was appropriate for our data, we calculated the Kaiser–Meyer–Olkin (KMO) measure of sampling adequacy and performed Bartlett's test of sphericity on the item correlation matrix. A KMO value ≥ 0.60 and a significant Bartlett's test (p < 0.001) would indicate that the data are factorable and justify proceeding with factor analysis.
A
Exploratory factor analysis (EFA). Using the tetrachoric correlation matrix, we conducted EFA to explore the underlying factor structure without imposing a predetermined model. We employed principal axis factoring (which does not assume multivariate normality and is well-suited to non-normal or binary data) and used oblimin rotation (an oblique rotation) because we expected any factors to be correlated (Costello & Osborne,
2005). To decide how many factors to retain, we triangulated multiple criteria: parallel analysis (which compares empirical eigenvalues to those from random data), the scree test (visual identification of an "elbow" in the plot of eigenvalues), and Velicer's Minimum Average Partial (MAP) test. Notably, parallel analysis can tend to over-extract factors with dichotomous data due to sampling error, so we cross-checked its suggestions with the MAP and the nScree method (which aggregates several criteria). In our case, the MAP test favored a single factor whereas parallel analysis suggested as many as eight factors, and the nScree indicated two factors. Based on these results and theoretical expectations (that a general misconception trait might have subdomains), we decided to examine both one-factor and two-factor solutions. We considered an item to load saliently on a factor if its loading was ≥ 0.30 on that factor and it did not simultaneously load > 0.20 on another factor. We interpreted any extracted factors in light of the content and conceptual focus of the items grouping on them.
Confirmatory factor analysis (CFA). We next tested the dimensionality indicated by EFA using CFA. We fit two CFA models with lavaan: a one-factor model (all 20 items loading on a single latent construct) and a two-factor model (items loading on two correlated latent factors, based on the EFA groupings). Given the dichotomous nature of the data, we treated items as ordered categorical variables and used the WLSMV estimator, which is robust for categorical outcomes. Factor variances were fixed to 1 for model identification. Model fit was evaluated with standard indices: CFI and TLI (values ≥ 0.90 or 0.95 for good or excellent fit) and RMSEA and SRMR (values ≤ 0.08 for acceptable fit, with ≤ 0.05 indicating close fit). We compared the one- and two-factor models on these indices. We also checked modification indices for any local misfit (e.g., suggesting correlated residuals) and considered whether allowing any additional covariance or cross-loading was substantively justified. In addition to overall fit, we calculated composite reliability (CR) and average variance extracted (AVE) for each factor in the two-factor model to assess internal consistency and convergent validity of the factors. Generally, CR > 0.70 and AVE > 0.50 are desired (Fornell & Larcker, 1981). We report these values and discuss whether the factors were sufficiently distinct (discriminant validity) or essentially measuring the same construct.
Rasch modeling. Finally, we performed Rasch analysis by fitting a one-parameter logistic (1PL) model using the eRm package. This yielded estimates of item difficulty (the location of each item on the latent scale) and person ability for each student. All items were constrained to equal discrimination (slope) in this model. We examined item fit via Infit and Outfit mean square statistics; we considered values in the range 0.70–1.30 as indicative of acceptable fit. Items with fit statistics outside this range or with standardized fit residuals |z| ≥ 2.0 were flagged for review. (We note that with N = 412, the standardized fit statistic can be sensitive, so we emphasize mean-square fit and substantive content review of flagged items rather than rigidly dropping items on the basis of z alone.) We also examined person fit to identify any students with aberrant response patterns (e.g., high ability students getting many easy items wrong, or vice versa). Person separation reliability and the separation index were computed to evaluate the precision of measurement on the logit scale. We generated a Wright map (person–item map) to visualize the distribution of student abilities against item difficulties; this helps identify whether the test items appropriately target the range of student misconceptions (e.g., whether very high or very low ability ranges are underrepresented by items). Finally, we assessed local independence by computing Yen's Q3 statistic for residual correlations between item pairs. Item pairs with Q3 > 0.20 would suggest local dependence (Yen, 1984), potentially indicating redundant items or shared stimuli, but as reported below we found no such violations.
Results
Item Analysis and Descriptive Statistics
Item difficulty (proportion of students answering correctly) ranged from 0.32 to 0.86. No item was extremely difficult or extremely easy by our criteria, indicating that the test included a mix of items of varying difficulty without floor or ceiling effects. The corrected item–total correlations (item discrimination indices) varied between 0.19 and 0.50, with a median of 0.33, suggesting that most items had satisfactory discrimination and were contributing positively to the total score. Two items (labeled x09 and x20) showed the lowest item–total correlations (approximately 0.19 and 0.16, respectively). Increased enzymes accelerate digestion was stated as item x09 (the misconception being that digestion can be sped up infinitely with the addition of enzyme). Item x20 dealt with the secretion of bile. However, despite their relatively low discrimination, no item had an item–total correlation below 0.15, and all items still demonstrated at least a moderate correlation with overall test performance. We therefore retained all 20 items for further analyses. The Cronbach's alpha for the 20 items was 0.77, which indicates acceptable internal consistency for a concept diagnostic scale. The Johnson & Morgan (2016) study also shows how this value yields confidence that the DSCS provides consistent outcomes across individual items since ‘the commonly recommended reliability bounds for classroom assessments’ suggests that the primary value should fall between ‘0.70 and 0.95’ (recall: group-level use).
Suitability for Factor Analysis
The DSCS data met key assumptions for factor analysis. The Kaiser–Meyer–Olkin (KMO) measure of sampling adequacy was 0.86, which is well above the recommended minimum of 0.60 for a satisfactory factor analysis. Similarly, Bartlett's test of sphericity was highly significant (χ² = 2344.19, df = 171, p < 0.001), indicating that the item correlation matrix was not an identity matrix and contained sufficient structure for factor extraction. Together, these diagnostics confirmed that it was appropriate to proceed with exploring the factor structure of the DSCS.
Exploratory Factor Analysis (EFA)
Using principal axis factoring on the tetrachoric correlation matrix, we conducted an EFA to probe the latent structure. The initial unrotated factor solution showed that the first factor had an eigenvalue substantially larger than subsequent factors. The first factor alone accounted for 37.5% of the variance, while the second factor accounted for 8.4%. A parallel analysis (random eigenvalue comparison) suggested that more than one factor could be retained, but the results were inconclusive due to the tendency of parallel analysis to overestimate factors with dichotomous data. The scree plot revealed a noticeable elbow after the first factor, with a much smaller drop to the second, suggesting a dominant first factor. We also computed Velicer's MAP test, which indicated a single underlying factor. Balancing this evidence, we examined both a one-factor and a two-factor solution. Parallel analysis on tetrachoric correlations guided factor retention; the scree comparison is shown in Fig. 1.
In the one-factor EFA solution, all 20 items loaded positively on the general factor, with factor loadings ranging from 0.29 to 0.78. This single factor solution explained 45.9% of the total variance in item responses. In the two-factor solution (using oblimin rotation to allow correlation between factors), the cumulative variance explained increased to 55.3%. The two factors were interpretable and aligned with content themes. Factor 1, which we might label Digestive Processes and Chemical Digestion, included items emphasizing biochemical aspects of digestion (e.g., the role of enzymes, understanding of chemical vs. mechanical digestion, and nutrient absorption processes). For instance, item x13 (misconception about enzyme function) and item x16 (misconception about where digestion can occur simultaneously) loaded strongly on Factor 1 (loadings 0.74 and 0.62, respectively) and had minimal cross-loading on the other factor. Factor 2, which we might label Organs and Mechanisms, comprised items focusing on anatomical sequence and organ-specific functions (e.g., which organs perform which digestive roles, where digestion begins, how food moves). Items x05 (belief that most nutrient digestion happens only in the small intestine) and x06 (belief that digestion begins only in the stomach rather than the mouth) were among those loading on Factor 2. Cross-loadings between the two factors were generally low; no item had a secondary loading greater than 0.20. This suggests that, while a single overall misconception trait underlies performance, there are two meaningful clusters of items that provide a richer, more nuanced view of students' misconceptions.
Confirmatory Factor Analysis (CFA)
We next conducted CFA to compare a unidimensional model against the two-factor model indicated by the EFA. In the one-factor CFA, all 20 items were specified to load on a single latent factor representing overall misconception severity. This model achieved an acceptable fit to the data: CFI = 0.978, TLI = 0.975, RMSEA = 0.024, SRMR = 0.076. All factor loadings in this model were significant and positive, ranging from about 0.35 up to 0.75. However, the modification indices for the one-factor model suggested that a few pairs of items with very similar content (for example, item x10 about enzyme reuse and item x11 about enzyme function) had correlated residuals, hinting that a secondary grouping might improve model fit.
We then specified a two-factor CFA model based on the EFA groupings: Factor 1 included the items related to digestive processes and enzymes, and Factor 2 included items related to organ functions and mechanisms. We allowed the two factors to correlate, as suggested by theory and the EFA oblimin rotation. The two-factor model provided an excellent fit: CFI = 0.997, TLI = 0.996, RMSEA = 0.009, SRMR = 0.070. These fit indices were substantially better than those of the one-factor model, indicating that modeling two latent factors improved the representation of the data. Factor loadings in the two-factor CFA ranged from 0.36 up to 0.74, with a median loading around 0.53. Each item loaded most strongly on its intended factor, and no cross-loadings were specified in the CFA. The two factors were moderately to strongly correlated (r = 0.704), which is consistent with the idea that while the DSCS can be viewed as tapping a single broad misconception construct, the two subdimensions are closely related. Given this high inter-factor correlation, the DSCS is essentially unidimensional in terms of measurement, though the two-factor solution offers some pedagogical interpretability (as discussed below). The two-factor model fit better than the one-factor alternative (Table 2). Standardized loadings for the retained two-factor solution appear in Table 3, and the path diagram is presented in Fig. 2. The latent factors were strongly correlated (r ≈ .70), supporting a single predominant construct with two interpretable facets.
Table 2
Confirmatory Factor Analysis—Model Fit Indices (WLSMV)
Model | χ² | df | p | CFI | TLI | RMSEA | RMSEA 90% CI | SRMR |
|---|
One-factor | 211.81 | 170 | .016 | .972 | .969 | .024 | .011–.034 | .077 |
Two-factor | 179.76 | 169 | .271 | .993 | .992 | .012 | .000–.026 | .072 |
| Note. Robust (scaled) indices were more conservative (two-factor robust CFI = .844; robust RMSEA = .062 [.044–.078]). |
Table 3
Two-Factor CFA: Standardized Loadings
Factor | Item | Std. loading |
|---|
F1 | x05 | 0.469 |
F1 | x06 | 0.510 |
F1 | x07 | 0.638 |
F1 | x12 | 0.729 |
F1 | x13 | 0.365 |
F1 | x14 | 0.491 |
F1 | x16 | 0.524 |
F1 | x17 | 0.646 |
F1 | x18 | 0.583 |
F1 | x20 | 0.245 |
F2 | x01 | 0.458 |
F2 | x02 | 0.376 |
F2 | x03 | 0.483 |
F2 | x04 | 0.395 |
F2 | x08 | 0.596 |
F2 | x09 | 0.348 |
F2 | x10 | 0.318 |
F2 | x11 | 0.697 |
F2 | x15 | 0.424 |
F2 | x19 | 0.335 |
| Note. Latent correlation r(F1, F2) = .73. |
To further evaluate the two-factor solution, we calculated the composite reliability (CR) for each factor, finding CR ≈ 0.85 for Factor 1 and 0.81 for Factor 2. These values indicate good internal consistency for the items grouped in each factor. Factor 1 was 0.49 and Factor 2 was 0.45, with an average variance extracted (AVE) of two, which still is lower than the generally agreed upon 0.50 limit for convergent validity (Fornell & Larcker, 1981). This means that despite the fact that there is a considerable amount of variance in the captured items corresponding to each factor, almost half of the variance is not captured and that the remaining variance is a result of either error or uniqueness. However, given the relatively high correlation between the factors (and the modest number of items per factor), the somewhat lower AVE is not surprising. We considered whether any low-loading items could be removed to raise the AVE, but doing so would have reduced content coverage of the scale. On balance, we retained all items to preserve the diagnostic breadth of the DSCS. We conclude that the CFA provided strong support for a two-factor structure, while also affirming that a single overarching trait largely governs student performance.
Importantly, removing the two previously flagged items (x09 and x20) and re-running the CFA did not substantially improve model fit; it actually slightly worsened some indices and left certain content areas underrepresented. Therefore, all 20 items were retained in the final instrument for subsequent Rasch analysis and interpretation.
Rasch Modeling
We fit a one-parameter Rasch model (1PL) to the 20-item dataset to further assess the measurement properties of the DSCS. The item difficulty estimates (denoted δ or β) ranged from − 0.85 logits (for item x09, which turned out to be one of the easiest items) to + 0.78 logits (for item x19, one of the most difficult items). This range of approximately 1.6 logits indicates a reasonable spread of item difficulty across the continuum of misconception severity. It was reasonable to arrange the items in levels of difficulty. The easier ones often related to more fundamental or widely taught ideas like pinpointing the beginning stages of digestion, while the harder ones were aimed at more subtle misunderstandings like the enzymes that get reused and the action of bile. Under a Rasch (1-PL) model, item difficulties and fit indices (infit/outfit mean squares and standardized z) are reported in Table 4. The person–item (Wright) map is shown in Fig. 3, and item characteristic curves (ICCs) for representative items are displayed in Fig. 4.
Table 4
Rasch (1PL) Item Difficulty and Fit
Item | Difficulty (logit) | Infit MSQ | Outfit MSQ |
|---|
x01 | 0.67 | 0.98 | 0.94 |
x02 | 0.03 | 1.05 | 0.99 |
x03 | 0.60 | 0.97 | 1.00 |
x04 | -0.33 | 1.08 | 1.12 |
x05 | -0.33 | 1.00 | 1.04 |
x06 | -0.11 | 0.97 | 0.99 |
x07 | -0.17 | 0.90 | 0.84 |
x08 | -0.18 | 0.95 | 0.94 |
x09 | 0.86 | 1.03 | 1.18 |
x10 | -0.61 | 1.11 | 1.12 |
x11 | 0.46 | 0.88 | 0.81 |
x12 | -0.02 | 0.85 | 0.78 |
x13 | 0.53 | 1.07 | 1.06 |
x14 | -0.16 | 1.00 | 0.99 |
x15 | -0.44 | 1.07 | 1.08 |
x16 | 0.31 | 0.95 | 0.92 |
x17 | -0.10 | 0.90 | 0.85 |
x18 | 0.41 | 0.93 | 0.93 |
x19 | -0.78 | 1.07 | 1.10 |
x20 | -0.60 | 1.14 | 1.19 |
| Note. Difficulties are mean centered. Reference MSQ range .70–1.30. |
The person reliability in the Rasch analysis was 0.706. This reliability is analogous to Cronbach's alpha in classical test theory and suggests that the DSCS can reliably distinguish at least two to three broad levels of student ability (misconception severity) in our sample. The separation index, calculated as SD(θ)/SEM on the logit scale and related to reliability, was about 1.55, indicating that the test separates students into approximately 1.552 ≈ 2 strata of ability. A person reliability above 0.70 is acceptable for educational assessments of this type.
All items showed good fit to the Rasch model.
A
The Infit mean square statistics ranged from 0.85 to 1.19, and the Outfit mean squares were in a similar range, all well within the 0.7–1.3 guideline for acceptable fit. Thus, none of the items exhibited aberrant response patterns inconsistent with the expectations of the model. We have standardized fit residuals (z-statistics) that indicated a severe misfit with six items (x07, x10, x11, x12, x17, x20) with |z|≥ 2. However, statistically significant misfit should be use with caution. In this case, it is warranted because our sample is considerable (N > 400) and it is known these sample sizes influence Bond and Fox (
2015) significant z values with minor deviations. Crucially, all six of these flagged items had mean-square fit statistics very close to 1 (well within the acceptable range), indicating that the magnitude of misfit was small in practical terms. Upon examining the content of these items, we found plausible reasons for their slight misfit: for example, item x12 ("Only chemical digestion takes place in the stomach") may have confused some students who did not clearly distinguish chemical from mechanical digestion, and item x10 ("Enzymes are lost after digestion") touches on knowledge (enzyme reuse) that might not be well emphasized in the curriculum. Such items might behave a bit unpredictably (leading to more variability in responses), but this does not invalidate them. Rather than removing these items, we decided to keep them in the scale but note in our recommendations that they could be rephrased in future revisions to reduce ambiguity. Overall, misfit in this context does not necessarily imply the item is useless; it may still target a valuable misconception concept (Sijtsma,
2009).
We also checked the assumption of local independence among items using Yen's Q3 residual correlations. The largest observed residual correlation between any pair of items was 0.18, and no item pair exceeded the 0.20 threshold for concern. This indicates that after accounting for the primary Rasch trait, item responses were essentially independent – in other words, there was no evidence that any two items shared additional common factors or that answering one item influenced responses to another. The DSCS items each appear to contribute unique information about the underlying misconception trait.
In terms of person fit, about 4.2% of students had outfit or infit statistics beyond the usual cut-off (e.g., outfit > 1.5), suggesting their response patterns were somewhat unusual. On inspecting these cases, we found they corresponded to instances where students might have been randomly guessing or not fully engaged (for example, some of these students had nearly equal numbers of correct and incorrect answers in a sporadic pattern or left multiple items blank). These few cases did not substantially affect the overall analysis and were not removed, but they underscore the importance of ensuring student motivation and understanding of instructions when administering the test.
The Wright map (person–item map) produced by the Rasch analysis provides a visualization of the scale's targeting. We observed that the bulk of student ability estimates clustered slightly above the mean item difficulty. In other words, on average, students in our sample found the test slightly easy (many students scored in the upper half of the raw score range). The items tended to target low to moderate levels of misconception severity; fewer items were located at the very high end of the ability scale. This results in fewer very difficult items to challenge the most knowledgeable students (those with the least misconceptions). Consequently, high-performing students (with very few misconceptions) may achieve near-perfect scores, making it harder to differentiate among them based on this test. This ceiling effect suggests that adding a few more challenging items, perhaps items that probe deeper biochemical or physiological details of digestion, could improve the test's ability to measure the upper end of understanding and thereby increase person reliability.
Given that the Rasch analysis supported treating the DSCS as essentially unidimensional (one dominant trait underlying performance) and the person reliability was adequate, we proceeded to use the total Rasch score (ability estimate) for each student as the primary measure of misconception severity. For practical use in classrooms, we also converted the continuous Rasch ability estimates into more interpretable metrics. As mentioned, we standardized the logits into T‑scores (mean = 50, SD = 10). An average student in our sample thus would have a T-score around 50; higher T-scores indicate more severe misconceptions (lower understanding), and lower T-scores indicate fewer misconceptions (higher understanding).
Additionally, we established performance bands based on percentile cut-offs to facilitate interpretation by teachers. For example, we defined approximate score bands as follows: raw scores of 0–4 correct (out of 20) as Very Low understanding (indicating pervasive misconceptions), 5–7 correct as Low, 8–11 as Average, 12–14 as High, and 15–20 as Very High. These categories correspond roughly to certain regions on the ability scale (e.g., the Very Low band roughly corresponds to ability estimates below about − 1.5 logits, and the Very High band corresponds to abilities above + 1.5 logits, based on our data distribution). A teacher can use these bands to get a general sense of a student's level: for instance, a student in the Very Low band likely holds many fundamental misconceptions about digestion and may need intensive review of basic concepts, whereas a student in the Very High band has mastered most concepts and might benefit from enrichment activities.
It must be stressed that these support bands are meant to be descriptive and not to stigmatize students. In this case support bands must be used along with other analysis at the item level. For example, a student in the Average band (around 8 to 11 correct) could still hold certain misconceptions (based on the particular items they got wrong) that need to be fixed. Conversely, a student in the "High" or "Very High" band might still have one or two stubborn misconceptions that could be uncovered through class discussion or open-ended questions. We advise educators to interpret the total score as a starting point and then delve into which items were missed to target instruction appropriately. Because the two factors identified by CFA were so highly correlated and the subscale reliability for each was low (Cronbach's α approximately 0.50 for Factor 1 and 0.32 for Factor 2), we do not recommend reporting separate subscale scores for each factor. Instead, teachers and researchers should interpret the DSCS as yielding a single overall misconceptions score, supplemented by an item-level profile to indicate whether a student's misconceptions tend to cluster more in process-related or anatomy-related areas.
Discussion
This study sought to validate the 20‑item DSCS using robust psychometric methods. As a whole, the DSCS showed strong technical attributes for a concept inventory. The instrument showed sufficient reliability (Cronbach's α = 0.77; Rasch person reliability = 0.706) and exhibited range for student understanding mastery. Both EFA and CFA indicated that student responses were driven primarily by a single latent trait (general understanding of digestion concepts vs. misconceptions). However, a two‑factor model provided a marginally better fit in CFA and offered pedagogical insight by grouping misconceptions into two interpretable facets (digestive processes vs. organ functions). Rasch modeling confirmed that items functioned appropriately (no significant misfit after accounting for content considerations) and that local item independence was satisfied. The person–item map revealed that the scale was somewhat easier for our sample than expected, suggesting the need for a few more difficult items to better challenge high-understanding students. Taken together, these results support using the DSCS as a valid and reliable instrument to diagnose misconceptions about digestion among 7th‑grade students.
Interpretation of Factor Structure
Although the two‑factor CFA model provided the best fit statistically, the high correlation between factors (approximately 0.70) suggests that the DSCS largely measures a single underlying construct: the overall severity of a student's misconceptions about the digestive system. The two factors can be thought of as emphasizing different aspects of this construct. One factor highlights process-related misconceptions (e.g., misunderstanding chemical vs. mechanical digestion, enzyme action, and how nutrients are broken down), while the other centers on structure-related misconceptions (e.g., confusion about which organs perform certain functions, or the path food takes through the digestive system).
From an instructional perspective, these facets are useful. Teachers may find it valuable to know, for example, if a class as a whole is weaker in understanding digestive processes as opposed to anatomy. In our data, many students showed consistent errors on the enzyme-related items (Factor 1), indicating a potential curriculum gap in teaching the role of enzymes or the chemical nature of digestion. If a teacher administers the DSCS and notices widespread difficulties on those items, they could plan additional lessons or demonstrations focusing on enzyme function (e.g., an experiment showing how enzymes break down food or the effect of pH on enzyme activity). Conversely, if students struggled more with items like X05 and X06 on Factor 2 (organ functions and sequences), a teacher might spend time having students construct annotated digestive system diagrams or perform a simulation of the digestive process, to reinforce what happens in each organ.
That said, because each subscale (Factor 1 and Factor 2) was short (approximately 10 items each) and their internal consistencies were quite low (α ~ 0.50 or below), we caution against reporting separate scores for the two factors. Subscale scores at that reliability would be unstable and potentially misleading (Nunnally, 1978). The safer approach is to use the total score as the primary metric of misconceptions and then use the pattern of item responses to glean insights into the types of misconceptions. In practice, an educator can review which specific questions a student or class answered incorrectly to diagnose whether those misconceptions relate more to processes or to structures, without needing to formally compute two subscale totals. This approach balances psychometric rigor (by using a well-defined unidimensional score) with pedagogical utility (by interpreting item patterns).
Rasch Interpretation and Item Functioning
Rasch analysis offered several valuable perspectives on the performance of items and the test. To begin with the spread of the item difficulties suggest that the DSCS covers narrow and moderate levels of comprehension. There were items that most students found easy (indicating very common misconceptions that almost everyone held) and items that were difficult (misconceptions that only the least-informed students held). However, the lack of extremely difficult items suggests that our instrument might not be sufficiently challenging for the top quartile of students who have very few misconceptions. In a class of mostly high-achieving students, the DSCS could yield many high scores with little variation. Adding 2–3 more difficult items that target subtle or higher-order misconceptions (for instance, items about hormonal regulation of digestion or integration of digestion with other body systems like circulatory or endocrine) could improve the instrument's ability to discriminate among students at the upper end of understanding. Increasing the spread of item difficulties in this way would likely also raise the person reliability, as more information is gathered about high-performing students.
Second, while all items were within acceptable fit ranges, the fact that six items triggered the statistical misfit criterion (|z| ≥ 2) invites reflection. After examining these items qualitatively, we suspect that the wording or cognitive demand of some items could be refined. For instance, students who fail to notice that mechanical digestion (churning) also happens in the stomach may get confused with the statement in item x12 ("Only chemical digestion takes place in the stomach"). Perhaps, for the sake of accuracy, focusing the misconception would be better if it was clarified to “No mechanical digestion occurs in the stomach.” Item x10 ("Enzymes are lost after digestion") touches on the concept of enzyme reusability, a topic that might not be fully covered in 7th grade, so some students might have answered incorrectly simply due to lack of instruction rather than a misconception per se. In future revisions of the DSCS, we recommend revisiting such items. The target audience should be students who are prepared to face the misconceptions the curriculum defines. The items should be retained rather than removed because they do target important misconceptions. Little changes could enhance their performance without compromising their content.
Third, the Rasch analysis affirmed that each item contributes unique information (local independence) and that a single score is defensible. We found no evidence of item clustering effects or multi-dimensionality in the residuals. This justifies the practice of reporting a total score (or Rasch measure) for each student. It also supports using the Rasch difficulty measures for each item to understand which misconceptions are easier or harder for students to avoid. For instance, the easiest item (x09) was one that nearly all students got right, suggesting that the misconception it tests (possibly a trivial or less common one) is not widespread. In contrast, the hardest item (x19) points to a misconception that even many high-performing students held, identifying a particularly problematic area of understanding.
Comparison with Previous Research
Our findings align with earlier studies on science misconceptions that have often found a largely unidimensional structure underlying students' incorrect belief. For example, instruments measuring misconceptions in other domains like photosynthesis or genetics have similarly found that while multiple factors can sometimes be identified, those factors tend to be highly correlated, reflecting one general proficiency (or lack thereof) in the domain (Haslam & Treagust, 1987; Levy Nahum et al., 2010). In the context of digestive system misconceptions, relatively few published scales exist. One prior study in Turkey by Uğur (2010) developed a two-tier test for high school students on the digestive system and reported a Cronbach's alpha of 0.71 for their 16-item test, which is comparable to the reliability of 0.77 we obtained for the DSCS. This suggests that the DSCS's reliability is on par with similar instruments, despite our inclusion of more items and more advanced psychometric analysis.
Notably, many earlier misconception tests have relied solely on classical test theory or exploratory factor analysis, without the additional confirmation and item-level scrutiny that Rasch modeling provides. This sometimes led to ambiguity in the interpretation of dimensions or inflated views of reliability. By employing both factor analysis and Rasch modeling, our study demonstrates the value of a mixed psychometric approach. The factor analyses allowed us to see overarching patterns and potential subdimensions, while the Rasch analysis confirmed the essential unidimensionality and helped identify specific items that could be improved. We believe this dual approach provides a more nuanced validation than either method alone, a practice that could be beneficially applied in validating concept inventories in other science domains.
In terms of magnitude of misconceptions, the average score in our sample and the person ability distribution indicate that misconceptions about digestion are still prevalent among 7th graders, despite digestion being a standard topic in the curriculum. This echoes the observations of other researchers who have found that significant proportions of students harbor misconceptions even after instruction (Özkan, 2017). Our high factor correlation (r ~ 0.70) also mirrors findings from concept inventories in other areas of biology and chemistry where factors were identified but were not truly independent (e.g., different facets of understanding in chemical bonding were found to correlate strongly: Levy Nahum et al., 2010). In practice, many researchers in science education end up reporting a single overall score on such inventories (even if a factor analysis suggests multiple factors) because that overall score tends to be the most reliable and interpretable measure of student understanding (or misunderstanding). Our results support a similar approach for the DSCS.
Implications for Research and Practice
The DSCS provides teachers and researchers with a psychometrically sound tool for diagnosing students' misconceptions about digestion and tailoring instruction accordingly. For classroom practitioners, the test covers multiple aspects of digestion, allowing them to pinpoint whether student misunderstandings cluster around certain themes. For instance, if a teacher finds that many students missed questions related to enzymes and chemical reactions (Factor 1 items), this would signal a need to reinforce lessons on how enzymes work (perhaps through interactive labs or analogies that make the invisible process more concrete). On the other hand, if students struggled more with items about the path of food or organ functions (Factor 2 items), the teacher might use more physical models or ask students to build a flowchart of the digestive process to solidify the sequence and roles of each organ.
The derived score bands and T-scores can help educators interpret individual and class performance in an intuitive way. A teacher might say, "Most of my class scored in the Average band, with a few in Low and a few in High," suggesting the needs of the class rather quickly. However, we stress the need to go deeper than the total score. We ask that teachers analyze the results multiple items and, whenever possible, address specific items with the class after the test to remediate the specific errors made. Research on conceptual change suggests that explicitly addressing misconceptions (for example, using refutation texts or class discussions where misconceptions are brought to light and examined) is necessary for many students to change their thinking (Duit & Treagust, 2003; Tippett, 2010). The DSCS can act as the diagnostic step in this process: it identifies the misconceptions, which the teacher can then deliberately refute and replace with correct conceptions through instruction.
For researchers and test developers, our study illustrates a holistic approach to instrument validation. The use of item-total correlations, factor analyses (EFA/CFA), and Rasch modeling of These elements were synthesised together. Multiple approaches provides more complete proof. Subsequent researchers creating partial understanding scales in science education may adopt a similar multi-pronged strategy to evaluate construct validity, check for dimensionality, and ensure the scale’s grade. The use of EFA, CFA, and Rasch in this work illustrates how EFA proposed a structural framework, CFA evaluated the framework using stringent fit standards, and Rasch provided item-level diagnostics and an IRT-based reliability and measurement invariance framework. This kind of thorough validation is especially important if such instruments are to be used for research or high-stakes decisions.
Our findings also underscore the importance of item difficulty distribution. Many diagnostic tests in science either lack enough easy items (leading to floor effects where many students score zero or very low) or lack enough hard items (leading to ceiling effects). The DSCS was designed to include a range, but as discussed, it could benefit from a few more difficult items. Achieving a balanced item set that measures across the spectrum of understanding enables better discrimination among all students, not just those in the middle. This has implications for test design: during development, one should aim to include some items that even the top students will struggle with (to probe the limits of their understanding) and some items that even the lowest students will get right (to capture partial understanding and engage those students).
Another implication pertains to formative use of such assessments. The DSCS is not merely a research tool; it can be used formatively in the classroom. For example, a teacher might administer the DSCS as a pre-test at the start of a unit on human biology to gauge what misconceptions exist, then tailor teaching strategies accordingly, and perhaps administer it again as a post-test to measure conceptual change. Because the DSCS is multiple-choice, it can be graded quickly (or even electronically), and because it's relatively short (20 items), it can fit into a single class period. The use of learning analytics or even simple item analysis can provide immediate feedback. If integrated into a digital platform, a teacher could see which misconceptions are most common in a class and even provide individual students with targeted follow-up materials addressing the specific misconceptions they showed.
For curriculum designers and education policy makers, the DSCS results across many classrooms could highlight systemic areas of weakness. For instance, if data from many schools reveal that the majority of students misunderstand the role of enzymes or have the misconception that "digestion occurs only in the stomach," this might indicate that the standard curriculum or textbooks are not effectively dispelling those notions. Curriculum developers could respond by incorporating more explicit content or activities about these trouble spots. On a larger scale, education reform efforts that emphasize inquiry and conceptual understanding might use instruments like the DSCS to measure whether reforms are reducing misconception prevalence. If, say, a new inquiry-based unit on digestion is implemented, the DSCS could serve as an evaluative tool to see if students emerging from that unit hold fewer misconceptions than students taught with a traditional approach.
Limitations and Future Directions
Several limitations of this study should be acknowledged. First, our sample was drawn from a single metropolitan region in Turkey, which may limit the generalizability of the findings. Education systems, teaching approaches, and prior knowledge can vary significantly across regions and countries. What holds true for our population may not exactly replicate elsewhere. We suggest that future research replicate the validation of the DSCS with diverse samples, including students from different countries, rural areas, or educational systems. Such studies would strengthen the external validity of the scale. They could also examine whether the factor structure remains the same across contexts or whether, for instance, different misconceptions are prominent in different cultures.
Second, we administered the DSCS as a paper–pencil test under teacher supervision. While this approach reflects typical classroom practice (enhancing ecological validity), it does not leverage the possibilities of technology. An interesting future direction would be to develop a computer-based or online version of the DSCS. A digital format could provide immediate feedback to students and teachers and potentially adapt to student responses. In fact, there is growing interest in computerized adaptive testing in education. An adaptive version of the DSCS could present students with items matched to their estimated misconception level, challenging stronger students with harder items and giving struggling students more basic ones, hus maintaining engagement and efficiency. Such an adaptive DSCS would require a larger item pool and careful calibration, but it could shorten test time while preserving measurement precision (by not asking students questions that are far too easy or far too hard for them). Moreover, a digital DSCS could easily be integrated into learning management systems, allowing teachers to track conceptual change over time for each student and providing rich data for researchers on how misconceptions evolve with successive learning interventions.
Third, we did not formally examine Differential Item Functioning (DIF) in this study. Although our Rasch analysis did not find obvious overall ability differences by gender (and an informal analysis using Rasch trees did not split by gender), we cannot rule out that some items might function differently for boys versus girls, or for other subgroups (e.g., students of different socioeconomic status or different science achievement levels). For example, certain misconceptions might be more common among one gender due to differences in interest or attention in biology. Future research using methods like the Mantel–Haenszel procedure, logistic regression DIF analysis, or multigroup IRT could investigate whether any DSCS items show bias. If any DIF is detected (say, an item is systematically easier for boys than girls despite equal overall understanding, or vice versa), that item could be revised or used with caution. So far, we have no specific indication of bias, but a thorough check would be prudent, especially if the test is used in high-stakes contexts.
Fourth, as noted in the results, some items were flagged for potential misfit. While we have rationales for keeping them, it remains that these items could be improved. Cognitive interviews or think-aloud protocols with students focusing on these specific items would be a useful next step. By asking students to explain their thought process on, say, item x12 or x10, we could learn whether the phrasing is misleading or if students are interpreting the question in unintended ways. This qualitative feedback could directly inform how to rewrite those items. Even a well-validated instrument can be refined further, and our analysis points to a few candidates for improvement.
Lastly, the DSCS in its current form lacks items tapping the very high end of understanding (the most advanced content or the most subtle misconceptions). As discussed, adding items in that range would likely improve the instrument's discrimination among top students and raise the ceiling. In practice, these could be items that incorporate minor details or exceptions that only students with a truly robust understanding would know. For example, an item might test understanding of how the nervous system regulates digestion or a misconception about how different macronutrients are processed differently. We foresee that including a handful of such items could extend the scale's utility for advanced or older students, such as 8th or 9th graders, while still being answerable by well-taught 7th graders.
In terms of future research avenues, beyond validation and improvement of this instrument, there is the broader question of how using the DSCS (or similar tools) influences teaching and learning. One could design a study where some teachers use the DSCS to inform their teaching (essentially employing it as a formative assessment tool) and compare those classes to classes that did not use the diagnostic test. Would explicit diagnosis and remediation of misconceptions lead to significantly greater learning gains? Intuition and prior conceptual change literature suggest yes (because teaching would be more targeted), but empirical evidence would be valuable. Moreover, researchers might explore longitudinal use of the DSCS: for instance, using it at the beginning of the school year and at the end to measure how students' misconceptions shift after a year of instruction not just in digestion but in related topics like metabolism. A related idea is developing parallel forms of the DSCS to allow repeated testing without practice effects, given that repeating identical items can cue students to correct answers if they remember the test.