An Application of latent profile analysis to study the difference assessment literacy of teachers attached to the office of the private education commission of Chiang Mai province
Abstract:
This research has two main objectives: 1) to develop and validate a model measuring teachers assessment literacy Attached to the Office of the Private Education Commission of Chiang Mai Province, and 2) to differentiate and examine the differences in teachers' assessment literacy among different groups Attached to the Office of the Private Education Commission of Chiang Mai Province. The study involved 686 randomly selected teachers and utilized a multi-stage sampling method. The research instruments include a questionnaire on teachers' assessment literacy, consisting of 80 items with 5 levels with Item-Objective Congruence Index (IOC) ranging from 0.80 to 1.00, index of discrimination (rxy) ranging from 0.432 to 0.742, t-values ranging from 3.640 to 10.928, and a reliability (α) of 0.981. Data was analyzed using descriptive statistics, second-order confirmatory factor analysis, and latent profile analysis. The research findings are summarized as follows: 1. The model of teachers' assessment literacy comprises 7 components and 21 indicators, including Component 1: Assessment Method Selection, Component 2: Assessment Method Development, Component 3: Examination Management, Scoring, and Score Interpretation, Component 4: Utilization of Assessment Results, Component 5: Process of Grading Development, Component 6: Communication of Assessment Results, and Component 7: Ethics in Assessment. Each component consists of 3 indicators. The component with the highest weight is the Process of Grading Development, followed by Communication of Assessment Results and Ethics in Assessment, respectively. The model demonstrates good structural validity with χ2= 120.259, df = 105, CFI = 0.999, TLI = 0.998, RMSEA = 0.015, SRMR = 0.012, and p-value = 0.1465. 1. The results of grouping teachers based on their assessment knowledge revealed that they could be classified into 3 groups. The index of accuracy in group classification (Ek) is 0.952, LL = -2,356.576, AIC = 3,493.660, BIC = 3,629.587, ABIC = 3,534.332. Each group exhibits as the following. 2.1 The Accelerated Development Group in Assessment Knowledge, has weights for each component ranging from 3.171 to 3.494. The component with the highest weight is exam management, scoring, and score interpretation, while the use of assessment results is the component with the lowest weight. In this group, there are 58 teachers (8.455%), which is the smallest number compared to all other groups. The average probability of teaching high school level in small to medium-sized schools outside the municipal area of Chiang Mai is highest in this group, at 0.984. 2.2 The Basic Level Assessment Knowledge Group, has weights for each component ranging from 3.970 to 4.246. The component with the highest weight is ethical principles in assessment, while the development of assessment methods is the component with the lowest weight. In this group, there are 301 teachers (43.878%), which is the largest number among all groups. The average probability of teaching high school level in special large schools within the municipal area of Chiang Mai is highest in this group, at 0.976. 2.3 The Advanced Level Assessment Knowledge Group, has weights for each component ranging from 4.548 to 4.777. The component with the highest weight is ethical principles in assessment, while the development of assessment methods is the component with the lowest weight. In this group, there are 327 teachers (47.668%), which is the largest number among all groups. The average probability of teaching primary school level in special large schools within the municipal area of Chiang Mai is highest in this group, at 0.981.