This workshop aims (1) to provide a short course on the theoretical foundations of cognitive diagnosis modeling (CDM), (2) to introduce the development of a cognitive diagnostic assessment on proportional reasoning, (3) to illustrate how an R package developed by the instructors can be used for various CDM analyses, (4) and to discuss some recent developments in the area.
Unlike unidimensional IRT, CDM aims to provide information about the attributes or skills that are finer-grained and more relevant to classroom instruction and student learning. This workshop will be useful for faculty and students specializing in educational measurement, as well as testing professionals working in government or testing organizations.
In this workshop, the GDINA R package will be introduced. This package overcomes several drawbacks in existing software packages and offers a set of functions for CDM analyses, such as calibration of various diagnostic models, validation of the Q-matrix, and detection of differential item functioning. After this workshop, participants are expected to be able to conduct various CDM analyses on their own.
Tentatively, the workshop will be structured as follows:
Part 1: Introduction
1.1. Introduction to diagnostic modeling framework
1.2. Development of a diagnostic assessment
1.3. The G-DINA model framework
Part 2: CDM analysis with the GDINA R package
2.1. Introduction to GDINA R package
2.2. Model calibration, fit evaluation, comparison, and identifiability
3.3. Q-matrix validation, differential item functioning, and classification accuracy
Part 3: Recent areas of development
3.1. Cognitive-diagnosis computerized adaptive testing
3.2. Methods for small sample sizes and large number of attributes
3.3. Models for polytomous skills, polytomous responses, and longitudinal data