Scaling NEPS data

Jana Welling, Christian Diegel

2026-09-23

Introduction

This scaling guide is primarily intended to introduce the general procedure of scaling of competence tests in the National Educational Panel Study (NEPS). It is not intended as a comprehensive introduction to the methodological foundations of scaling or item response theory. The following sections provide only a brief overview of scaling in NEPS and mainly serve as pointers for further reading.

Scaling of Competence Tests in NEPS

The scaling of competence tests in NEPS typically includes the following steps:

Individual steps may be omitted if the necessary prerequisites are not met (e.g., if no structure in the test justifies a dimensionality analysis). The vignettes included in NEPSroutines lead you step by step through these procedures and summarize key information on data preparation in R, required datasets, and the use of the NEPSroutines package. This vignette also provides background information on competence assessments and measurement models used in NEPS.

Competence Assessments in NEPS

General information on competence assessments in NEPS is available at:

https://www.neps-data.de/Portals/0/NEPS/Datenzentrum/Forschungsdaten/Kompetenzen/NEPS_OverviewCompetenceData_2025_en.pdf

This document explains naming conventions and provides an overview of all competence assessments.

Further information on specific assessments can be found here:

https://www.neps-data.de/Data-Center/Data-and-Documentation

Competence Items

Tasks in competence tests are called items. In the raw data, these are initially unscored and contain the response selected by the participant (e.g., “3” or “C” if the third option was chosen).

At the beginning of the scaling process, items are scored by converting them into dichotomous variables indicating whether the response is correct (1) or incorrect (0).

Some tasks consist of multiple sub-items (e.g., complex multiple-choice or matching tasks). These are called polytomous items. The score of a polytomous item is obtained by summing all sub-item scores. For example, an item with three sub-items can take the values 0, 1, 2, or 3.

During scaling, a distinction is made between dichotomous and polytomous items:

Item Response Theory Models

The scaling framework for NEPS is described in Pohl and Carstensen (2012):

https://www.neps-data.de/Portals/0/Working%20Papers/WP_XIV.pdf

NEPS competence tests are designed to fit the Rasch model (Rasch (1960)) or the Partial Credit Model (PCM; Masters (1982)). Additionally, a 2PL model (Birnbaum (1968)) or a Generalized Partial Credit Model (GPCM; Muraki (1992)) is estimated to assess model fit.

The choice of model depends on the item format:

Linking

Competence assessments are often linked across waves or cohorts to ensure comparability between different measurements.

A detailed description of the linking procedure is provided in Fischer et al. (2016):

https://www.neps-data.de/Portals/0/Survey%20Papers/SP_I.pdf

Note: Linking is not yet implemented in this version of the NEPSroutines package.

References

Birnbaum, A. 1968. “Some Latent Trait Models and Their Use in Inferring an Examinee’s Ability.” In Statistical Theories of Mental Test Scores, edited by F. M. Lord and M. R. Novick. Addison-Wesley.
Fischer, Luise, Theresa Rohm, Timo Gnambs, and Claus H. Carstensen. 2016. “Linking the Data of the Competence Tests.” NEPS Survey Papers (Bamberg), no. 1.
Masters, Geoff N. 1982. “A Rasch Model for Partial Credit Scoring.” Psychometrika 47 (2): 149–74. https://doi.org/10.1007/BF02296272.
Muraki, Eiji. 1992. “A Generalized Partial Credit Model: Application of an EM Algorithm.” ETS Research Report Series 1992 (1). https://doi.org/10.1002/j.2333-8504.1992.tb01436.x.
Pohl, Steffi, and Claus H. Carstensen. 2012. “NEPS Technical Report – Scaling the Data of the Competence Tests.” NEPS WOrking Paper (Bamberg), no. 14.
Rasch, G. 1960. Studies in Mathematical Psychology: I. Probabilistic Models for Some Intelligence and Attainment Tests. Nielsen & Lydiche.