A Test Information Function for Linear Combinations of Traits Without Nuisance Traits in Multidimensional Item Response Theory

Research output: Contribution to journalArticle

Abstract

In educational evaluation and psychological measurement, we often measure traits that contain several sub-traits. When tests, such as entrance examinations, are used for decision-making, often test users do not evaluate the sub-traits directly, but rather evaluate the linear combination of sub-traits in which weights were pre-specified by the test users. In the present research, we propose a new test information function and item information that enable us to evaluate linear combinations of sub-traits in which the traits are correlated. Nuisance dimensions of linear combinations are integrated out in the proposed information function. This will enable test editing in which linear combinations of sub-traits can be evaluated prior to executing the test. We also propose a method for comparing values of information functions that have different weights and/or different correlations. A numerical simulation study showed the validity of our methods. We also applied our methods to the item pool of Geometry and Statistics of the 1996 NAEP test.

Original languageEnglish
Pages (from-to)497-499
Number of pages3
JournalJapanese Journal of Educational Psychology
Volume49
Issue number4
Publication statusPublished - 2001
Externally publishedYes

Fingerprint

Weights and Measures
Decision Making
Psychology
entrance examination
Research
statistics
mathematics
decision making
simulation
evaluation

Keywords

  • Adaptive testing
  • Item pool
  • Multidimensional item response theory
  • Test editing

ASJC Scopus subject areas

  • Psychology(all)
  • Developmental and Educational Psychology

Cite this

@article{01b48c789fbd40fc999ebaf4f72d87cc,
title = "A Test Information Function for Linear Combinations of Traits Without Nuisance Traits in Multidimensional Item Response Theory",
abstract = "In educational evaluation and psychological measurement, we often measure traits that contain several sub-traits. When tests, such as entrance examinations, are used for decision-making, often test users do not evaluate the sub-traits directly, but rather evaluate the linear combination of sub-traits in which weights were pre-specified by the test users. In the present research, we propose a new test information function and item information that enable us to evaluate linear combinations of sub-traits in which the traits are correlated. Nuisance dimensions of linear combinations are integrated out in the proposed information function. This will enable test editing in which linear combinations of sub-traits can be evaluated prior to executing the test. We also propose a method for comparing values of information functions that have different weights and/or different correlations. A numerical simulation study showed the validity of our methods. We also applied our methods to the item pool of Geometry and Statistics of the 1996 NAEP test.",
keywords = "Adaptive testing, Item pool, Multidimensional item response theory, Test editing",
author = "Takahiro Hoshino",
year = "2001",
language = "English",
volume = "49",
pages = "497--499",
journal = "Japanese Journal of Educational Psychology",
issn = "0021-5015",
publisher = "Japanese Association of Educational Psychology",
number = "4",

}

TY - JOUR

T1 - A Test Information Function for Linear Combinations of Traits Without Nuisance Traits in Multidimensional Item Response Theory

AU - Hoshino, Takahiro

PY - 2001

Y1 - 2001

N2 - In educational evaluation and psychological measurement, we often measure traits that contain several sub-traits. When tests, such as entrance examinations, are used for decision-making, often test users do not evaluate the sub-traits directly, but rather evaluate the linear combination of sub-traits in which weights were pre-specified by the test users. In the present research, we propose a new test information function and item information that enable us to evaluate linear combinations of sub-traits in which the traits are correlated. Nuisance dimensions of linear combinations are integrated out in the proposed information function. This will enable test editing in which linear combinations of sub-traits can be evaluated prior to executing the test. We also propose a method for comparing values of information functions that have different weights and/or different correlations. A numerical simulation study showed the validity of our methods. We also applied our methods to the item pool of Geometry and Statistics of the 1996 NAEP test.

AB - In educational evaluation and psychological measurement, we often measure traits that contain several sub-traits. When tests, such as entrance examinations, are used for decision-making, often test users do not evaluate the sub-traits directly, but rather evaluate the linear combination of sub-traits in which weights were pre-specified by the test users. In the present research, we propose a new test information function and item information that enable us to evaluate linear combinations of sub-traits in which the traits are correlated. Nuisance dimensions of linear combinations are integrated out in the proposed information function. This will enable test editing in which linear combinations of sub-traits can be evaluated prior to executing the test. We also propose a method for comparing values of information functions that have different weights and/or different correlations. A numerical simulation study showed the validity of our methods. We also applied our methods to the item pool of Geometry and Statistics of the 1996 NAEP test.

KW - Adaptive testing

KW - Item pool

KW - Multidimensional item response theory

KW - Test editing

UR - http://www.scopus.com/inward/record.url?scp=0347036829&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0347036829&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:0347036829

VL - 49

SP - 497

EP - 499

JO - Japanese Journal of Educational Psychology

JF - Japanese Journal of Educational Psychology

SN - 0021-5015

IS - 4

ER -