Application of the TRI Nominal Response Model to Large-Scale Educational Assessment

Authors

  • André Felipe Zilio da Silva UFSC - Universidade Federal de Santa Catarina
  • Dalton Francisco de Andrade UFSC - Universidade Federal de Santa Catarina https://orcid.org/0000-0002-4403-980X
  • Adriano Ferreti Borgatto UFSC - Universidade Federal de Santa Catarina
  • Luiz Ricardo Nakamura UFSC - Universidade Federal de Santa Catarina https://orcid.org/0000-0002-7312-2717

Keywords:

Item Response Theory, Large Scale Assessments, Nominal Response Model

Abstract

The educational evaluation system aims to organise information that helps the decision making about the education quality. Formative evaluation focuses on teaching-learning and tries to identify students’s difficults in a fast way. In this context, a psychometric study was carried out using data from a large-scale mathematics assessment, performed by students of the 4th year of primary school in Curitiba-PR. The main aim of this paper is to apply the nominal response model from item response theory (IRT) to these data. When we compare the three-parameter logistic model, we can note that this model was able to identify problems that were not detected by the three-parameter IRT logistic model. Furthermore, this model presented a growth or decrease of the distractors according to the students’ proficiency.

Author Biographies

André Felipe Zilio da Silva, UFSC - Universidade Federal de Santa Catarina

Mestrando no Programa de Pós-Graduação em Métodos Quantitativos e Gestão em Avaliação (UFSC - em andamento).

Dalton Francisco de Andrade, UFSC - Universidade Federal de Santa Catarina

Professor do Departamento de Informática e Estatística, INE, UFSC

Adriano Ferreti Borgatto, UFSC - Universidade Federal de Santa Catarina

Professor do Departamento de Informática e Estatística, INE, UFSC

Luiz Ricardo Nakamura, UFSC - Universidade Federal de Santa Catarina

Professor do Departamento de Informática e Estatística, INE, UFSC

References

ANDRADE, D. F.; TAVARES, H. R.; VALLE, R. C. 2000. Teoria de Resposta ao Item: conceitos e aplicações. ABE — Associação Brasileira de Estatística, 4º SINAPE, 2000.

BLAND, J. M.; ALTMAN, D. G. Cronbach´s alpha. British Medical Journal. p. 314-572. 1997.

FREITAS, Luiz Carlos de; et al. Avaliação educacional: caminhando pela contramão. 5. ed. Petrópolis: Vozes, 2013.

STREINER, D. L. Being inconsistent about consistency: when coefficient alpha does and doesn´t matter. Journal of Personality Assessment. v. 80, p. 217-222. 2003.

Published

29-07-2019

How to Cite

da Silva, A. F. Z., de Andrade, D. F., Borgatto, A. F., & Nakamura, L. R. (2019). Application of the TRI Nominal Response Model to Large-Scale Educational Assessment. Sigmae, 8(2), 735–741. Retrieved from https://publicacoes.unifal-mg.edu.br/revistas/index.php/sigmae/article/view/1036