Optimization of Computerized Adaptive Tests (CAT) through the self-start procedure

Authors

  • Jordi Renom Universidad de Barcelona
  • Eduardo Doval Universidad Autónoma de Barcelona
  • Miguel Sellés TAD Sistemas

DOI:

https://doi.org/10.7203/relieve.4.2.7208

Keywords:

Computerized Adaptive Tests, CAT, item bank

Abstract

The Computerized Adaptive Tests (CAT) have many ad-vantages over the Conventional Test of paper and pencil, but their main disadvantage is that imply to build an item bank (IB) with an important size, and it involves working with high samples of subjects. It all implies that the elabo-ration process of a TAI is extremely complex and expen-sive, and it means a brake to the development of this kind of strategies.
In this work we analyse in an empirical way the possi-bilities of the Self-start procedure making TAIs, a routine to build BI designed by Renom y Martinez (1995) that allow to measure the items partially avoiding the disad-vantages pointed out above. Good products are obtained with this method bering in mind the economy of the pro-cess and the similarity of the final products in relation to conventional techniques.

References

Barbero, I. (1996). Bancos de items. En J. Mu-ñiz (Coordinador). Psicometría. Madrid: Uni-versitas.

Bennet, R.E. (1994). An electronic infrastruc-ture for a future generation of tests. Comunicación presentada en el Annual Educational Assessment. Wellington, Nueva Zelanda.

Bunderson, C.V., Inouye, D.K. y Olsen, J.B. (1989). The four generations of computerizad educational measurement. En R. L. Linn (Ed.). Educational measurement. Londres: Collier Macmillan Publishers.

Craigh, M. y Stocking, M.L. (1995). Practical issues in large-scale high-stakes Computerized Adaptive Testing. Research Report-95-23, Educational Testing Service. Princenton, NJ.

Eignor, D.R. (1997). Book review. Journal of Educational Measurement, 34(1), 97-100.

Hetter, R.D., Segall, D.O. y Bloxon, B.M. (1994). A comparison of item calibration media in computerizad adaptive testing. Applied Psychological Measurement, 18(3), 197-204. http://dx.doi.org/10.1177/014662169401800301

McBride, J.R.(1997). Research antcedents of applied adaptive testing. In W.A.Sands, B.K.Waters y J.R.Mcbride (Eds) Computerized Adaptive Testing: Form Inquiry to operation. Washington, DC: American Psycho-logical Association. http://dx.doi.org/10.1037/10244-005

Muñiz, J. (1997). La medición de lo psicológico. Lección inaugural del curso académico 1997-1998. Universidad de Oviedo: Servicio de Publicaciones.

Navas, M.J. (1996). Equiparación de puntua-ciones. En J. Muñiz (Coordinador). Psicome-tría. Madrid: Universitas.

Olea, J. y Ponsoda, V. (1996). Tests adaptativos informatizados. En J. Muñiz (Coordinador). Psicometría. Madrid: Universitas.

Perking, K., Gupta, L. y Tammana, R. (1995). Predicting item dificulty in a reading com-prehension test with an artificial neural net-work. Annual testing Research Colloquiu. Illinois.

Puyuelo, M. (1994). Evaluación de habilidades psicolinguísticas: Proceso de adaptación de una prueba psicométrica. Tesis Doctoral no publicada. Facultad de Psicología, Universi-dad Autònoma de Barcelona.

Renom, J. (1993). Tests adaptativos computerizados. Fundamentos y aplicaciones. Barcelo-na: PPU.

Renom, J. (1997). Retos y perspectivas de los tests adaptativos informatizados. En A. Cordero (Coordinador). La evaluación psicológica en el año 2000. Madrid: TEA ediciones.

Renom, J. y Martínez, N. (1994). LGFI: pro-grama para la creación y administración de items por ordenador. Comunicación presentada en el III Congreso de Evaluación Psicológica: Santiago de Compostela.

Renom, J. y Martínez, N. (1995). Construcción de Bancos de items sin anclajes ni equiparaciones: el procedimiento de autoarranque. En M. Ato y López-Pina, J.A. (Ed.). IV Symposio de metodología de las ciencias del comportamiento. Universidad de Murcia.

Renom, J., Solanas, A. y Sellés, M. (1997). Aplicaciones psicométricas de las Redes Neuronales. Comunicación presentada en el V Symposio de metodología de las ciencias del comportamiento.Universidad de Sevilla.

Weiss, D.J. (1982). Improving measurement quality and efficiency with adaptive testing. Applied Psychological Measurement, 6, 473-492. http://dx.doi.org/10.1177/014662168200600408

Weiss, D.J. (1983). New horizons in testing: Latent trait test theory and computerized adaptive testing. Nueva York: Academic Press.

Wainer, 1990. Computer adaptive testing: A premier. Hillsdale, NJ: LEA.

Downloads

Issue

Vol. 4 No. 2 (1998)

Section

Research Articles

License

The authors grant non-exclusive rights of exploitation of works published to RELIEVE and consent to be distributed under the Creative Commons Attribution-Noncommercial Use 4.0 International License (CC-BY-NC 4.0), which allows third parties to use the published material whenever the authorship of the work and the source of publication is mentioned, and it is used for non-commercial purposes. 

    The authors can reach other additional and independent contractual agreements, for the non-exclusive distribution of the version of the work published in this journal (for example, by including it in an institutional repository or publishing it in a book), as long as it is clearly stated that the Original source of publication is this magazine.  

    Authors are encouraged to disseminate their work after it has been published, through the internet (for example, in institutional archives online or on its website) which can generate interesting exchanges and increase work appointments. 

   The fact of sending your paper to RELIEVE implies that you accept these conditions.