One of our principles of measurement is that we should be able to quantify error. The standard errors of both person ability and item difficulty can be obtained.
rm(list=ls()) #remove all variables in the R environmentlibrary(TAM) #load the package TAM so we can use the functions in TAMlibrary(tidyverse)# load in the datasetresponses <-read_csv('data/responses.csv')# keep the scoresresponses <- responses %>%select(ends_with('score'))mod1 <-tam.jml(responses,bias=FALSE)fit1 <-tam.jml.fit(mod1,trim_val =NULL)item_fit <-tibble(fit1$fit.item)item_fit <- item_fit %>%bind_cols(mod1$item1)item_fit <- item_fit %>%arrange(xsi)
How would you describe the relationship between the standard error of the item difficulty and the item difficulty?
p <-ggplot(item_fit, aes(x=xsi, y=se.xsi))p <- p +geom_point()p
Andrich, David, and Ida Marais. 2019. “The Idea of Measurement.” In A Course in Rasch Measurement Theory, 3–11. Springer Nature Singapore. https://doi.org/10.1007/978-981-13-7496-8_1.
Bond, Trevor G., Zi Yan, and Moritz Heene. 2020. Applying the Rasch Model: Fundamental Measurement in the Human Sciences. Routledge. https://doi.org/10.4324/9780429030499.
Cappelleri, Jason Lundy, J. C. 2014. “Overview of Classical Test Theory and Item Response Theory for the Quantitative Assessment of Items in Developing Patient-Reported Outcomes Measures.”Clinical Therapeutics 36 (5): 648–62. https://doi.org/https://doi.org/10.1016/j.clinthera.2014.04.006.
Cronbach, Lee J. 1951. “Coefficient Alpha and the Internal Structure of Tests.”Psychometrika 16 (3): 297–334. https://doi.org/10.1007/bf02310555.
Goldstein, H., and Steve Blinkhorn. 1982. “The Rasch Model Still Does Not Fit.”British Educational Research Journal 8 (2): 167–70. https://doi.org/10.1080/0141192820080207.
Lord, Frederic M, and Melvin R Novick. 2008. Statistical Theories of Mental Test Scores. IAP.
McNeish, Daniel. 2018. “Thanks Coefficient Alpha, We’ll Take It from Here.”Psychological Methods 23 (3): 412–33. https://doi.org/10.1037/met0000144.
Panayides, Panayiotis, Colin Robinson, and Peter Tymms. 2010. “The Assessment Revolution That Has Passed England by: Rasch Measurement.”British Educational Research Journal 36 (4): 611–26. https://doi.org/10.1080/01411920903018182.
Sijtsma, Klaas. 2008. “On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha.”Psychometrika 74 (1): 107–20. https://doi.org/10.1007/s11336-008-9101-0.
Wright, Benjamin D, and Magdalena Mok. 2000. “Rasch Models Overview.”Journal of Applied Measurement 1 (1): 83–106.