Some of the material in is restricted to members of the community. By logging in, you may be able to gain additional access to certain collections or items. If you have questions about access or logging in, please use the form on the Contact Page.
Siebert, C. F. (2013). Differential Item Functioning Identification Strategy for Items with Dichotomous Responses Using the Item Information Curve: A Weighted Area Method (WAM). Retrieved from http://purl.flvc.org/fsu/fd/FSU_migr_etd-9094
Differential Item Functioning Identification Strategy for Items with Dichotomous Responses Using the Item Information Curve: A Weighted Area Method (WAM)
Frequently researchers base their decisions and interpretations on conclusions drawn from data analyses, but what happens when the data used in the analyses are collected from unreliable instruments or surveys? The instrument may include a particular question that invokes different interpretations based on group membership, thereby placing one of the two groups at an unfair disadvantage. Another challenge occurs when the size of the sample under investigation (i.e., number of respondents or participants) is unavoidably small, adding more uncertainty to parameter estimates. Over the past 50 years, researchers have suggested many different approaches for identifying problematic questions (i.e., items that are biased), but no consensus has been reached as to which method is best. In addition, selecting appropriate methods becomes even more challenging when smaller sample sizes are involved (Lai, Teresi, & Gershon, 2005). This dissertation presents the findings of a study introducing a new method for identifying DIF and potentially biased items. The study explored the use of the Item Information Curve (IIC) as a weighting strategy (i.e., Weighted Area Method - WAM) to the area between Item Characteristic Curves (ICC) as a way to identify problematic questions. Through thousands of simulations, the performance of WAM was compared to two other commonly used methods for detecting DIF - the Mantel-Haenszel approach (Mantel & Haenszel, 1959) and the Rudner's Area method (Rudner, 1977). The results show the effects of sample size variations on identifying modeled DIF items, and the opportunity for future Differential Item Functioning (DIF) analyses using WAM.
Differential Item Functioning DIF, Item information curve IIC, Item response theory IRT, Monte Carlo, Simulation study, WAM
Date of Defense
November 8, 2013.
Submitted Note
A Dissertation submitted to the Department of Educational Psychology and Learning Systems in partial fulfillment of the requirements for the degree of Doctor of Philosophy.
Bibliography Note
Includes bibliographical references.
Advisory Committee
Betsy Becker, Professor Directing Dissertation; Akihito Kamata, Professor Co-Directing Dissertation; Fred Huffer, University Representative; Yanyun Yang, Committee Member; Insu Paek, Committee Member.
Publisher
Florida State University
Identifier
FSU_migr_etd-9094
Use and Reproduction
This Item is protected by copyright and/or related rights. You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s). The copyright in theses and dissertations completed at Florida State University is held by the students who author them.
Siebert, C. F. (2013). Differential Item Functioning Identification Strategy for Items with Dichotomous Responses Using the Item Information Curve: A Weighted Area Method (WAM). Retrieved from http://purl.flvc.org/fsu/fd/FSU_migr_etd-9094