June 18, 2025 | Research Methods, Measurement, and Evaluation

Multiple Research Methods, Measurement, & Evaluation (RMME) community members are presenting at the 2024 annual meeting of the American Evaluation Association (AEA) this week. Remember to check out these excellent presentations–we hope to see you there!

Wednesday, October 23
4:15 PM to 5:15 PM
Location: B117-119
Session Title: (Panel + AEA Sponsored Sessions)
Presentation Title: Amplifying and Empowering Voices through Evaluation Journals
Chair: Bianca Montrosse-Moorhead*
Presenters: Florence Etta/Laura Peck/Nicole Bowman (Lunaape/Mohican)/Ayesha Boyce/ Thomas Archibald/Daniel Balsaobre-Lorente/Michael A. Harnar/Sarah Mason/Hanh Cao Yu

Thursday, October 24
10:15 AM to 11:15 AM
Location: G131-132
Session Title: (Panel + Theories of Evaluation)
Presentation Title: What Happens When You Give Evaluators a Box of Crayons? Reflections on Visualizations of Evaluation Theory
Chair: Sebastian Lemire
Presenters: Christina Christie/Tarek Azzam/Bianca Montrosse-Moorhead*
Discussants: Melvin M. Mark

6:00 PM to 7:30 PM
Location: N/A
Session Title: Poster Reception #2 (Poster + Organizational Learning and Evaluation Capacity Building)
Presentation Title: 257 – Amplifying the voices of new Evaluation Capacity Builders: Lessons learned from transferring new skills and ideas into the workplace
Chair: Leslie A. Fierro*
Presenters: Emily Frost, Lashonda Williams/Renee Boyer/Jordyn J. Livingston
Discussants: Heather D. Codd/ Renee Boyer

Friday, October 25
11:30 AM to 12:30 PM
Location: C120-122
Session Title: (Multipaper + Health Evaluation)
Presentation Title: The Updated CDC Program Evaluation Framework: Revised to Meet Current and Future Public Health and Evaluation Needs
Presenters: Daniel P. Kidder/Heather Salvaggio/Elena Luna
Discussants: Leslie A. Fierro*
Authors: Daniel P. Kidder/Cassandra Davis/Destiny Bruce/Michael Kerzner

12:45 PM to 1:45 PM
Location: Exhibit Hall A
Session Title: Birds of a feather (STEM Education and Training)
Presentation Title: 62 – Amplifying the Voices of Multigenerational and Multidisciplinary STEM Evaluation Journeys – A Roundtable Bridge of Resources and Mentorship
Presenters: Kevin Keane/Clara M. Pelfrey/Breonte Guy/Leslie A. Fierro*/Carlos Romero/Alexandra Budenz/Robert Garcia/Rechelle Paranal
Facilitators: Rajiv R. Ramdat/Ciara C. Knight

2:30 PM to 3:30 PM
Location: Portland Ballroom 254
Session Title: (Roundtable + Research on Evaluation)
Presentation Title: What does it mean to be an evaluator?
Presenters: Doris Espelien/Dana J. Linnell/Bianca Montrosse-Moorhead*/Aileen M. Reid/Cherie M. Avent/Grettel Arias Orozco/ Onyinyechukwu Onwuka du Bruyn
Authors: Doris Espelien/Dana J. Linnell/Bianca Montrosse-Moorhead*/Aileen M. Reid/Cherie M. Avent/Grettel Arias Orozco/ Onyinyechukwu Onwuka du Bruyn

3:45 PM to 4:45 PM PST
Location: B113-114
Session Title: (Think Tank + Use and Influence of Evaluation)
Presentation Title: The Critical Role of Equity and Inclusion in Defining Rigor: What It Takes to Reimagine Peer Review Journals
Chair: Hanh Cao Yu
Presenters: Rodney Hopson/Bianca Montrosse-Moorhead*

4:15 PM to 4:30 PM
Location: D133-134
Session Title: Building Evaluator Capacity and Competencies (Paper + Graduate Students and New Evaluators and Research on Evaluation)
Presentation Title: Doctoral Student Experiences with Research on Evaluation: Insights and Opportunities from a Collaborative Autoethnography
Presenters: Amanda Sutter*/ Valerie Marshall/Rachael Kenney/Allison Prieur/ Kari Ross Nelson/ Christine Liboon

*RMME Community member

RMME/STAT Joint Colloquium

Assessment of Fit of Item Response Theory Models: Full-information and Limited-information Methods, Item and Person Fit Analysis, and Beyond

Dr. Sandip Sinharay

Educational Testing Service (ETS) Research Institute

Friday, October 11, at 11:15 AM ET

AUST 110

https://tinyurl.com/rmme-Sinharay

Item response theory (IRT) is one of the central methodological pillars supporting many large and high-profile assessment programs globally. IRT analysis is essentially a type of discrete multivariate analysis and is performed using IRT models that are latent variable models for discrete data. However, IRT models involve multiple assumptions like conditional independence, monotonicity etc. and the results obtained from IRT models may not be accurate if one or more of the assumptions are not met, that is, if there is IRT model misfit. This presentation will include a comprehensive review of the literature on the assessment of fit of IRT models. The presenter will discuss various approaches and concepts regarding IRT model fit including full-information and limited-information methods, residual analysis, item and person-fit analysis, Bayesian methods, analysis for differential item functioning, and assessment of practical significance of misfit. A real data example will be used to illustrate some of the approaches. One goal of the presentation is to stimulate discussions involving the audience members regarding IRT model-fit assessment.

Taking too long?

Reload document

Open in new tab

Research Methods, Measurement, and Evaluation

Month: October 2024

RMME Community Members Present at AEA 2024

RMME Community Members Present at NAGC 2024

Upcoming RMME/STAT Colloquium (10/11): Sandip Sinharay, “Assessment of Fit of Item Response Theory Models: Full-information and Limited-information Methods, Item and Person Fit Analysis, and Beyond”