GlassLabs releases research on Psychometric Considerations in Game-based Assessment
Press Release: GlassLab Publishes Research on Game-based Assessment
For Immediate Release
February 6, 2014
Digital Games Can Improve Measurement of Student Learning With Continuous Assessment, According to New Research From GlassLab
New white paper offers framework for integrating game design and educational assessment
Redwood City, Calif. – February 6, 2013 — Researchers have figured out a new way to give teachers a dynamic portrait of a student’s learning in action, using video games. In a white paper released today by Institute of Play project GlassLab (the Games, Learning and Assessment Lab), a team of assessment data scientists, learning designers and game developers describe a multidisciplinary approach to designing a new type of classroom game — a game-based assessment. Game-based assessments can provide a rich understanding of the different factors that affect educational achievement and predict how a student’s performance might change over time.
The white paper, “Psychometric Considerations in Game-Based Assessment,” answers the provocative questions that stand in the way of realizing the full potential of games to transform learning and assessment: How can scientists make sense of the endless stream of data generated by a digital game — the entire spectrum from wayward mouse clicks to strategic choices in gameplay? How can psychometric data help game designers build better challenges to improve learning outcomes? And how can experts in diverse fields come together to build and test new game-based assessments?
“Game-based assessments may hold the promise of a richer, multi-dimensional portrait of student learning, but they also present a new frontier in assessment design, ripe with challenges and opportunities for psychometricians and game designers to explore collaboratively,” says co-author Robert Mislevy, a psychometrics consultant for GlassLab, pioneer of evidence-centered assessment design, and Frederic M. Lord Chair in Measurement and Statistics at ETS. “This paper provides a framework for the continued exploration of this new frontier and proposes a design approach for developing and testing new game-based assessments.”
“Psychometric Considerations in Game-Based Assessment” is the first publication from GlassLab, and contains findings from the development of the Lab’s first game-based assessment product, SimCityEDU: Pollution Challenge!, which launched in November 2013. GlassLab’s research and development efforts are made possible by the generous support of the John D. and Catherine T. MacArthur Foundation and the Bill & Melinda Gates Foundation.
A project of the nonprofit Institute of Play, GlassLab is an interdisciplinary partnership between leaders in commercial games and experts in learning and assessment to develop next-generation educational games. Co-authors of “Psychometric Considerations in Game-Based Assessment” include researchers from Institute of Play, Educational Testing Service, Electronic Arts, and Pearson’s Center for Digital Data, Analytics and Adaptive Learning.
The 160-page white paper is available for free download today from Institute of Play. To download the full white paper and Executive Summary as a PDF e-book, or to explore print-on-demand options, please visit http://bit.ly/glasslab-research.
The next white paper from GlassLab, scheduled for publication in Fall/Winter 2014, will detail GlassLab’s Evidence-Centered Game Design process for developing game-based assessments.
$10.3 Million for new Games, Learning, and Assessment Lab
“The game industry and nonprofits are teaming up to create a video game design lab that will do research on engaging students and measuring learning … The new Games, Learning and Assessment (GLASS) Lab will be managed by the Institute of Play, a nonprofit video game institute with support from the John D. and Catherine T. MacArthur Foundation, the Bill & Melinda Gates Foundation, Electronic Arts, and the Entertainment Software Association (ESA). It will be supported by $10.3 million in grants.”- Dean Takahashi