Blog Archives
GlassLabs releases research on Psychometric Considerations in Game-based Assessment
Press Release: GlassLab Publishes Research on Game-based Assessment
For Immediate Release
February 6, 2014
Digital Games Can Improve Measurement of Student Learning With Continuous Assessment, According to New Research From GlassLab
New white paper offers framework for integrating game design and educational assessment
Redwood City, Calif. – February 6, 2013 — Researchers have figured out a new way to give teachers a dynamic portrait of a student’s learning in action, using video games. In a white paper released today by Institute of Play project GlassLab (the Games, Learning and Assessment Lab), a team of assessment data scientists, learning designers and game developers describe a multidisciplinary approach to designing a new type of classroom game — a game-based assessment. Game-based assessments can provide a rich understanding of the different factors that affect educational achievement and predict how a student’s performance might change over time.
The white paper, “Psychometric Considerations in Game-Based Assessment,” answers the provocative questions that stand in the way of realizing the full potential of games to transform learning and assessment: How can scientists make sense of the endless stream of data generated by a digital game — the entire spectrum from wayward mouse clicks to strategic choices in gameplay? How can psychometric data help game designers build better challenges to improve learning outcomes? And how can experts in diverse fields come together to build and test new game-based assessments?
“Game-based assessments may hold the promise of a richer, multi-dimensional portrait of student learning, but they also present a new frontier in assessment design, ripe with challenges and opportunities for psychometricians and game designers to explore collaboratively,” says co-author Robert Mislevy, a psychometrics consultant for GlassLab, pioneer of evidence-centered assessment design, and Frederic M. Lord Chair in Measurement and Statistics at ETS. “This paper provides a framework for the continued exploration of this new frontier and proposes a design approach for developing and testing new game-based assessments.”
“Psychometric Considerations in Game-Based Assessment” is the first publication from GlassLab, and contains findings from the development of the Lab’s first game-based assessment product, SimCityEDU: Pollution Challenge!, which launched in November 2013. GlassLab’s research and development efforts are made possible by the generous support of the John D. and Catherine T. MacArthur Foundation and the Bill & Melinda Gates Foundation.
A project of the nonprofit Institute of Play, GlassLab is an interdisciplinary partnership between leaders in commercial games and experts in learning and assessment to develop next-generation educational games. Co-authors of “Psychometric Considerations in Game-Based Assessment” include researchers from Institute of Play, Educational Testing Service, Electronic Arts, and Pearson’s Center for Digital Data, Analytics and Adaptive Learning.
The 160-page white paper is available for free download today from Institute of Play. To download the full white paper and Executive Summary as a PDF e-book, or to explore print-on-demand options, please visit http://bit.ly/glasslab-research.
The next white paper from GlassLab, scheduled for publication in Fall/Winter 2014, will detail GlassLab’s Evidence-Centered Game Design process for developing game-based assessments.
Game Worlds facilitate Collaborative, Inquiry-Based, and Self-Directed learning
Jason Haas, of MIT, writes that;
“Commercial massively multiplayer online games, or MMOs, like World of Warcraft offer a number of features common to great learning environments. These games are, to varying degrees, collaborative, inquiry-based, and self-directed, all of which make them a prime place to explore aspects of math and science learning. Having a “world” in which to situate problems also means that players can solve something that feels meaningful to them; and see the consequences of their individual and collective actions. The massively multiplayer nature of these games also creates an opportunity for students to address problems with colleagues. Problems too large for any one of them to solve by themselves can be solved collectively by gathering data together, comparing notes, and acting decisively, confident in their evidence-based decisions.
At their best (and, frankly, even at their worst), these games function as a kind of society.
So, if you can combine these existing practices with engaging math and science content, imagine the learning experience you could provide. Thanks to a grant from the Bill & Melinda Gates Foundation, we’re doing just that.
Our game, The Radix Endeavor, is a massively multiplayer online learning game, designed by our lab, The Education Arcade at MIT, and developed by Filament Games in Madison, Wisc. The game places thousands of players in an Earth-like world with a technical and social situation similar to our 1400s.”
To read the full article click here;
http://www.boston.com/business/innovation/state-of-play/2014/02/mind_games_new_adventures_in_l.html
Gates Foundation sponsors game-based learning
http://www.ajc.com/opinion/game-based-learning-1478744.html
“Game-based learning is one of the priorities of the Bill & Melinda Gates Foundation, a nonprofit founded by the Microsoft creator. . . .Two years ago, the nonprofit brought together 20 of the country’s best assessment designers with 20 of the world’s best game designers to discuss creating games that engage kids more deeply, said Vicki Phillips, director of the college ready strategy for the Gates Foundation. Now the foundation is working with the Center for Game Science at the University of Washington on a free, online game called Refraction. As students play, their progress is visible to the teacher on his or her computer, allowing the educator to see instantly what concepts students understand.” – Jamie Sarrio
$10.3 Million for new Games, Learning, and Assessment Lab
“The game industry and nonprofits are teaming up to create a video game design lab that will do research on engaging students and measuring learning … The new Games, Learning and Assessment (GLASS) Lab will be managed by the Institute of Play, a nonprofit video game institute with support from the John D. and Catherine T. MacArthur Foundation, the Bill & Melinda Gates Foundation, Electronic Arts, and the Entertainment Software Association (ESA). It will be supported by $10.3 million in grants.”- Dean Takahashi
Gaming and Education 