Handbook of Learning Analytics
Chapter 15
Game Learning Analytics
Emily Reardon, Vishesh Kumar, & Glenda Revelle
Abstract
Games are a pervasive cultural phenomenon with intriguing connections to learning, and the use of learning analytics can inform our understanding of learning in the context of games. In this chapter we identify four principles that are fundamental to both compelling gameplay and meaningful learning -- \textbf{agency}, \textbf{engagement}, \textbf{growth}, and \textbf{social connection}. Agency in learners helps them grow and feel safe to fail, persist, and feel ownership of their learning. Engagement, both as great interest and active involvement, is essential to learning, and digital games can be very engaging. Growth involves increases in ability that are developed through effort, perseverance, trying alternative strategies, and seeking help from others. Social connection with other players both within and outside of games facilitates learning. We propose that these four principles serve as an entry point for understanding and conducting game learning analytics work. For each principle we provide examples of evidence-based approaches to the design, measurement, and analysis of learning in game-based contexts to guide thinking and work in the nascent field of game learning analytics. This chapter is intended to be useful not only to game learning analytics practitioners but also to people working in LA-adjacent domains, such as game design, classroom learning, data security, and educational policy. We suggest that designers, practitioners, educators, and learners could all benefit from the translation of academic GLA work into a form that is useful to this broader constituency.
Anderman, Eric M., Chammie C. Austin, and Dawn M. Johnson. 2002. “The Development of Goal Orientation.” In Development of Achievement Motivation, 197–220. Elsevier.
Antle, Alissa, Allen Bevans, Theresa Tanenbaum, Katie Seaborn, and Sijie Wang. 2011. “Futura: Design for Collaborative Learning and Game Play on a Multi-Touch Digital Tabletop.” In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction, 93–100. https://doi.org/10.1145/1935701.1935721.
Bandura, Albert. 1977. “Self-Efficacy: Toward a Unifying Theory of Behavioral Change.” Psychological Review 84 (2): 191–215. https://doi.org/10.1037/0033-295X.84.2.191.
Barnett, Susan M. 2014. “Virtual to Real Life—Assessing Transfer of Learning from Video Games.” Learning by Playing: Video Gaming in Education, 15–28.
Bartle, Richard. 1996. “Hearts, Clubs, Diamonds, Spades: Players Who Suit MUDs.” Journal of MUD Research 1 (1): 19.
Berland, Matthew, Taylor Martin, Tom Benton, Carmen Petrick Smith, and Don Davis. 2013. “Using Learning Analytics to Understand the Learning Pathways of Novice Programmers.” Journal of the Learning Sciences 22 (4): 564–99. https://doi.org/10.1080/10508406.2013.836655.
Bogost, Ian. 2007. Persuasive Games: The Expressive Power of Videogames. MIT Press.
Bouvier, Patrice, Elise Lavoué, and Karim Sehaba. 2014. “Defining Engagement and Characterizing Engaged-Behaviors in Digital Gaming.” Simulation & Gaming 45 (4): 491–507.
Boyle, Elizabeth A, Thomas M. Connolly, Thomas Hainey, and James M Boyle. 2012. “Engagement in Digital Entertainment Games: A Systematic Review.” Computers in Human Behavior 28 (3): 771–80.
Brooks, Mindy, Ashley Fenwick-Naditch, and Erica Branch-Ridley. 2011. “Electric Racer: An Intergenerational Gaming Experience Designed to Promote Literacy.” New York, NY: The Joan Ganz Cooney Center at Sesame Workshop.
Brown, Peter C., Henry L. Roediger III, and Mark A. McDaniel. 2014. Make It Stick: The Science of Successful Learning. Cambridge, MA: Harvard University Press.
Brunick, Kaitlin L., Marisa M. Putnam, Lauren E. McGarry, Melissa N. Richards, and Sandra L. Calvert. 2016. “Children’s Future Parasocial Relationships with Media Characters: The Age of Intelligent Characters.” Journal of Children and Media 10 (2): 181–90. https://doi.org/10.1080/17482798.2015.1127839.
Butler, Eric, Erik Andersen, Adam M. Smith, Sumit Gulwani, and Zoran Popović. 2015. “Automatic Game Progression Design Through Analysis of Solution Features.” In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI ’15, 2407–16. Seoul, Republic of Korea: ACM Press. https://doi.org/10.1145/2702123.2702330.
Capp, Matthew James. 2017. “The Effectiveness of Universal Design for Learning: A Meta-Analysis of Literature Between 2013 and 2016.” International Journal of Inclusive Education 21 (8): 791–807. https://doi.org/10.1080/13603116.2017.1325074.
Chapman, V., and Robin Hunicke. 2004. “AI for Dynamic Difficulty Adjustment in Games.” In Proceedings of the Challenges in Game AI Workshop, Nineteenth National Conference on Artificial Intelligence, 91–96. San Jose, California, USA.
Chaudy, Yaelle, Thomas Connolly, and Thomas Hainey. 2014. “Learning Analytics in Serious Games: A Review of the Literature.” In European Conference in the Applications of Enabling Technologies 2014.
Chehabi, H. E., and Allen Guttmann. 2002. “From Iran to All of Asia: The Origin and Diffusion of Polo.” The International Journal of the History of Sport 19 (2): 384–400. https://doi.org/10.1080/714001752.
Clark, Terry Ray, and Dan W. Clanton. 2012. Understanding Religion and Popular Culture: Theories, Themes, Products and Practices. Routledge.
Copier, Marinka. 2005. “Connecting Worlds. Fantasy Role-Playing Games, Ritual Acts and the Magic Circle.” In.
Csikszentmihalyi, Mihaly, Sami Abuhamdeh, and Jeanne Nakamura. 2014. “Flow.” In Flow and the Foundations of Positive Psychology, 227–38. Springer.
Cukurova, Mutlu, Rosemary Luckin, and Alison Clark‐Wilson. 2019. “Creating the Golden Triangle of Evidence-Informed Education Technology with EDUCATE.” British Journal of Educational Technology 50 (2): 490–504. https://doi.org/10.1111/bjet.12727.
Deater-Deckard, Kirby, Mido Chang, and Michael E. Evans. 2013. “Engagement States and Learning from Educational Games.” New Directions for Child and Adolescent Development 2013 (139): 21–30.
Deci, Edward L. 1971. “Effects of Externally Mediated Rewards on Intrinsic Motivation.” Journal of Personality and Social Psychology 18 (1): 105–15. https://doi.org/10.1037/h0030644.
DeLiema, David, Noel Enyedy, and Joshua A. Danish. 2019. “Roles, Rules, and Keys: How Different Play Configurations Shape Collaborative Science Inquiry.” Journal of the Learning Sciences, 1–43.
Dickey, Michele. 2005. “Engaging by Design: How Engagement Strategies in Popular Computer and Video Games Can Inform Instructional Design.” Educational Technology Research and Development 53 (June): 67–83. https://doi.org/10.1007/BF02504866.
Drachen, Anders, Magy Seif El-Nasr, and Alessandro Canossa. 2013. Game Analytics: Maximizing the Value of Player Data. Springer.
Ducheneaut, Nicolas, Nicholas Yee, Eric Nickell, and Robert J. Moore. 2006. “"Alone Together?": Exploring the Social Dynamics of Massively Multiplayer Online Games.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI ’06, 407. Montréal, Québec, Canada: ACM Press. https://doi.org/10.1145/1124772.1124834.
Dweck, Carol S. 2008. Mindset: The New Psychology of Success. Random House Digital, Inc.
Erikson, Erik H. 1956. “Ego Identity and the Psychosocial Moratorium.” New Perspectives for Research in Juvenile Delinquency, 1–23.
Fisher, Kelly, Kathy Hirsh-Pasek, Roberta M. Golinkoff, Dorothy G. Singer, and Laura Berk. 2011. “Playing Around in School: Implications for Learning and Educational Policy.” In The Oxford Handbook of the Development of Play, A. Pellegrini, 341–60. New York, NY: Oxford University Press.
Fredricks, Jennifer A., Phyllis. Blumenfeld, and Alison H. Paris. 2004. “School Engagement: Potential of the Concept, State of the Evidence.” Review of Educational Research 74 (1): 59–109. https://doi.org/10.3102/00346543074001059.
Gee, James Paul. 2003. What Video Games Have to Teach Us About Learning and Literacy. Palgrave Macmillan.
Grabinger, R. Scott, and Joanna C. Dunlap. 1995. “Rich Environments for Active Learning: A Definition.” ALT-J 3 (2): 5–34.
Hamari, Juho, and Janne Tuunanen. 2014. “Player Types: A Meta-Synthesis.” Transactions of the Digital Games Research Association 1 (March): 29–53. https://doi.org/10.26503/todigra.v1i2.13.
Hirsh-Pasek, Kathy, Jennifer M Zosh, Roberta Michnick Golinkoff, James H. Gray, Michael B. Robb, and Jordy Kaufman. 2015. “Putting Education in ‘Educational’ Apps: Lessons from the Science of Learning.” Psychological Science in the Public Interest 16 (1): 3–34.
Holbert, Nathan, and Uri Wilensky. 2019. “Designing Educational Video Games to Be Objects-to-Think-with.” Journal of the Learning Sciences 28 (1): 32–72.
Hooshyar, Danial, Moslem Yousefi, and Heuiseok Lim. 2019. “A Systematic Review of Data-Driven Approaches in Player Modeling of Educational Games.” Artificial Intelligence Review 52 (3): 1997–2017. https://doi.org/10.1007/s10462-017-9609-8.
Huizinga, Johan. 1949. Homo Ludens: A Study of the Play Element in Culture, Trans. R. F. C. Hull (After Huizinga’s Own Translation). London.
Juul, Jesper. 2013. The Art of Failure: An Essay on the Pain of Playing Video Games. MIT press.
Kafai, Yasmin B. 2010. “World of Whyville an Introduction to Tween Virtual Life.” Games and Culture 5 (January): 3–22. https://doi.org/10.1177/1555412009351264.
Ke, Fengfeng, Valerie Shute, Kathleen M Clark, and Gordon Erlebacher. 2019. Interdisciplinary Design of Game-Based Learning Platforms. Springer.
Kiili, Kristian, and Timo Lainema. 2008. “Foundation for Measuring Engagement in Educational Games.” Journal of Interactive Learning Research 19 (January): 469–88.
Klopfer, Eric, and Scot Osterweil. 2013. “The Boom and Bust and Boom of Educational Games.” In Transactions on Edutainment IX, 290–96. Springer.
Kumar, Vishesh, Mike Tissenbaum, and Matthew Berland. 2017. “What Are Visitors up to? Helping Museum Facilitators Know What Visitors Are Doing.” In Proceedings of the Seventh International Learning Analytics & Knowledge Conference, 558–59.
Lauricella, Alexis R., Alice Ann Gola, and Sandra L. Calvert. 2011. “Toddlers’ Learning from Socially Meaningful Video Characters.” Media Psychology 14 (May): 216–32. https://doi.org/10.1080/15213269.2011.573465.
Liu, Yun-En, Travis Mandel, Eric Butler, Erik Andersen, Eleanor O’Rourke, Emma Brunskill, and Zoran Popovic. 2013. “Predicting Player Moves in an Educational Game: A Hybrid Approach.” In EDM, 106–13. Citeseer.
Malone, Thomas W., and Mark Lepper. 1987. “Making Learning Fun: A Taxonomic Model of Intrinsic Motivations for Learning.” Aptitude, Learning, and Instruction.
Morrison, Donald M., and Kenneth B. Miller. 2018. “Teaching and Learning in the Pleistocene: A Biocultural Account of Human Pedagogy and Its Implications for AIED.” International Journal of Artificial Intelligence in Education 28 (3): 439–69. https://doi.org/10.1007/s40593-017-0153-0.
O’Rourke, Eleanor, Kyla Haimovitz, Christy Ballweber, Carol Dweck, and Zoran Popović. 2014. “Brain Points: A Growth Mindset Incentive Structure Boosts Persistence in an Educational Game.” In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems - CHI ’14, 3339–48. Toronto, Ontario, Canada: ACM Press. https://doi.org/10.1145/2556288.2557157.
O’Rourke, Eleanor, Erin Peach, Carol S. Dweck, and Zoran Popovic. 2016. “Brain Points: A Deeper Look at a Growth Mindset Incentive Structure for an Educational Game.” In Proceedings of the Third (2016) ACM Conference on Learning @ Scale - L@S ’16, 41–50. Edinburgh, Scotland, UK: ACM Press. https://doi.org/10.1145/2876034.2876040.
Owen, V., and Ryan S. J. d. Baker. 2019. “Learning Analytics for Games.” In Handbook of Game-Based Learning. Cambridge, MA: MIT.
Owen, V. Elizabeth. 2015. “Using Learning Analystics to Support Educational Game Development: A Data-Driven Design Apporach.” In American Educational Research Association (AERA) Annual Meeting, Chicago, IL.
Papert, Seymour. 1980. “Mindstorms: Computers, Children, and Powerful Ideas.” NY: Basic Books.
Pea, Roy D. 2004. “The Social and Technological Dimensions of Scaffolding and Related Theoretical Concepts for Learning, Education, and Human Activity.” The Journal of the Learning Sciences 13 (3): 423–51. http://www.jstor.org/stable/1466943.
Pellicone, Anthony, and June Ahn. 2014. “Construction and Community: Investigating Interaction in a Minecraft Affinity Space.” Proceedings of the Tenth Conference for Games + Learning + Society - GLS 2014, 187–93. https://nyuscholars.nyu.edu/en/publications/construction-and-community-investigating-interaction-in-a-minecra.
Peppler, Kylie, Joshua Danish, Benjamin Zaitlen, Diane Glosson, Alexander Jacobs, and David Phelps. 2010. “BeeSim: Leveraging Wearable Computers in Participatory Simulations with Young Children.” In Proceedings of the 9th International Conference on Interaction Design and Children, 246–49. https://doi.org/10.1145/1810543.1810582.
Perdue, Diana S. 2016. “Increasing Student Engagement in Math with Online Games and Elements of Game Theory.” Shining a Light on Mathematics Learning.
Phillips, Rachel S., Theresa Horstman, Nancy Vye, and John Bransford. 2014. “Engagement and Games for Learning: Expanding Definitions and Methodologies.” Simulation & Gaming 45 (4): 548–68.
Piaget, Jean. 1952. The Origins of Intelligence in Children. Vol. 8. 5. International Universities Press New York.
Przybylski, Andrew K., C. Scott Rigby, and Richard M. Ryan. 2010. “A Motivational Model of Video Game Engagement.” Review of General Psychology 14 (2): 154–66. https://doi.org/10.1037/a0019440.
Ramirez, Dennis. 2016. How Player Movement Data Improves Educational Game Assessments. The University of Wisconsin-Madison.
Reilly, Joseph, Vishesh Kumar, Shari Metcalf, Matthew Berland, Chris Dede, and Tina A. Grotzer. 2018. “Learning Analytics in a Teacher Dashboard to Facilitate Inquiry-Based Instruction.” In Spotlight and Tech Demos. MIT, Cambridge, MA.
Reimann, Peter. 2016. “Connecting Learning Analytics with Learning Research: The Role of Design-Based Research.” Learning: Research and Practice 2 (2): 130–42. https://doi.org/10.1080/23735082.2016.1210198.
Revelle, Glenda. 2003. “Educating via Entertainment Media: The Sesame Workshop Approach.” Computers in Entertainment 1 (October): 1–9. https://doi.org/10.1145/950566.950590.
———. 2013. “Applying Developmental Theory and Research to the Creation of Educational Games.” New Directions for Child and Adolescent Development 2013 (139): 31–40. https://doi.org/10.1002/cad.20029.
Richard, Gabriela T. 2013. “Designing Games That Foster Equity and Inclusion: Encouraging Equitable Social Experiences Across Gender and Ethnicity in Online Games.” In Proceedings of the CHI’2013 Workshop: Designing and Evaluating Sociability in Online Video Games (Paris, France, 83–88.
Ringland, Kathryn E., Christine T. Wolf, Heather Faucett, Lynn Dombrowski, and Gillian R. Hayes. 2016. “"Will I Always Be Not Social?": Re-Conceptualizing Sociality in the Context of a Minecraft Community for Autism.” In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI ’16, 1256–69. Santa Clara, California, USA: ACM Press. https://doi.org/10.1145/2858036.2858038.
Roberts, Jeremy D., Gregory K. W. K. Chung, and Charles B. Parks. 2016. “Supporting Children’s Progress Through the PBS KIDS Learning Analytics Platform.” Journal of Children and Media 10 (2): 257–66. https://doi.org/10.1080/17482798.2016.1140489.
Rogoff, Barbara. 1994. “Developing Understanding of the Idea of Communities of Learners.” Mind, Culture, and Activity 1 (4): 209–29.
Romero, Margarida, Mireia Usart, Michela Ott, and Jeffrey Earp. 2012. “Learning Through Playing for or Against Each Other? Promoting Collaborative Learning in Digital Game Based Learning.” Proceedings of the 20th European Conference on Information Systems 5 (January): 5–15.
Rose, David H., and Anne Meyer. 2006. A Practical Reader in Universal Design for Learning. ERIC.
Salen, Katie. 2008. The Ecology of Games: Connecting Youth, Games, and Learning. MIT press.
Salen, Katie, and Eric Zimmerman. 2003. Rules of Play: Game Design Fundamentals. MIT press.
Shute, Valerie J. 2011. “Stealth Assessment in Computer-Based Games to Support Learning.” Computer Games and Instruction 55 (2): 503–24.
Shute, Valerie J, Lubin Wang, Samuel Greiff, Weinan Zhao, and Gregory Moore. 2016. “Measuring Problem Solving Skills via Stealth Assessment in an Engaging Video Game.” Computers in Human Behavior 63: 106–17.
Shute, Valerie, Fengfeng Ke, Russel Almond, Seyedahmad Rahimi, Ginny Smith, and Xi Lu. 2019. “How to Increase Learning While Not Decreasing the Fun in Educational Games.” In Learning Science: Theory, Research, and Practice, 327–58.
Smith, David Eugene, and Clara C. Eaton. 1911. “Rithmomachia, the Great Medieval Number Game.” The American Mathematical Monthly 18 (4): 73–80. https://doi.org/10.2307/2973449.
Squire, Kurt D. 2005. “Resuscitating Research in Educational Technology: Using Game-Based Learning Research as a Lens for Looking at Design-Based Research.” Educational Technology 45 (1): 8–14. https://www.jstor.org/stable/44429183.
Steinkuehler, Constance. 2011. “The Mismeasure of Boys: Reading and Online Videogames.” WCER Working Paper No. 2011-3. https://wcer.wisc.edu/publications/abstract/wcer-working-paper-no.-2011-3.
Steinkuehler, Constance A. 2006. “Massively Multiplayer Online Video Gaming as Participation in a Discourse.” Mind, Culture, and Activity 13 (1): 38–52. https://doi.org/10.1207/s15327884mca1301_4.
Steinkuehler, Constance, and Kurt D. Squire. 2014. “Videogames and Learning.” Cambridge Handbook of the Learning Sciences, 377–96.
Sung, Han-Yu, and Gwo-Jen Hwang. 2013. “A Collaborative Game-Based Learning Approach to Improving Students’ Learning Performance in Science Courses.” Computers & Education 63 (April): 43–51. https://doi.org/10.1016/j.compedu.2012.11.019.
Teasley, Stephanie. 2019. “Learning Analytics: Where Information Science and the Learning Sciences Meet.” Information and Learning Science 120 (1): 59–73. https://doi.org/10.1108/ILS-06-2018-0045.
Thomas, Michael K., Sasha A. Barab, and Hakan Tuzun. 2009. “Developing Critical Implementations of Technology-Rich Innovations: A Cross-Case Study of the Implementation of Quest Atlantis.” Journal of Educational Computing Research 41 (2): 125–53.
Tissenbaum, Mike, Vishesh Kumar, and Matthew Berland. 2016. “Modeling Visitor Behavior in a Game-Based Engineering Museum Exhibit with Hidden Markov Models.” International Educational Data Mining Society, 6.
Troseth, Georgene L., Colleen E. Russo, and Gabrielle A. Strouse. 2016. “What’s Next for Research on Young Children’s Interactive Media?” Journal of Children and Media 10 (January): 54–62. https://doi.org/10.1080/17482798.2015.1123166.
Villalta, Marco, Ignacio Gajardo, Miguel Nussbaum, Juan José Andreu, Alejandro Echeverría, and Jan L. Plass. 2011. “Design Guidelines for Classroom Multiplayer Presential Games (CMPG).” Computers & Education 57: 2039–53. https://doi.org/10.1016/j.compedu.2011.05.003.
Vygotsky, Lev Semenovich. 1978. Mind in Society: The Development of Higher Psychological Processes. Harvard university press.
Wang, Bingqing, Laramie Taylor, and Qiusi Sun. 2018. “Families That Play Together Stay Together: Investigating Family Bonding Through Video Games.” New Media & Society 20 (11): 4074–94. https://doi.org/10.1177/1461444818767667.
Weisberg, Deena Skolnick, Kathy Hirsh-Pasek, and Roberta Michnick Golinkoff. 2013. “Guided Play: Where Curricular Goals Meet a Playful Pedagogy.” Mind, Brain, and Education 7 (2): 104–12. https://doi.org/10.1111/mbe.12015.
Wise, Alyssa Friend, and Baruch Schwarz. 2017. “Visions of CSCL: Eight Provocations for the Future of the Field.” International Journal of Computer-Supported Collaborative Learning, December. https://doi.org/10.1007/s11412-017-9267-5.
Yannakakis, G. N., and J. Togelius. 2011. “Experience-Driven Procedural Content Generation.” IEEE Transactions on Affective Computing 2 (3): 147–61. https://doi.org/10.1109/T-AFFC.2011.6.
Yee, Nick. 2006. “The Demographics, Motivations, and Derived Experiences of Users of Massively Multi-User Online Graphical Environments.” Presence: Teleoperators and Virtual Environments 15 (3): 309–29. https://doi.org/10.1162/pres.15.3.309.
Zagal, José P., Staffan Björk, and Chris Lewis. 2013. “Dark Patterns in the Design of Games.” In Foundations of Digital Games 2013.
Zea, Natalia Padilla, José Luís González Sánchez, Francisco L. Gutiérrez, Marcelino J. Cabrera, and Patricia Paderewski. 2009. “Design of Educational Multiplayer Videogames: A Vision from Collaborative Learning.” Advances in Engineering Software, Designing, modelling and implementing interactive systems, 40 (12): 1251–60. https://doi.org/10.1016/j.advengsoft.2009.01.023.
Zohaib, Mohammad. 2018. “Dynamic Difficulty Adjustment (DDA) in Computer Games: A Review.” Advances in Human-Computer Interaction 2018 (November): 1–12. https://doi.org/10.1155/2018/5681652.
No Supplementary Material Available
Title
Game Learning Analytics
Book Title
Handbook of Learning Analytics
Pages
pp. 152-162
Copyright
2022
DOI
10.18608/hla22.015
ISBN
978-0-9952408-3-4
Publisher
Society for Learning Analytics Research
Authors
Emily Reardon
Vishesh Kumar
Glenda Revelle
Editors
Charles Lang
Alyssa Friend Wise
Agathe Merceron
Dragan Gašević
George Siemens