Handbook of Learning Analytics
Chapter 7
Temporal Aspects of Learning Analytics - Grounding Analyses in Concepts of Time
Inge Molenaar & Alyssa Friend Wise
Abstract
This chapter represents an effort to lay out a common framework for the concepts of time to (a) support diverse researchers working on temporal aspects of learning analytics to communicate better, (b) facilitate an understanding of how different approaches to studying time in learning articulate and (c) map out the space of temporal analysis to reduce redundancy of efforts. We distinguish two concepts of time, namely the passage of time and order in time. Passage of time considers time as a continuous flow of events and order in time focuses on the organization among events. Within the passage of time we distinguish four metrics: position, duration, frequency and rate. Within order in time we discriminate between consistency, recurrent and non-recurrent change and irregular change. Metrics extracted to index passage of time can be used in many different statistical methods, whereas analysis of order in time commonly requires the usage of advanced analysis methods. For either, decisions about the level of granularity at which time is considered and segmentation of time into “windows” have important effects on analysis results. We argue that understanding the value of temporal concepts and implications for the related analysis, is foundational for closing the loop and advancing learning analytics design with temporal insights.
Azevedo, Roger, Ronald S. Landis, Reza Feyzi-Behnagh, Melissa Duffy, Gregory Trevors, Jason M. Harley, François Bouchet, et al. 2012. “The Effectiveness of Pedagogical Agents’ Prompting and Feedback in Facilitating Co-Adapted Learning with MetaTutor.” In Intelligent Tutoring Systems, 212–21. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-30950-2_27.
Bannert, Maria, Melanie Hildebrand, and Christoph Mengelkamp. 2009. “Effects of a Metacognitive Support Device in Learning Environments.” Computers in Human Behavior 25 (4): 829–35. https://doi.org/10.1016/j.chb.2008.07.002.
Bannert, Maria, Peter Reimann, and Christoph Sonnenberg. 2013. “Process Mining Techniques for Analysing Patterns and Strategies in Students’ Self-Regulated Learning.” Metacognition and Learning 9 (2): 161–85. https://doi.org/10.1007/s11409-013-9107-6.
Barnes, Douglas. 1992. “The Role of Talk in Learning.” In Thinking Voices: The Work of the National Oracy Project, edited by Kate Norman, 123–28.
Carroll, J. Douglas. 1963. “Functional Learning: The Learning of Continuous Functional Mappings Relating Stimulus and Response Continua.” ETS Research Bulletin Series 1963 (2): i–144. https://doi.org/10.1002/j.2333-8504.1963.tb00958.x.
Casarrubea, M., G.K. Jonsson, F. Faulisi, F. Sorbera, G. Di Giovanni, A. Benigno, G. Crescimanno, and M.S. Magnusson. 2015. “T-Pattern Analysis for the Study of Temporal Structure of Animal and Human Behavior: A Comprehensive Review.” Journal of Neuroscience Methods 239 (January): 34–46. https://doi.org/10.1016/j.jneumeth.2014.09.024.
Chen, Bodong, Simon Knight, and Alyssa Wise. 2018. “Critical Issues in Designing and Implementing Temporal Analytics.” Journal of Learning Analytics 5 (1): 1–9. https://doi.org/10.18608/jla.2018.51.1.
Chiu, Ming Ming, and Lawrence Khoo. 2002. “A New Method for Analyzing Sequential Processes.” Small Group Research 36 (5): 600–631. https://doi.org/10.1177/1046496405279309.
———. 2005. “Effects of Resources, Inequality, and Privilege Bias on Achievement: Country, School, and Student Level Analyses.” American Educational Research Journal 42 (4): 575–603. https://doi.org/10.3102/00028312042004575.
Chiu, Ming Ming, Inge Molenaar, Gaowei Chen, Alyssa Friend Wise, and Nobuko Fujita. n.d. “Micro-Analysis of Collaborative Processes That Facilitate Productive Online Discussions.” In Assessment and Evaluation of Time Factors in Online Teaching and Learning, 232–63. IGI Global. https://doi.org/10.4018/978-1-4666-4651-3.ch009.
Dewey, John. 1938. “Experiential Learning.” New Jersey: Pentice Hall.
Dindar, Muhterem, Iman Alikhani, Jonna Malmberg, Sanna Järvelä, and Tapio Seppänen. 2019. “Examining Shared Monitoring in Collaborative Learning: A Case of a Recurrence Quantification Analysis Approach.” Computers in Human Behavior 100 (November): 335–44. https://doi.org/10.1016/j.chb.2019.03.004.
Engelmann, Katharina, and Maria Bannert. 2021. “Analyzing Temporal Data for Understanding the Learning Process Induced by Metacognitive Prompts.” Learning and Instruction 72 (April): 101205. https://doi.org/10.1016/j.learninstruc.2019.05.002.
Gašević, Dragan, Shane Dawson, and George Siemens. 2014. “Let’s Not Forget: Learning Analytics Are About Learning.” TechTrends 59 (1): 64–71. https://doi.org/10.1007/s11528-014-0822-x.
Graaf, Joep van der. 2020. “Inquiry-Based Learning and Conceptual Change in Balance Beam Understanding.” Frontiers in Psychology 11 (July). https://doi.org/10.3389/fpsyg.2020.01621.
Greller, Wolfgang, and Hendrik Drachsler. 2012. “Translating Learning into Numbers: A Generic Framework for Learning Analytics.” Journal of Educational Technology & Society 15 (3): 42–57.
Gunawardena, Charlotte N., Constance A. Lowe, and Terry Anderson. 1997. “Analysis of a Global Online Debate and the Development of an Interaction Analysis Model for Examining Social Construction of Knowledge in Computer Conferencing.” Journal of Educational Computing Research 17 (4): 397–431. https://doi.org/10.2190/7mqv-x9uj-c7q3-nrag.
Heirweg, Sofie. 2019. “Measuring and Promoting Self-Regulated Learning of Upper-Primary School Students: A Study on the Effectiveness of a School-Wide Teacher Professional Development Program.”
Hesse, Bradford W., Carol M. Werner, and Irwin Altman. 1988. “Temporal Aspects of Computer-Mediated Communication.” Computers in Human Behavior 4 (2): 147–65. https://doi.org/10.1016/0747-5632(88)90023-4.
Hickendorff, Marian, Peter A. Edelsbrunner, Jake McMullen, Michael Schneider, and Kelly Trezise. 2018. “Informative Tools for Characterizing Individual Differences in Learning: Latent Class, Latent Profile, and Latent Transition Analysis.” Learning and Individual Differences 66 (August): 4–15. https://doi.org/10.1016/j.lindif.2017.11.001.
Jacobson, Michael J., Manu Kapur, and Peter Reimann. 2016. “Conceptualizing Debates in Learning and Educational Research: Toward a Complex Systems Conceptual Framework of Learning.” Educational Psychologist 51 (2): 210–18. https://doi.org/10.1080/00461520.2016.1166963.
Jeong, Allan C. 2003. “The Sequential Analysis of Group Interaction and Critical Thinking in Online.” American Journal of Distance Education 17 (1): 25–43. https://doi.org/10.1207/s15389286ajde1701_3.
Kapur, Manu. 2011. “Temporality Matters: Advancing a Method for Analyzing Problem-Solving Processes in a Computer-Supported Collaborative Environment.” International Journal of Computer-Supported Collaborative Learning 6 (1): 39–56. https://doi.org/10.1007/s11412-011-9109-9.
———. 2016. “Examining Productive Failure, Productive Success, Unproductive Failure, and Unproductive Success in Learning.” Educational Psychologist 51 (2): 289–99. https://doi.org/10.1080/00461520.2016.1155457.
Kapur, Manu, and Katerine Bielaczyc. 2012. “Designing for Productive Failure.” Journal of the Learning Sciences 21 (1): 45–83. https://doi.org/10.1080/10508406.2011.591717.
Knight, Simon, Alyssa Friend Wise, and Bodong Chen. 2017. “Time for Change: Why Learning Analytics Needs Temporal Analysis.” Journal of Learning Analytics 4 (3). https://doi.org/10.18608/jla.2017.43.2.
Koedinger, Kenneth R., Julie L. Booth, and David Klahr. 2013. “Instructional Complexity and the Science to Constrain It.” Science (New York, N.Y.) 342 (6161): 935–37. https://doi.org/10.1126/science.1238056.
Kovanović, Vitomir, Srećko Joksimović, Negin Mirriahi, Ellen Blaine, Dragan Gašević, George Siemens, and Shane Dawson. 2018. “Understand Students Self-Reflections Through Learning Analytics.” In Proceedings of the 8th International Conference on Learning Analytics and Knowledge. ACM. https://doi.org/10.1145/3170358.3170374.
Kuvalja, Martina, Mohini Verma, and David Whitebread. 2013. “Patterns of Co-Occurring Non-Verbal Behaviour and Self-Directed Speech a Comparison of Three Methodological Approaches.” Metacognition and Learning 9 (2): 87–111. https://doi.org/10.1007/s11409-013-9106-7.
Lu, Jingyan, Ming Ming Chiu, and Nancy WaiYing Law. 2011. “Collaborative Argumentation and Justifications: A Statistical Discourse Analysis of Online Discussions.” Computers in Human Behavior 27 (2): 946–55.
Matcha, Wannisa, Dragan Gašević, NoraAyu Ahmad Uzir, Jelena Jovanović, and Abelardo Pardo. 2019. “Analytics of Learning Strategies.” In Proceedings of the 9th International Conference on Learning Analytics & Knowledge. ACM. https://doi.org/10.1145/3303772.3303787.
Mercer, Neil. 2008. “The Seeds of Time: Why Classroom Dialogue Needs a Temporal Analysis.” Journal of the Learning Sciences 17 (1): 33–59. https://doi.org/10.1080/10508400701793182.
Molenaar, Inge, Carla A.M. van Boxtel, and Peter J.C. Sleegers. 2010. “The Effects of Scaffolding Metacognitive Activities in Small Groups.” Computers in Human Behavior 26 (6): 1727–38. https://doi.org/10.1016/j.chb.2010.06.022.
Molenaar, Inge, Anne Horvers, Rick Dijkstra, and Ryan S. Baker. 2020. “Personalized Visualizations to Promote Young Learners SRL.” In Proceedings of the Tenth International Conference on Learning Analytics & Knowledge. ACM. https://doi.org/10.1145/3375462.3375465.
Molenaar, Inge, and Sanna Järvelä. 2014. “Sequential and Temporal Characteristics of Self and Socially Regulated Learning.” Metacognition and Learning 9 (2): 75–85. https://doi.org/10.1007/s11409-014-9114-2.
Moos, Daniel C., and Roger Azevedo. 2007. “Exploring the Fluctuation of Motivation and Use of Self-Regulatory Processes During Learning with Hypermedia.” Instructional Science 36 (3): 203–31. https://doi.org/10.1007/s11251-007-9028-3.
Nystrand, Martin, Lawrence L. Wu, Adam Gamoran, Susie Zeiser, and Daniel A. Long. 2003. “Questions in Time: Investigating the Structure and Dynamics of Unfolding Classroom Discourse.” Discourse Processes 35 (2): 135–98. https://doi.org/10.1207/s15326950dp3502_3.
Olthof, Merlijn, Fred Hasselman, Guido Strunk, Marieke van Rooij, Benjamin Aas, Marieke A. Helmich, Günter Schiepek, and Anna Lichtwarck-Aschoff. 2019. “Critical Fluctuations as an Early-Warning Signal for Sudden Gains and Losses in Patients Receiving Psychotherapy for Mood Disorders.” Clinical Psychological Science 8 (1): 25–35. https://doi.org/10.1177/2167702619865969.
Paans, Cindy, Inge Molenaar, Eliane Segers, and Ludo Verhoeven. 2019. “Temporal Variation in Childrens Self-Regulated Hypermedia Learning.” Computers in Human Behavior 96 (July): 246–58. https://doi.org/10.1016/j.chb.2018.04.002.
Paans, Cindy, Erdem Onan, Inge Molenaar, Ludo Verhoeven, and Eliane Segers. 2019. “How Social Challenges Affect Children’s Regulation and Assignment Quality in Hypermedia: A Process Mining Study.” Metacognition and Learning 14 (2): 189–213. https://doi.org/10.1007/s11409-019-09204-9.
Reimann, Peter. 2009. “Time Is Precious: Variable- and Event-Centred Approaches to Process Analysis in CSCL Research.” International Journal of Computer-Supported Collaborative Learning 4 (3): 239–57. https://doi.org/10.1007/s11412-009-9070-z.
Sande, Eva van de, Eliane Segers, and Ludo Verhoeven. 2017. “The Role of Executive Functions for Dyadic Literacy Learning in Kindergarten.” Early Education and Development 29 (2): 192–206. https://doi.org/10.1080/10409289.2017.1393739.
Schegloff, Emanuel A. 2007. “Categories in Action: Person-Reference and Membership Categorization.” Discourse Studies 9 (4): 433–61. https://doi.org/10.1177/1461445607079162.
Schiepek, Günter, and Guido Strunk. 2010. “The Identification of Critical Fluctuations and Phase Transitions in Short Term and Coarse-Grained Time Series—a Method for the Real-Time Monitoring of Human Change Processes.” Biological Cybernetics 102 (3): 197–207. https://doi.org/10.1007/s00422-009-0362-1.
Schmitz, Bernhard, and Bettina S. Wiese. 2006. “New Perspectives for the Evaluation of Training Sessions in Self-Regulated Learning: Time-series Analyses of Diary Data.” Contemporary Educational Psychology 31 (1): 64–96. https://doi.org/10.1016/j.cedpsych.2005.02.002.
Seymour, Philip H. K., and Lynne G. Duncan. 1997. “Small Versus Large Unit Theories of Reading Acquisition.” Dyslexia (Chichester, England) 3 (3): 125–34. https://doi.org/10.1002/(sici)1099-0909(199709)3:3<125::aid-dys85>3.0.co;2-4.
Shaffer, David Williamson, Wesley Collier, and A. R. Ruis. 2016. “A Tutorial on Epistemic Network Analysis: Analyzing the Structure of Connections in Cognitive, Social, and Interaction Data.” Journal of Learning Analytics 3 (3): 9–45. https://doi.org/10.18608/jla.2016.33.3.
Soller, Amy, and Ron Stevens. 2007. “Applications of Stochastic Analyses for Collaborative Learning and Cognitive Assessment.” Alexandria, VA: Institute for Defence Analyses.
Spikol, Daniel, Luis P. Prieto, M. J. Rodríguez-Triana, Marcelo Worsley, Xavier Ochoa, Mutlu Cukurova, Bahtijar Vogel, Emanuele Ruffaldi, and Ulla Lunde Ringtved. 2017. “Current and Future Multimodal Learning Analytics Data Challenges.” In Proceedings of the Seventh International Learning Analytics & Knowledge Conference. ACM. https://doi.org/10.1145/3027385.3029437.
Van Boxtel, Carla. 2004. “Studying Peer Interaction from Three Perspectives.” Dialogic Learning, 125–43.
Wise, Alyssa Friend, and Ming Ming Chiu. 2012. “Statistical Discourse Analysis of a Role-Based Online Discussion Forum: Patterns of Knowledge Construction.” In 2012 45th Hawaii International Conference on System Sciences. IEEE. https://doi.org/10.1109/hicss.2012.546.
Wise, Alyssa Friend, Simone Nicole Hausknecht, and Yuting Zhao. 2014. “Attending to Others’ Posts in Asynchronous Discussions: Learners’ Online ‘Listening’ and Its Relationship to Speaking.” International Journal of Computer-Supported Collaborative Learning 9 (2): 185–209. https://doi.org/10.1007/s11412-014-9192-9.
Wise, Alyssa Friend, Jennifer Speer, Farshid Marbouti, and Ying-Ting Hsiao. 2012. “Broadening the Notion of Participation in Online Discussions: Examining Patterns in Learners’ Online Listening Behaviors.” Instructional Science 41 (2): 323–43. https://doi.org/10.1007/s11251-012-9230-9.
No Supplementary Material Available
Title
Temporal Aspects of Learning Analytics - Grounding Analyses in Concepts of Time
Book Title
Handbook of Learning Analytics
Pages
pp. 66-76
Copyright
2022
DOI
10.18608/hla22.007
ISBN
978-0-9952408-3-4
Publisher
Society for Learning Analytics Research
Authors
Inge Molenaar
Alyssa Friend Wise
Editors
Charles Lang
Alyssa Friend Wise
Agathe Merceron
Dragan Gašević
George Siemens