Handbook of Learning Analytics
Chapter 19
Data Literacy and Learning Analytics
Ellen B. Mandinach & Lisa M. Abrams
Abstract
Data use, whether through traditional methods in education or more sophisticated techniques such as learning analytics and educational data mining, has emerged as an important part of educational practice. Foundational to the use of data is data literacy; that is, educators’ ability to use data effectively and responsibly. A construct called data literacy for teachers has been operationalized and differs from assessment literacy to include the many diverse sources of data that educators now encounter. However, an issue, even with traditional data use is the extent to which educators have sufficient data literacy. The introduction of learning analytics presents the need for even more sophisticated data use capacity that may or may not be practical in most K-12 educational settings. This chapter explores the intersection of data literacy and learning analytics, and in doing so draws parallels between data use in the K-12 and post-secondary education settings, where data-driven decision making and learning analytics have traditionally been positioned. It provides a review of data literacy and the technologies that support data use. It discusses the practical challenges and constraints to transforming more traditional data use to include learning analytic strategies and how data literacy applies. The chapter then looks toward the opportunities and possibilities made possible by the sophisticated data use in learning analytics.
Abrams, Lisa M., and Tameshia V. Grimes. 2017. “Role of Research Methods Courses in Bridging Research and Practice.pdf.” In Leadership: Learning, Teaching and Practice, edited by Autumn T. Cypres, 71–87. Charlotte, NC: Information Age Publishing.
Abrams, Lisa, Divya Varier, and Lisa Jackson. 2016. “Unpacking Instructional Alignment: The Influence of Teachers’ Use of Assessment Data on Instruction.” Perspectives in Education 34 (4): 15–28. https://doi.org/10.18820/2519593X/pie.v34i4.2.
Agasisti, Tommaso, and Alex J. Bowers. 2017. “Data Analytics and Decision Making in Education: Towards the Educational Data Scientist as a Key Actor in Schools and Higher Education Institutions.” In Handbook of Contemporary Education Economics, 184–210. https://doi.org/10.4337/9781785369070.00014.
Arnold, Kimberly E., and Matthew D. Pistilli. 2012. “Course Signals at Purdue: Using Learning Analytics to Increase Student Success.” ACM International Conference Proceeding Series, no. May: 267–70. https://doi.org/10.1145/2330601.2330666.
Beck, Jori S., and Diana Nunnaley. 2020. “A Continuum of Data Literacy for Teaching.” Studies in Educational Evaluation, 100871.
Bowers, Alex J. 2017. “Quantitative Research Methods Training in Education Leadership and Administration Preparation Programs as Disciplined Inquiry for Building School Improvement Capacity.” Journal of Research on Leadership Education 12 (1): 72–96. https://doi.org/10.1177/1942775116659462.
Bowers, Alex J, April Bang, Yilin Pan, and Kenneth E. Graves. 2019. “Education Leadership Data Analytics ( ELDA ): A White Paper Report on the 2018 ELDA Summit Authors :” 1–14.
Bowers, Alex J., Andrew E. Krumm, and Timothy Podkul. 2016. “Building a Data Analytics Partnership to Inform School Leadership Evidence-Based Improvement Cycles.” In Annual Meeting of the American Educational Research Association, Washington, Dc.
Campaign, Data Quality. 2017. “Making Data Work for Personalized Learning: Lessons Learned.” Washington, DC. https://doi.org/10.1787/g2572a5943-en.
Cho, Vincent, and Jeffrey C. Wayman. 2014. “Districts’ Efforts for Data Use and Computer Data Systems: The Role of Sensemaking in System Use and Implementation.” Teachers College Record 116 (2).
Daniel, Ben. 2017. “Contemporary Research Discource and Issues on Big Data in Higher Education.” Educational Technology 57 (1): 18–22. https://doi.org/10.1016/S1096-7516.
Datnow, Amanda, and Vicki Park. 2018. “Opening or Closing Doors for Students? Equity and Data Use in Schools.” Journal of Educational Change 19 (2): 131–52. https://doi.org/10.1007/s10833-018-9323-6.
Education Statistics, National Forum on. 2018. “Forum Guide to Early Warning Systems.” Washington, DC.
———. 2019. “Forum Guide to Personalized Learning.” Washington, DC. https://doi.org/10.21608/deu.2018.49236.
Farley-Ripple, Elizabeth, and Joan Buttram. 2015. “The Development of Capacity for Data Use : The Role of Teacher Networks in an Elementary School.” Teachers College Record 117 (4). https://doi.org/10.1007/s13398-014-0173-7.2.
Farley-Ripple, Elizabeth N., Austin S. Jennings, and Joan Buttram. 2019. “Toward a Framework for Classifying Teachers’ Use of Assessment Data.” AERA Open 5 (4): 1–18. https://doi.org/10.1177/2332858419883571.
Gummer, Edith S., and Ellen B. Mandinach. 2015. “Building a Conceptual Framework for Data Literacy.” Teachers College Record 117 (4): 1–22.
Hamilton, Laura, Richardson Halverson, Sharnell S. Jackson, Ellen Mandinach, Jonathan A. Supovitz, and Jeffrey C Wayman. 2009. “Using Student Achievement Data to Support Instructional Decision Making. IES Practice Guide. NCES 2009-4067.” National Center for Education Evaluation and Regional Assistance. http://search.ebscohost.com/login.aspx?direct=true&db=eric&AN=ED506645&site=ehost-live.
Ifenthaler, Dirk. 2015. “Learning Analytics: Benefits and Challenges for Higher Education.” https://councilcommunity.org/2015/05/23/learning-analytics-benefits-and-challenges-for-higher-education/.
Jimerson, Jo Beth, Vanessa Garry, Cindy L. Poortman, and Kim Schildkamp. 2019. “Implementing a Data Use Intervention in a United States Context: Enabling and Contraining Factors.” In American Educational Research Association. Toronto, Canada.
———. 2020. “Implementation of a Collaborative Data Use Model in a United States Context.” Studies in Educational Evaluation, 100866.
Lai, Mei K., and Stuart McNaughton. 2016. “The Impact of Data Use Professional Development on Student Achievement.” Teaching and Teacher Education 60: 434–43. https://doi.org/10.1016/j.tate.2016.07.005.
Leitner, Philipp, Markus Ebner, and Martin Ebner. 2019. “Learning Analytics Challenges to Overcome in Higher Education Institutions.” In Utilizing Learning Analytics to Support Study Success, edited by Dirk Ifenthaler, D.K. Mah, and J.K. Yau, 91–104. Springer International Publishing. https://doi.org/10.1007/978-3-319-64792-0.
Macfadyen, Leah. 2017. “Overcoming Barriers to Educational Analytics: How Systems Thinking and Pragmatism Can Help.” Educational Technology: The Magazine for Managers of Change in Education 57 (1): 31–39.
Macfadyen, Leah P., Shane Dawson, Abelardo Pardo, and Dragan Gaševic. 2014. “Embracing Big Data in Complex Educational Systems: The Learning Analytics Imperative and the Policy Challenge.” Research & Practice in Assessment 9: 17–28.
Mandinach, Ellen B. 2012. “A Perfect Time for Data Use: Using Data-Driven Decision Making to Inform Practice.” Educational Psychologist 47 (2): 71–85. https://doi.org/10.1080/00461520.2012.667064.
Mandinach, Ellen B., Jeremy M. Friedman, and Edith S. Gummer. 2015. “How Can Schools of Education Help to Build Educators ’ Capacity to Use Data ? A Systemic View of the Issue.” Teachers College Recordrs 117 (4): 1–50.
Mandinach, Ellen B., and Edith S. Gummer. 2013. “A Systemic View of Implementing Data Literacy in Educator Preparation.” Educational Researcher 42 (1): 30–37. https://doi.org/10.3102/0013189X12459803.
———. 2016a. Data Literacy for Educators: Making It Count in Teacher Preparation and Practice. New York, NY: Teachers College Press.
———. 2016b. “What Does It Mean for Teachers to Be Data Literate: Laying Out the Skills, Knowledge, and Dispositions.” Teaching and Teacher Education 60: 366–76. https://doi.org/10.1016/j.tate.2016.07.011.
Mandinach, Ellen B., Margaret Honey, Daniel Light, and Cornelia Brunner. 2008. “A Conceptual Framework for Data-Driven Decision Making.” In Data-Driven for School Improvement" Linking Data and Learning, edited by Ellen B. Mandinach and Margaret Honey, 13–31. New York, NY: Teachers College Press.
Mandinach, Ellen B., and Sharnell S. Jackson. 2012. Transforming Teaching and Learning Through Data-Driven Decision Making. Thousand Oaks, CA: Corwin Press.
Mandinach, Ellen B., and Jo Beth Jimerson. 2016. “Teachers Learning How to Use Data: A Synthesis of the Issues and What Is Known.” Teaching and Teacher Education 60: 452–57. https://doi.org/10.1016/j.tate.2016.07.009.
Mandinach, Ellen B., and Ryan C. Miskell. 2018. “Blended Learning and Data Use in Three Technology-Infused Charter Schools.” LEARNing Landscapes 11 (1): 183–98.
Mandinach, Ellen B., and D. Nunnaley. 2017. “Practitioner Data Literacy: Modules for Teacher Education.” Washington, DC.
Marsh, Julie A. 2012. “Interventions Promoting Educators’ Use of Data: Research Insights and Gaps.” Teachers College Record, 1–48.
Means, Barbara, Christine Padilla, and Lawrence P. Gallagher. 2010. “Use of Education Data at the Local Level: From Accountability to Instructional Improvement.” US Department of Education, 158–58. http://eric.ed.gov/?id=ED511656.
Oláh, Leslie Nabors, Nancy R. Lawrence, and Matthew Riggan. 2010. “Learning to Learn from Benchmark Assessment Data: How Teachers Analyze Results.” Peabody Journal of Education 85 (2): 226–45. https://doi.org/10.1080/01619561003688688.
Pane, John F., Elizabeth D. Steiner, Matthew D. Baird, and Laura S. Hamilton. 2015. “Continued Progress: Promising Evidence on Personalized Learning.” Santa Monica, California. https://doi.org/10.7249/RR1365.
Park, Vicki, Alan J. Daly, and Alison Wishard Guerra. 2013. “Strategic Framing: How Leaders Craft the Meaning of Data Use for Equity and Learning.” Educational Policy 27 (4): 645–75. https://doi.org/10.1177/0895904811429295.
Piety, Philip J. 2019. “Components, Infrastructures, and Capacity: The Quest for the Impact of Actionable Data Use on P–20 Educator Practice.” Review of Research in Education 43 (1): 394–421. https://doi.org/10.3102/0091732X18821116.
Schildkamp, Kim, and Cindy L. Poortman. 2015. “Factors Influencing the Function of Data Teams.” Teacher College Record 117 (5): 1–31.
Sclater, Niall, Alice Peasgood, and Joel Mullan. 2016. “Learning Analytics in Higher Education.” JISC 8 (2017): 176.
Shepard, Lorrie A., Kristen L. Davidson, and Richard Bowman. 2011. “How Middle School Mathematics Teachers Use Interim and Benchmark Assessment Data.” Santa Monica, California. https://www.rand.org/pubs/research_reports/RR1365.html.
Shulman, Lee S. 1986. “Those Who Understand: Knowledge Growth in Teaching.” Educational Researcher 15 (2): 4–14. https://doi.org/10.30827/profesorado.v23i3.11230.
———. 1987. “Knowledge and Teaching: Foundations of the New Reform.” Harvard Educational Review 57 (1): 1–23. https://doi.org/10.17763/haer.57.1.j463w79r56455411.
Wang, Yinying. 2020. “When Artificial Intelligence Meets Educational Leaders’ Data-Informed Decision-Making: A Cautionary Tale.” Studies in Educational Evaluation, 100872.
Wayman, Jeffrey C. 2005. “Involving Teachers in Data- Driven Decision Making : Using Computer Data Systems to Support Teacher Inquiry and Reflection.” Journal of Education for Students Placed at Risk (JESPAR) 10 (February 2015): 295–308. https://doi.org/10.1207/s15327671espr1003.
———. 2007. “Student Data Systems for School Improvement: The State of the Field.” In TCEA in Educational Technology Symposium: Vol. 1, 156–62. Lancaster, PA: ProActive Publications.
Wayman, Jeffrey C., Vincent Cho, and M. Richards. 2010. “Student Data Systems and Their Use for Educational Improvement.” In The International Encyclopedia of Education, edited by B. McGaw, P. Peterson, and E. Baker, Vol 8, 14–20. London: Elsevier Inc.
Wayman, Jeffrey C., and Jo Beth Jimerson. 2014. “Teacher Needs for Data-Related Professional Learning.” Studies in Educational Evaluation 42: 25–34. https://doi.org/10.1016/j.stueduc.2013.11.001.
Wayman, Jeffrey C., Shana Shaw, and Vincent Cho. 2017. “Longitudinal Effects of Teacher Use of a Computer Data System on Student Achievement.” AERA Open 3 (1): 233285841668553–3. https://doi.org/10.1177/2332858416685534.
Wayman, Jeffrey C., Sam Stringfield, and Mary Yakimowski. 2004. “Software Enabling School Improvement Through Analysis of Student Data.” Center for Research on the Education of Students Placed at Risk. CRESPAR/Johns Hopkins University. Baltimore, MD. Retrieved August. http://www.csos.jhu.edu/crespar/techreports/report67.pdf.
No Supplementary Material Available
Title
Data Literacy and Learning Analytics
Book Title
Handbook of Learning Analytics
Pages
pp. 196-204
Copyright
2022
DOI
10.18608/hla22.019
ISBN
978-0-9952408-3-4
Publisher
Society for Learning Analytics Research
Authors
Ellen B. Mandinach
Lisa M. Abrams
Editors
Charles Lang
Alyssa Friend Wise
Agathe Merceron
Dragan Gašević
George Siemens