An Analytical Study of the Report Writing Process in the Classroom
Keywords:
process feedback, writing processes, keystroke logging, self-assessment, writing from sources”Abstract
Keystroke loggers provide researchers with assistance in the interpretation of the information they acquire as well as in the process of acquiring information on processes at a more granular level of detail. In addition, keystroke loggers allow researchers to analyze the collected data. We are coming closer to a more comprehensive comprehension of the facts crucial to the writing process as the field of writing studies has witnessed an increase in popularity for documenting each keystroke that is pushed. On the other hand, the most effective methods of implementing keystroke monitoring in educational settings have not garnered significant research attention. It is not that they do not see the potential benefits of taking a more process-oriented approach to writing development; rather, they find it challenging to "translate" massive and complicated data sets into an educational setting. Because of this, we were inspired to add a brand-new feature to Inputlog to make it easier for writing instructors to give process feedback to students enrolled in their programs. The so-called "report" feature, based on an XML-logfile, generates a pdf file containing information on various writing-related topics, such as pausing, editing, utilizing sources, and fluency. The file may be downloaded and viewed on a computer. In addition, this document may be downloaded to your computer, tablet, or smartphone and viewed using any device. The report contains illustrations or illustrations that creatively depict these points of view. The content is divided into shorter and simpler sections, each focusing on a different facet of the discussed overarching issue. Users can modify the Inputlog feedback report in any way they see fit, even though it is generated automatically. This article provides a description of the process report and an illustration of how it may be used in an intervention. We also give some extra educational settings that may be used in writing workshops so that participants can get the most out of the feedback. This is done so that participants can benefit as much as possible from the provided feedback.
Downloads
References
Aben, J., Van den Broek, B., Vandermeulen, N., Van Steendam, E., & Rijlaarsdam, G. (2017). Feedback op de schrijfaanpak. De ontwikkeling van een zchrijfprocesgericht feedbackrapport voor vwo-leerlingen. Levende Talen Tijdschrift, 18(4), 3–14.
Baaijen, V. M., & Galbraith, D. (2018). Discovery Through Writing: Relationships with Writing Processes and Text Quality. Cognition and Instruction, 36(3), 1–25. https://doi.org/ 10.1080/07370008.2018.1456431
Baaijen, V. M., Galbraith, D., & de Glopper, K. (2014). Effects of writing beliefs and planning on writing performance. Learning and Instruction, 33, 81–91. https://doi.org/ 10.1016/j.learninstruc.2014.04.001
Bandura, A. (2016). The power of observational learning through social modeling. In R. J. Sternberg, S. T. Fiske, & D. J. Foss (Eds.), Scientists Making a Difference (pp. 235–239). Cambridge University Press. https://doi.org/ 10.1017/CBO9781316422250.052
Barkaoui, K. (2016). What and When Second-Language Learners Revise When Responding to Timed Writing Tasks on the Computer: The Roles of Task Type, Second Language Proficiency, and Keyboarding Skills. The Modern Language Journal, 100(1). https://doi.org/ 10.1111/modl.12316
Beers, S. F., Mickail, T., Abbott, R., & Berninger, V. (2017). Effects of transcription ability and transcription mode on translation: Evidence from written compositions, language bursts and pauses when students in grades 4 to 9, with and without persisting dyslexia or dysgraphia, compose by pen or by keyboard. Journal of Writing Research, 9(1), 1–25. https://doi.org/ 10.17239/jowr-2017.09.01.01
Bejar, I. I., Mislevy, R. J., & Zhang, M. (2016). Automated Scoring with Validity in Mind. In A. Rupp & J. Leighton (Eds.), The Handbook of Cognition and Assessment (p. 648). John Wiley & Sons. https://doi.org/ 10.1002/9781118956588.ch10
Benetos, K., & Bétrancourt, M. (2020). Digital authoring support for argumentative writing: What does it change? Journal of Writing Research 12(1), 263- 290. https://doi.org /10.17239/jowr-2020.12.01.09
Berger, C. L., & Lewandowski, L. (2013). The effect of a word processor as an accommodation for students with learning disabilities. Journal of Writing Research, 4(3), 261–280.https://doi.org/https://doi.org/ 10.17239/jowr-2013.04.03.2
Blok, H. (1986). Essay Rating by the Comparison Method. Tijdschrift Voor Onderwijsresearch, 11(4), 169–176.
Bouwer, R., Koster, M., & Van den Bergh, H. (2018). Effects of a strategy-focused instructional program on the writing quality of upper elementary students in the Netherlands. Journal of Educational Psychology, 110(1), 58–71. https://doi.org/ 10.1037/edu0000206
Braaksma, M. A. H., Rijlaarsdam, G., & Van den Bergh, H. (2002). Observational learning and the effects of model-observer similarity. Journal of Educational Psychology, 94(2), 405–415. https://doi.org/ 10.1037//0022-0663.94.2.405
Breetvelt, I., Van den Bergh, H., & Rijlaarsdam, G. (1994). Relations between writing processes and text quality: when and how? Cognition and Instruction, 12(2), 103–123. https://doi.org/ 10.1207/s1532690xci1202_2
Breetvelt, I., Van den Bergh, H., & Rijlaarsdam, G. (1996). Rereading and generating and their relation to text quality. An application of multilevel analysis on writing process data. In G. Rijlaarsdam, H. Van den Bergh, & M. Couzijn (Eds.), Theories, models and methodology in writing research (pp. 10–20). Amsterdam: Amsterdam University Press. https://doi.org/https://doi.org/ 10.5117/9789053561973
Butler, D. L., & Winne, P. H. (1995). Feedback and Self-Regulated Learning: A Theoretical Synthesis. Review of Educational Research, 65(3), 245–281. https://doi.org/ 10.3102/ 00346543065003245
Carless, D., & Boud, D. (2018). The development of student feedback literacy: enabling uptake of feedback. Assessment and Evaluation in Higher Education, 43(8), 1315–1325. https://doi.org/ 10.1080/02602938.2018.1463354
Chukharev-Hudilainen, E. (2019). Empowering automated writing evaluation with keystroke logging. In E. Lindgren & K. P. H. Sullivan (Eds.), Observing Writing: Insights from keystroke logging and handwriting (pp. 125–142). Leiden: Brill. https://doi.org/https://doi.org/ 10.1163/9789004392526
Chukharev-Hudilainen, E., Saricaoglu, A., Torrance, M., & Feng, H. H. (2019). Combined deployable keystroke logging and eyetracking for investigating L2 writing fluency. Studies in Second Language Acquisition, 41, 583–604. https://doi.org/https://doi.org/ 10.1017/S027226311900007X
Conijn, R. (2020). The Keys to Writing: A writing analytics approach to studying writing processes using keystroke logging. (Doctoral dissertation). Tilburg University/ University of Antwerp.
Conijn, R., Cook, C. L., Van Zaanen, M., & Van Waes, L. (2020). Early prediction of writing quality using keystroke logging. Submitted.
Conijn, R., Roeser, J., & Van Zaanen, M. (2019). Understanding the Keystroke Log: The Effect of Writing Task on Keystroke Features. Reading and Writing, 32, 2353–2374. https://doi.org/https://doi.org/ 10.1007/s11145-019-09953-8
Conijn, R., Van Waes, L., & Van Zaanen, M. (2020). Human-centered design of a dashboard on students’ revisions during writing. Under Review.
Cotos, E., Huffman, S., & Link, S. (2020). Understanding graduate writers’ interaction with and impact of the Research Writing Tutor during revision. Journal of Writing Research 12(1), 187-232. https://doi.org/ 10.17239/jowr-2020.12.01.07
De Smet, M. J. R., Brand-Gruwel, S., Leijten, M., & Kirschner, P. A. (2014). Electronic outlining as a writing strategy: Effects on students’ writing products, mental effort and writing process. Computers and Education, 78, 352–366. https://doi.org/ 10.1016/j.compedu. 2014.06.010
Deane, P., & Zhang, M. (2015). Exploring the Feasibility of Using Writing Process Features to Assess Text Production Skills. ETS Research Report Series. https://doi.org/ 10.1002/ets2.12071
Ertmer, P. A., Ottenbreit-Leftwich, A. T., Sadik, O., Sendurur, E., & Sendurur, P. (2012). Teacher beliefs and technology integration practices: A critical relationship. Computers and Education, 59(2), 423–435. https://doi.org/ 10.1016/j.compedu.2012.02.001
Fidalgo, R., Torrance, M., Rijlaarsdam, G., Van den Bergh, H., & Álvarez, M. L. (2015). Strategy- focused writing instruction: Just observing and reflecting on a model benefits 6th grade students. Contemporary Educational Psychology, 41, 37–50. https://doi.org/ 10.1016/ j.cedpsych.2014.11.004
Galbraith, D., & Baaijen, V. M. (2019). Aligning Keystrokes with Cognitive Processes in Writing. In E. Lingren & K. Sullivan (Eds.), Observing Writing. Insights from keystroke logging and handwriting (pp. 306–325). Brill. https://doi.org/ 10.1163/9789004392526_015
