Development and Validation of Digital Writing Scale for Preservice Teachers

The purpose of this study was to develop and validate a Digital Writing Scale that measures the perspectives of individuals on digital writing. A total of 615 preservice teachers studying in the faculty of education at a state university in Turkey participated in the study (n = 615). The data were collected in two phases for exploratory factor analysis and confirmatory factor analysis. Threehundred pre-service teachers participated in the first phase and 315 in the second phase of the study. In the analyses of the data obtained in the first phase, the exploratory factor analysis employed principal axis factoring technique with direct oblimin rotation and a two-factor model, both of which consists of 7 items, was obtained. The Cronbach’s α coefficients were 0.851 for digital translating factor and 0.852 for digital reviewing factor. In the second phase, confirmatory factor analysis with maximum likelihood estimation demonstrated a statistically significant model fit to the data with five indices indicating a good fit and one indicating a substantial fit. The study, which endorsed the Hayes and Flower model and cognitive process theory of writing, resulted in a valid and reliable Digital Writing Scale. Digital Writing Scale is the first Turkish scale that measures the perspectives of individuals on digital writing. Factor scores did not differ according to sex or department of the respondents

Dijital Yazma Ölçeğinin Geliştirilmesi ve Geçerliliğinin Sınanması

Bu çalışmanın amacı, bireylerin dijital yazmaya yönelik perspektiflerini ölçen Dijital Yazma Ölçeği’ni geliştirmek ve geçerliliğini sınamaktır. Çalışmaya Türkiye’deki bir devlet üniversitesinin eğitim fakültesinde öğrenim gören 615 öğretmen adayı katılmıştır (n=615). Veriler, açımlayıcı etken çözümlemesi ve doğrulayıcı etken çözümlemesi için iki aşamada toplanmıştır. Çalışmanın birinci aşamasına 300, ikinci aşamasına ise 315 öğretmen adayı katılmıştır. Birinci aşamada elde edilen verilerin çözümlenmesinde, açımlayıcı etken çözümlemesi için doğrudan enküçültücü eğik (direct oblimin) döndürmeli temel eksen etken çıkarım yöntemi kullanılmış ve her ikisi de 7 öğeden oluşan iki etkenli bir model elde edilmiştir. Cronbach’s α katsayısı dijital dönüştürme etkeni için 0.851, dijital gözden geçirme etkeni için ise 0.852 olarak hesaplanmıştır. İkinci aşamada, en büyük olabilirlik kestirimi ile gerçekleştirilen doğrulayıcı etken çözümlemesi, beşinin iyi uyumu birinin de güçlü uyumu gösterdiği beş endeks ile verilere istatistiksel olarak anlamlı biçimde uyumlu bir modeli göstermiştir. Hayes ve Flower modeli ile yazmayla ilgili bilişsel süreç kuramını temel alan bu çalışma, geçerli ve güvenilir bir Dijital Yazma Ölçeği ile sonuçlanmıştır. Dijital Yazma Ölçeği, bireylerin dijital yazmaya yönelik perspektiflerini ölçen ilk Türkçe ölçektir. Etken puanları katılımcının cinsiyetine ya da bölümlerine göre farklılık göstermemiştir.

___

AbuSeileek, A. F. (2006). The use of word processor for teaching writing to EFL learners in King Saud University. Journal of King Saud University, 19(2), 1-15. Retrieved November 16, 2019, from https://jes.ksu.edu.sa/en/node/5260

Adair-Hauck, B., Willingham-McLain, L., & Youngs, B. E. (2000). Evaluating the integration of technology and second language learning. CALICO journal, 17(2), 269-306. Retrieved November 16, 2019, from https://www.jstor.org/stable/24152630

Alamargot, D., & Chanquoy, L. (2001). Through the models of writing. Dordrecht: Kluwer Academic.

Alshumaimeri, Y. (2011). The effects of wikis on foreign language students writing performance. Procedia - Social and Behavioral Sciences, 28, 755-763. https://doi.org/10.1016/j.sbspro.2011.11.139

American Psychological Association. (2002). Ethical principles of psychologists and code of conduct. American Psychologist, 57(12), 1060-1073. https://doi.org/10.1037/0003- 066X.57.12.1060

Avgerou, E., & Vlachos, K. (2016). The blog as an innovative tool for the development of the writing skill in the Greek EFL class. Research Papers in Language Teaching and Learning, 7(1), 212-232.

Aytan, T. (2017). Evaluation of electronic writing experiences of Turkish teacher candidates at WATTPAD environment. Higher Education Studies, 7(4), 1-8. http://doi.org/10.5539/hes.v7n4p1

Bailie, R. A., & Huset, J. (2015). The effect of CMS technology on writing styles and processes: Two case studies. IEEE Transactions on Professional Communication, 58(3), 309-327. https://doi.org/10.1109/TPC.2016.2516642

Barker, P. (2005). Teaching and assessing electronic writing skills. Information and Communication Technology. Retrieved November 16, 2019, from http://hdl.handle.net/10797/14608

Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238-246. https://doi.org/10.1037/0033-2909.107.2.238

Bentler, P. M. (1995). EQS structural equations program manual. Encino: Multivariate Software.

Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588−606. https://doi.org/10.1037/0033-2909.88.3.588

Bergman, C. A. (1984). Writing Across the Curriculum: students as scholars, scholars as students. Journal of Advanced Composition, 5(1984), 79-86. Retrieved from https://www.jstor.org/stable/20865562

Bernhardt, S. A., Edwards, P., & Wojahn, P. (1989). Teaching college composition with computers: A program evaluation study. Written Communication, 6(1), 108-133. https://doi.org/10.1177/0741088389006001007

Bolter, J. D. (1996a). Virtual reality and the redefinition of self. In L. Strate, R. Jacobson, & S. B. Gibson (Eds.), Communication and cyberspace: Social interaction in an electronic environment (pp. 105-120). Cresskill: Hampton Press.

Bolter, J. D. (1996b). Ekphrasis, virtual reality, and the future of writing. In G. Nunberg (Ed.), The future of the book (pp. 253-272). Berkeley: University of California Press.

Boltz, W. G. (1999). Language and writing. In M. Loewe & E. Shaughnessy (Authors), The Cambridge history of ancient China: From the origins of civilization to 221 BC (pp. 74-123). Cambridge: Cambridge University Press. https://doi.org/10.1017/CHOL9780521470308.004

Bruce, B. C. (1997). Critical issues literacy technologies: What stance should we take? Journal of literacy Research, 29(2), 289-309. https://doi.org/10.1080/10862969709547959

Buckingham, D. (2008). Introducing identity. In D. Buckingham (Ed.), Youth, identity, and digital media (pp. 1–24). Cambridge, MA, USA: The M.I.T. Press. https://doi.org/10.1162/dmal.9780262524834.001

Cheung, Y. L. (2016). A comparative study of paper-and-pen versus computer-delivered assessment modes on students’ writing quality: A Singapore study. The Asia-Pacific Education Researcher, 25(1), 23-33. https://doi.org/10.1007/s40299-015-0229-2

Choo, Y. B., & Li, K. L. (2017). Digital writing in English language writing instruction. ARIEL-An International Research Journal of English Language and Literature, 28, 1-16. Retrieved from http://sujo.usindh.edu.pk/index.php/ARIEL/article/view/19

Churchill Jr, G. A. (1979). A paradigm for developing better measures of marketing constructs. Journal of Marketing Research, 16(1), 64-73. https://doi.org/10.1177/002224377901600110

Coulmas, F. (2003). Writing systems: An introduction to their linguistic analysis. Cambridge: Cambridge University Press. Cunningham, K. (2000). Integrating CALL into the writing curriculum. The Internet TESL Journal, 6(5), 9-22. Retrieved November 16, 2019, from http://iteslj.org/Articles/Cunningham-CALLWriting/ Dahlström, H. (2019). Digital writing tools from the student perspective. Education and Information Technologies, 24(2), 1563-1581.https://doi.org/10.1007/s10639-018-9844- x Daiute, C. (1983). The computer as stylus and audience. College Composition and Communication, 34(2), 134-145. https://doi.org/10.2307/357400 Daiute, C. (1985). Do writers talk to themselves? In S. Freedman (Ed.), The acquisition of written language: Response and revision (pp. 133-139). Norwood: Ablex. Dalton, D. W., & Hannafin, M. J. (1987). The effects of word processing on written composition. The Journal of Educational Research, 80(6), 338-342. https://doi.org/10.1080/00220671.1987.10885779 Daniels, P. T. (1996). Grammatology. In P. T. Daniels & W. Bright (Eds.), The world's writing systems (pp. 1-18). Oxford: Oxford University Press. De Saussure, F. (2011). Grundfragen der allgemeinen Sprachwissenschaft. Berlin: Walter de Gruyter. Demir, T. (2013). Study of the relationship between the creative writing skills of primary school students and their self-efficacy perception. Uluslararası Türkçe Edebiyat Kültür Eğitim (TEKE) Dergisi, 2(1), 84-114. DeVellis, R. F. (2017). Scale development: Theory and applications (4th ed.). Los Angeles: Sage. DeVoss, D. N., Eidman-Aadahl, E., & Hicks, T. (2010). Because digital writing matters: Improving student writing in online and multimedia environments. San Francisco: JosseyBass. Duwila, S. A., & Khusaini, T. (2019). Pedagogical strategy of writing paragraph using Edmodo to enhance writing skill for EFL students. Journal of English Language Teaching and Islamic Integration (JELTII), 2(2), 155-167. Retrieved from http://ejournal.hikmahuniversity.ac.id/index.php/jeltii/article/view/181 Edison, S. W., & Geissler, G. L. (2003). Measuring attitudes towards general technology: Antecedents, hypotheses and scale development. Journal of Targeting, Measurement and Analysis for Marketing, 12(2), 137-156. https://doi.org/10.1057/palgrave.jt.5740104 Emig, J. (1971). The composing processes of twelfth graders. Urbana: NCTE. Eriksson, J., & Giacomello, G. (2006). The information revolution, security, and international relations: (IR)relevant theory? International Political Science Review, 27(3), 221-244. https://doi.org/10.1177/0192512106064462 Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272 Ferris, S. P. (2002). Writing electronically: The effects of computers on traditional writing. Journal of Electronic Publishing, 8(1). https://doi.org/10.3998/3336451.0008.104 Field, A. (2018). Discovering statistics using IBM SPSS Statistics (5th ed.). London: Sage. Flower, L., & Hayes, J. R. (1980). The cognition of discovery: Defining a rhetorical problem. College Composition and Communication, 31(1), 21-32. https://doi.org/10.2307/356630 Flower, L., & Hayes, J. R. (1981). A cognitive process theory of writing. College Composition and Communication, 32(4), 365-387. https://doi.org/10.2307/356600Coulmas, F. (2003). Writing systems: An introduction to their linguistic analysis. Cambridge: Cambridge University Press. Cunningham, K. (2000). Integrating CALL into the writing curriculum. The Internet TESL Journal, 6(5), 9-22. Retrieved November 16, 2019, from http://iteslj.org/Articles/Cunningham-CALLWriting/ Dahlström, H. (2019). Digital writing tools from the student perspective. Education and Information Technologies, 24(2), 1563-1581.https://doi.org/10.1007/s10639-018-9844- x Daiute, C. (1983). The computer as stylus and audience. College Composition and Communication, 34(2), 134-145. https://doi.org/10.2307/357400 Daiute, C. (1985). Do writers talk to themselves? In S. Freedman (Ed.), The acquisition of written language: Response and revision (pp. 133-139). Norwood: Ablex. Dalton, D. W., & Hannafin, M. J. (1987). The effects of word processing on written composition. The Journal of Educational Research, 80(6), 338-342. https://doi.org/10.1080/00220671.1987.10885779 Daniels, P. T. (1996). Grammatology. In P. T. Daniels & W. Bright (Eds.), The world's writing systems (pp. 1-18). Oxford: Oxford University Press. De Saussure, F. (2011). Grundfragen der allgemeinen Sprachwissenschaft. Berlin: Walter de Gruyter. Demir, T. (2013). Study of the relationship between the creative writing skills of primary school students and their self-efficacy perception. Uluslararası Türkçe Edebiyat Kültür Eğitim (TEKE) Dergisi, 2(1), 84-114. DeVellis, R. F. (2017). Scale development: Theory and applications (4th ed.). Los Angeles: Sage. DeVoss, D. N., Eidman-Aadahl, E., & Hicks, T. (2010). Because digital writing matters: Improving student writing in online and multimedia environments. San Francisco: JosseyBass. Duwila, S. A., & Khusaini, T. (2019). Pedagogical strategy of writing paragraph using Edmodo to enhance writing skill for EFL students. Journal of English Language Teaching and Islamic Integration (JELTII), 2(2), 155-167. Retrieved from http://ejournal.hikmahuniversity.ac.id/index.php/jeltii/article/view/181 Edison, S. W., & Geissler, G. L. (2003). Measuring attitudes towards general technology: Antecedents, hypotheses and scale development. Journal of Targeting, Measurement and Analysis for Marketing, 12(2), 137-156. https://doi.org/10.1057/palgrave.jt.5740104 Emig, J. (1971). The composing processes of twelfth graders. Urbana: NCTE. Eriksson, J., & Giacomello, G. (2006). The information revolution, security, and international relations: (IR)relevant theory? International Political Science Review, 27(3), 221-244. https://doi.org/10.1177/0192512106064462 Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272 Ferris, S. P. (2002). Writing electronically: The effects of computers on traditional writing. Journal of Electronic Publishing, 8(1). https://doi.org/10.3998/3336451.0008.104 Field, A. (2018). Discovering statistics using IBM SPSS Statistics (5th ed.). London: Sage. Flower, L., & Hayes, J. R. (1980). The cognition of discovery: Defining a rhetorical problem. College Composition and Communication, 31(1), 21-32. https://doi.org/10.2307/356630 Flower, L., & Hayes, J. R. (1981). A cognitive process theory of writing. College Composition and Communication, 32(4), 365-387. https://doi.org/10.2307/356600

Galbraith, D. (2009a). Cognitive models of writing. German as a Foreign Language, 2(3), 7-22. Retrieved November 16, 2019, from http://www.gfl-journal.de/Issue_2_2009.php Galbraith, D. (2009b). Writing about what we know: Generating ideas in writing. In R. Beard, D. Myhill, J. Riley, & M. Nystrand (Eds.), The SAGE handbook of writing development (pp. 48-64). London: Sage. Gelb, I. J. (1963). A study of writing (2nd ed.). Chicago: University of Chicago Press. Goldberg, A., Russell, M., & Cook, A. (2003). The effect of computers on student writing: A meta-analysis of studies from 1992 to 2002. The Journal of Technology, Learning and Assessment, 2(1), 1-52. Retrieved November 16, 2019, from https://ejournals.bc.edu/index.php/jtla/article/view/1661 Goody, J. (1986). The logic of writing and the organization of society. Cambridge: Cambridge University Press. Grabill, J. T., & Hicks, T. (2005). Multiliteracies meet methods: The case for digital writing in English education. English Education, 37(4), 301-311. Retrieved November 16, 2019, from http://www.jstor.org/stable/40173204 Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2006). Multivariate data analysis (6th ed.). Upper Saddle River: Pearson. Harmer, J. (2004). How to teaching writing. Harlow: Pearson. Hayes, J. R., & Flower, L. S. (1980). Identifying the organization of the writing process. In L. W. Gregg & E. R. Steinberg (Eds.), Cognitive processes in writing (pp. 3-30). Hillsdale: Lawrence Erlbaum Associates. Hayes, J. R., & Flower, L. S. (1986). Writing research and the writer. American Psychologist, 41(10), 1106-1113. https://doi.org/10.1037/0003-066X.41.10.1106 Heath, V. L. (2013). Elementary writing assessment platforms: A quantitative examination of online versus offline writing performance of fifth grade students (Unpublished doctoral dissertation). Indiana University, Indiana, USA. Hillocks, G., Jr. (2007). Narrative writing learning a new model for teaching. Portsmouth: Heinemann. Holst, A. (2019). Number of smartphone users worldwide 2014-2020. Retrieved August 6, 2019, from https://www.statista.com/statistics/330695/number-of-smartphone-usersworldwide/ Hosek, J., Masek, P., Andreev, S., Galinina, O., Ometov, A., Kropfl, F., Wiedermann, W., & Koucheryavy, Y. (2017). A SyMPHOnY of integrated IoT businesses: Closing the gap between availability and adoption. IEEE Communications Magazine, 55(12), 156-164. https://doi.org/10.1109/MCOM.2017.1700028 Hyland, K. (2003). Second language writing. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511667251 İşeri, K., & Ünal, E. (2010). The adaptation of writing disposition scale into Turkish. Eğitim ve Bilim, 35(155), 104-117. Jöreskog, K., & Sörbom, D. (2001). LISREL 8: User’s reference guide (2nd ed.). Lincolnwood: SSI. Johnson, M. A. (1988). Word processing in the English as a second language classroom. In J. L. Hoot & S. B. Silvern (Eds.), Writing with computer in the early grades (pp. 107–121). New York: Teachers College Press. Jones, S., Johnson-Yale, C., Millermaier, S., & Pérez, F. S. (2009). US college students’ Internet use: Race, gender and digital divides. Journal of Computer-Mediated Communication, 14(2), 244-264. https://doi.org/10.1111/j.1083-6101.2009.01439.x

Juzwik, M. M., Wolbers, K., Moxley, K., Dimling, L., & Shankland, R. (2006). Writing into the 21st century an overview of research writing, 1999 to 2004. Written Communication, 23(4), 451-476. https://doi.org/10.1177/0741088306291619 Kitchin, D. A. (1991). Case study of ESL community college students using computer-based writing tools in composition course (Unpublished doctoral dissertation). University of San Francisco, California, USA. Kutlu, Ö. (2013). Using technology for developing writing in an ESP class. Procedia-Social and Behavioral Sciences, 70, 267-271. https://doi.org/10.1016/j.sbspro.2013.01.0644 Lam, F. S., & Pennington, M. C. (1995). The computer vs. the pen: A comparative study of word processing in a Hong Kong secondary classroom. Computer Assisted Language Learning, 8(1), 75-92. https://doi.org/10.1080/0958822950080106 Lee, H. K. (2004). A comparative study of ESL writers’ performance in a paper-based and a computer-delivered writing test. Assessing Writing, 9(1), 4-26. https://doi.org/10.1016/j.asw.2004.01.001 Li, J. (2006). The mediation of technology in ESL writing and its implications for writing assessment. Assessing Writing, 11(1), 5-21. https://doi.org/10.1016/j.asw.2005.09.001 Li, J., & Cumming, A. (2001). Word processing and second language writing: A longitudinal case study. International Journal of English Studies, 1(2), 127-152. Retrieved November 16, 2019, from https://revistas.um.es/ijes/article/view/48231 Li, X. (n.d.). Complexity theory - the holy grail of 21st century. Lane Department of CSEE, West Virginia University. Retrieved July 22, 219 from https://archive.is/20130815234045/http://www.csee.wvu.edu/~xinl/complexity. html#selection-11.0-11.17 Lyons, M. (2013). The writing culture of ordinary people in Europe, c. 1860-1920. Cambridge: Cambridge University Press Marsh, H. W., Hau, K.-T., Roche, L., Craven, R., Balla, J., & McInerney, V. (1994). Problems in the application of structural equation modeling: Comment on Randhawa, Beamer, and Lundberg (1993). Journal of Educational Psychology, 86(3), 457-462. https://doi.org/10.1037/0022-0663.86.3.457 McAllister, C., & Louth, R. (1988). The effect of word processing on the quality of basic writers' revisions. Research in the Teaching of English, 22(4), 417-427. Retrieved November 16, 2019, from https://www.jstor.org/stable/40171196 Murray, D. (1972). Teach writing as a process not product. The Leaflet, 71(3), 11-14. National Commission on Writing. (2004). Writing a ticket to work . . . or a ticket out: A survey of business leaders. New York: College Board. Neal, M. (2011). Writing assessment and the revolution in digital texts and technologies. New York: Teachers College Press. Neuwirth, C. M., Chandhok, R., Kaufer, D. S., Morris, J. H., Erion, P., & Miller, D. (2000). Computer supported collaborative writing: A coordination science perspective. In G. M. Olson, T. W. Malone, & J. B. Smith (Eds.), Coordination theory and collaboration technology (pp. 535–557). Mahwah, NJ: Lawrence Erlbaum Associates. Nobles, S., & Paganucci, L. (2015). Do digital writing tools deliver? Student perceptions of writing quality using digital tools and online writing environments. Computers and Composition, 38, 16-31. https://doi.org/10.1016/j.compcom.2015.09.001 Owston, R. D., Murphy, S., & Wideman, H. H. (1992). The effects of word processing on students' writing quality and revision strategies. Research in the Teaching of English, 26(3), 249-276. Retrieved November 16, 2019, from https://www.jstor.org/stable/40171308

Wheeler, S., & Wheeler, D. (2007). Evaluating Wiki as a tool to promote quality academic writing skills. Paper presented at the Conference ICL2007 (pp. 26-28). Villach, Austria. Retrieved from https://telearn.archives-ouvertes.fr/hal-00197280 Wichmann, A., & Rummel, N. (2013). Improving revision in wiki-based writing: Coordination pays off. Computers & Education, 62, 262-270. https://doi.org/10.1016/j.compedu.2012.10.017 Williamson, M. M., & Pence, P. (1989). Word processing and student writers. In: B. K. Britton & S. M. Glynn (Eds.), Computer writing environments: Theory, research, and design (pp. 93–127). Hillsdale: Erlbaum. Xu, C. (2018). Understanding online revisions in L2 writing: A computer keystroke-log perspective. System, 78, 104-114. https://doi.org/10.1016/j.system.2018.08.007 Yilmaz, C., & Erkol, K. (2015). Using word processor as a tool to enhance the teaching of writing in a Turkish EFL context: An action research. Journal of Theory and Practice in Education, 11(1), 346-358. Retrieved November 16, 2019, from http://dergipark.gov.tr/eku/issue/5464/74167 Yunus, M. M., Nordin, N., Salehi, H., Embi, M. A., & Salehi, Z. (2013). The use of information and communication technology (ICT) in teaching ESL writing skills. English Language Teaching, 6(7), 1-8. https://doi.org/10.5539/elt.v6n7p1