Abdullah Alper Şahin, Mehmet Boz, Tolga Keçeci, Ahmet Ünal, Alper Çıraklı

Readability and quality levels of websites that contain written information about anterior cruciate ligament injury: A survey of Turkish websites

Objective: This study aimed to evaluate the contents and readability levels of informative texts about anterior cruciate ligament (ACL) on Turkish websites. Methods: In this cross-sectional study, online searches were performed using the Google, Yandex, and Yahoo search engines on 16, 17, and 18 November 2020, respectively. In these three search engines, ‘anterior cruciate ligament’, ‘anterior cruciate ligament surgery’, ‘ACL’, and ‘ACL surgery’ were entered in Turkish. The first 10 pages from each search on the websites were collected. The websites were divided into 3 groups according to their sources. Group 1 was classified as websites prepared by private hospitals or medical centers; group 2, as individual websites of orthopedics and traumatology physicians; and group 3, as non-profit websites providing general health information that does not fall into these two groups. The websites were analyzed based on both the website interface and a specific content scoring guide by two reviewers. The Flesch Kincaid (FK) grade level and the Flesch reading ease (FRE) score were used to determine the read- ability of information on the websites. Results: Eighty-five unique websites were evaluated. The mean quality score of all the websites was 10.4 ± 4.5 with a maximum score of 25 (range = 3–21). No significant difference in quality score was found between the groups. The mean FK grade score of all the websites was 11.2 ± 1.7 (range = 7.9–15.3). The mean FRE score of all the websites was 46.8 ± 7.7 (range = 24.1–63.7). No statistically significant differences in FK grade and FRE score were found between the groups. Although 59 websites (69%) had a third-party seal indicating the certification of one of the organizations established to provide a standard of health information on the Internet, only 21 websites (25%) were updated in the year before the search. Conclusion: The readability level of the informative texts about the ACL on the Turkish websites was above the educational level in Turkey. In addition, the quality score of the Turkish websites related to ACL was low. The content of the informative texts should be organized while taking into account the patients’ literacy level.

PDF

___

1. Internet usage statistics. Internet. Available at: https ://ww w.int ernet world stats .com/ stats.htm. Accessed 2021 Jan 19.
2. Türkiye İstatistik Kurumu. Hanehalkı Bilişim Teknolojileri Kullanım Araştırması; 2021. Available at: https ://data.tu ik.gov.tr/Bulte n/Ind ex?p= Haneh alki- Bilis im-Teknolojileri-(BT)-Kul lanim -Arastirmasi-20 20-33 679.
3. Bilgin NC, Kesgin MT, Gucuk S, Ak B. Assessment of internet usage for health- related information among clients utilizing primary health care services. Niger J Clin Pract. 2019;22(11):1467-1474. [CrossRef
4. Castleton K, Fong T, Wang-Gillam A, et al. A survey of Internet utilization among patients with cancer. Support Care Cancer. 2011;19(8):1183-1190. [CrossRef]
5. Çatal B, Çimen O, Demirtaş A, Azboyİ. Online resources for platelet-rich plasma injections for orthopedic therapy: what are patients reading? A survey of Turkish websites. Jt Dis Relat Surg. 2020;31(3):582-588. [CrossRef]
6. Albright J, de Guzman C, Acebo P, Paiva D, Faulkner M, Swanson J. Readability of patient education materials: implications for clinical practice. Appl Nurs Res. 1996;9(3):139-143. [CrossRef]
7. Williams AM, Muir KW, Rosdahl JA. Readability of patient education materials in ophthalmology: a single-institution study and systematic review. BMC Oph- thalmol. 2016;16:133. [CrossRef]
8. Kim S, Bosque J, Meehan JP, Jamali A, Marder R. Increase in outpatient knee arthroscopy in the United States: a comparison of National Surveys of Ambula- tory Surgery, 1996 and 2006. J Bone Joint Surg Am. 2011;93(11):994-1000. [CrossRef]
9. Güler H,Şahinkayası Y, Şahinkayası H. The penetration of internet and mobile information technologies: opportunities and limitations. Sosyal Bilimler Derg. 2017;7:186-207. [CrossRef]
10. Search engine market share Turkey. Internet. Available at: https ://gs.stat count er.co m/sea rch-e ngine -market-sh are/a ll/tu rkey. Accessed 2021 Jan 19.
11. Flesch R. A new readability yardstick. J Appl Psychol. 1948;32(3):221-233. [CrossRef]
12. Kincaid PJ, Fishburne RP, Rogers RL, Chissom BS. Derivation of New Readabil- ity Formulas (Automated Readability Index, Fog Count, and Flesch Reading Ease Formula) for Navy Enlisted Personnel. Research Branch Report, Naval Technical Training Command, Millington, TN, USA; 1975:8-75.
13. Mc Carthy A, Taylor C. SUFE and the internet: are healthcare information websites accessible to parents? BMJ Paediatr Open. 2020;4(1):e000782. [CrossRef]
14. Bruce-Brand RA, Baker JF, Byrne DP, Hogan NA, McCarthy T. Assessment of the quality and content of information on anterior cruciate ligament recon- struction on the internet. Arthroscopy. 2013;29(6):1095-1100. [CrossRef]
15. Gosselin MM, Mulcahey MK, Feller E, Hulstyn MJ. Examining Internet resources on gender differences in ACL injuries: what patients are reading. Knee. 2013;20(3):196-202. [CrossRef]
16. Tan SS, Goonawardene N. Internet health information seeking and the patient- physician relationship: A systematic review. J Med Internet Res. 2017;19(1):e9. [CrossRef]
17. Jindal P, MacDermid JC. Assessing reading levels of health information: uses and limitations of flesch formula. Educ Health (Abingdon). 2017;30(1):84-88. [CrossRef]
18. Wang LW, Miller MJ, Schmitt MR, Wen FK. Assessing readability formula differences with written health information materials: application, results, and recommendations. Res Social Adm Pharm. 2013;9(5):503-516. [CrossRef]
19. Roberts H, Zhang D, Dyer GS. The readability of AAOS patient education mate - rials: evaluating the progress since 2008. J Bone Joint Surg Am. 2016;98(17):e70. [CrossRef]
20. Minoughan C, Schumaier A, Kakazu R, Grawe B. Readability of sports injury and prevention patient education materials from the American Academy of Orthopaedic Surgeons Website. J Am Acad Orthop Surg Glob Res Rev. 2018;2(3):e002. [CrossRef]
21. Yeşilyurt ME, Karadeniz O, Gülel FE, Çağlar A, Kangallı Uyar SG. Mean and expected years of schooling for provinces in Turkey. Pamukkale J Eua Soc Stu. 2016;3(1):1-7. [CrossRef]
22. Küçükdurmaz F, Mutlu S, Mutlu H, Parvizi J. A comparison of the quality of online information about total knee arthroplasty available in Turkish and Eng- lish: a cross-sectional study. Acta Orthop Traumatol Turc. 2015;49(4):370-374. [CrossRef]
23. Küçükdurmaz F, Aytekin MN, Tuncay İ, Şen C. Sağlıkla ilgili Türkçe web siteler- indeki bilgilerin kalitesi üzerine bir pilot çalışma: Menisküs yırtığı. Evaluation. 2013;2:25.
24. Küçükdurmaz F, Ceylan HH, Tuncay I. The quality of information about hip fractures in Turkish internet sites. J Clin Anal Med. 2013;4(3):200-203. [CrossRef]