Evaluation of the readability of informed consent forms used in urology: Is there a difference between open, endoscopic, and laparoscopic surgery?

Abstract

Objective: The aim of this study is to evaluate the readability levels of informed consent forms (ICFs) used before urological surgery application in Turkey and to compare the readability levels of open, endoscopic and laparoscopic surgical ICFs.
Material and Methods: Five-hundred twenty-nine ICFs used for urological open, endoscopic and laparoscopic surgical procedures were collected from different hospitals in Turkey. Evaluating ICFs which have exactly the same text only once, a total of 69 consent forms were evaluated. Gunning fog and Flesch kincaid formulas measuring the general readability level was used in order to calculate the readability level of ICFs in addition to Ateşman and Bezirci-Yılmaz formulas defined for determining the readability level of Turkish texts. ICFs were evaluated by separating into three groups as open, endoscopic and laparoscopic surgery forms depending on their contents.
Results: Among 69 ICFs evaluated, 35 were open, 19 were endoscopic and 15 were laparoscopic surgery consent forms. Readability level of all ICFs was detected as average according to Ateşman formula, very difficult according to Flesch kincaid formula, difficult according to Gunning fog formula and at high school education level according to Bezirci-Yılmaz. Among the three groups statistical evaluation, a significant difference was not detected in readability level.
Conclusion: In this study, it was detected that ICF readability levels used in urological surgeries in our country was rather low. We think that the cooperation of the concerned institutions is required for the revision of the consent information texts available and the improvement of the texts according to the strategies recommended.

Keywords: Informed consent forms, readability, understandability, urological surgery

Introduction

Informed consent means the authorization given to the health professional for the diagnosis or treatment interventions planned with the patient’s consent. Informed consent forms (ICF), being an inseparable constituent of the consent phase, are used to help the patients during the treatment phase by explaining the indications, advantages, and possible risks of medical applications (1). It was also shown that these texts may be effective in solving problems in the treatment phase with advantages such as providing the patient–doctor communication and making the agreement of the patient to treatment easier (2, 3). But as the value of information is limited with the comprehension ability of the patients, the “readability” and “understandability” of information are as important as its reliability and currency.

Presenting some quantitative data on texts, readability provides information on whether the text is easily understandable by the reader at a certain level through the characteristics of the syllables, words, and sentences in that language. Factors influencing readability are the average word length, word frequency, multisyllabic words, average sentence length, ambiguous word number, and average syllable number. The sentence readability of decreases as the number of words in a sentence increase. Readability formulas were developed using criteria such as the length of words and sentences and the word syllable number in readability evaluation. There are many formulas developed for readability analysis (4-9).

The Ateşman and Bezirci–Yılmaz formulas (6, 7) defined to determine the readability level of Turkish texts and Gunning Fog Index and Flesh–Kincaid test measuring the general readability level are the most common readability formulas used (8, 9). In a research conducted in Turkey, it was found that 64.6% of the public had inadequate health literacy (5).

The aim of this study is to evaluate the readability levels of ICFs used in our country before urological surgery and to compare the readability levels of ICF specifically prepared for open, endoscopic, and laparoscopic surgery.

Material and Methods

This research was conducted according to the principles of the World Medical Association’s Declaration of Helsinki. Since there were no human participants in this study, it was not necessary to obtain ICF.
A total of 529 ICFs used for urological open, endoscopic, and laparoscopic surgical procedures were collected from different hospitals in Turkey. Evaluating ICFs that have exactly same text only once, a total of 69 consent forms were evaluated for the sentence number, word number, letter number, character number, syllable number, and words with an average syllable number of four and above.

The informative text available in these consent forms was copied and transferred to Microsoft Word (Microsoft, Redmond, WA) program and was calculated manually with Microsoft Excel (Microsoft, Redmond, WA) program. The Ateşman and Bezirci–Yılmaz formulas (6, 7) for determining the readability level of Turkish texts and the Gunning Fog Index and Flesch–Kincaid (8, 9) test for measuring the general readability level were used for calculating the readability level of ICF.

Ateşman readability formula (Ateşman readability formula, Ankara, Turkey)
The Ateşman readability formula is a formula based on the length of words and sentences.

The readability score is formulated as 198.825−40.175× (total syllables/total words)−2.610×(total words/total sentences). It is understood that the readability level of a text is considered easier when it is closer to100 and harder when it is closer to 0, according to the Ateşman formula.
Bezirci–Yılmaz readability formula (Bezirci–Yılmaz readability formula, Ankara, Turkey)
The Bezirci–Yılmaz readability formula was developed based on the sentence length and syllable number in words, characteristics of different formulas developed until today, and the statistical characteristics of the Turkish language. According to this formula, the readability difficulty of the text increases when the sentences in the text are longer. Similarly, an increase of the syllable number in a word makes the readability of that word and the sentences harder most of the time.

AWN: Average word number; S3: Number of words with an average of three syllables; S4: Number of words with an average of four syllables; S5: Number of words with an average of five syllables; S6: Number of words with an average of six or more syllables

The result acquired from this formula explains which class level a text addresses to according to the education system in our country. The education system shows the elementary school education level for Grades 1–8, secondary (high) school education for Grades 9–12, bachelor’s degree for Grades 12–16, and academic education level for Grades 16 and above.

Flesch–Kincaid test (Flesch–Kincaid test, Columbia, USA)
The length of the words and sentences is determined.

Readability=(0.39×sentence length)+(1.18×word length)−15.59

World length=syllable number/word number

Sentence length=word number/sentence number

The syllable number is divided with the word number for the word length, and the word number is divided with the sentence number for sentence length. The text is evaluated as easy when the syllable number of each word is closer to 1 and as difficult when the syllable number rises up to 10. The same operation is valid for the sentence. The text is evaluated as easy when the word number decreases to 1 and as difficult when it is more than 10.

Gunning Fog Index (Gunning Fog Index formula, New York, USA)
There are two important aspects of the Gunning Fog Index. These are words containing three or more syllables and the average number of words used in sentences.

Fog Index=0.4×(word rate with three syllables+average number of words)

Word rate with three syllables=(number of words with three or more syllables/remaining number of words)×100

Average number of words=word number/sentence number.

It is an easy text if the result is between 8 and 10 and a difficult text if the result is above 11.

The readability intervals of the readability formulas used in the study are available in Table 1.
Informed consent forms were separated into three groups as open (Group 1), laparoscopic (Group 2), and endoscopic (Group 3) surgery according to their content. The readability levels were compared with the Ateşman, Bezirci–Yılmaz, Gunning Fog, and Flesch–Kincaid formulas and the sentence number, word number, letter number, character number, syllable number, and average number of words with four and more syllables.

Table 1. Readability intervals of the readability formulas used in the study

Results

Among 69 ICFs evaluated, 35 were open (Group 1), 15 were laparoscopic (Group 2), and 19 were endoscopic surgery (Group 3) consent forms. No significant difference was observed in the sentence number, word number, letter number, character number, syllable number, and words with an average syllable number of four and above among the consent forms. Among the three groups and among the groups in binary statistical evaluation, no significant difference was detected in readability level among the groups.

Readability level of all consent forms was detected as average according to the Ateşman formula, very difficult according to Flesch–Kincaid test, difficult according to the Gunning Fog Index, and at high school education level according to the Bezirci–Yılmaz formula. Numeric and statistical values among the groups are available in Table 2.

Table 2. Numeric and statistical values among the groups

Discussion

Informed consent is one of the most important aspects of ethical medical practice. In legal terms, making an intervention without informed consent may mean negligence or malpractice and may lead to a legal action, maltreatment, and even an attack against the doctor. Informed consent allows the patient to understand the risks and benefits of all interventions and provides the voluntary consent of patients to be able to continue the procedure. A consent form through which the patients can completely understand the process to be made can be called the ideal informed consent. Ethically, to be able to make a conscious decision, it is very important for the patient to understand the recommended procedure (10, 11). Also, the increasing tendency of health insurance costs and malpractice cases, especially for the surgeons and doctors making invasive interventions, makes the readability and understandability of ICFs even more important (11-13).

It is estimated that the patient level of understanding during the informed consent phase is better than it is actuallly reported (14). But Crepeau et al. (15) found the understanding and recalling of the patients for surgical consent form to be unexpectedly low. As the average readability level of adults in the United States is at the eighth-grade level, the National Institutes of Health and the American Medical Association suggest that the readability of patient materials should be lower than or at the sixth-grade reading level (16-18).

While the average education level of the whole population over 15 years of age is reported as 7.18 years in Turkey according to 2010 data, the average education level of only the females over 15 years of age is reported as 6.33 years (19). Also, according to a research made in 2014, it was found that two-thirds of the population in Turkey has an inadequate level of health literacy (5). So, it is considered that easy readability of ICFs in Turkey would increase the clarity of the procedure to be applied.

Readability levels of ICFs were measured in different countries for different medical branches before. According to Mariscal-Crespo et al. (20) ICFs used in public hospitals were analyzed globally in Spain, and it was shown that 62.4% had “somewhat difficult,” 23.4% had “normal,” and 13.4% had “very difficult” readability. The ICF readability values among the branches were compared in another study, and it was reported that urology ICFs were at a “very and somewhat difficult” interval (21). We think that this situation may be related to the fact that urological operations especially include endoscopic and laparoscopic surgeries, and ICFs containing the details of different special techniques used in these cases cannot be prepared at a level understandable by the patients. So, we compared the readability levels of open, endoscopic, and laparoscopic consent forms in our study. Although no significant difference was detected between the readability levels of all three surgery groups, we detected that the average of sentence, word, syllable, and number of words with four and more syllables was higher for laparoscopic surgeries.

Gargoum and Keeffe (22) evaluated the information forms used for endoscopic interventions in Ireland and reported that only 62% of the forms were easy to ready, and 57% were at the reading level of 13–15 years of age. In a study made in the United States, it was reported that the invasive operation ICFs were written at an average of 15th grade level (i.e., third year of college) (23). Boztaş et al. evaluated the ICFs used before anesthesia in Turkey and reported that these had low-to-very low readability levels (4). Şahin et al. reported that 41.5% of the patients who underwent orthopedic surgery after taking ICF in Turkey did not remember potential complications, and only 29.6% of the patients completely read the ICFs (24).

Difficult readability level can be one of the reasons for not reading ICFs completely. In our study, it was detected that the urological ICFs had a different readability level and were understandable at the high school education level. This condition is in line with studies made in different branches in many countries. So, the things to be done so that ICFs can be more readable and understandable should be discussed.

Borello et al. (1) prepared ICFs that were made easier to comprehend with marked texts and diagrams for laparoscopic cholecystectomy and reported that these forms are easier to understand and remember. Shukla et al. (25) reported that the cataract surgery ICFs at the second-grade reading level and video support are easier to understand.

To increase the readability level of ICFs, we recommend decreasing the number of multisyllabic worlds, sentences, and words, to form the document by words in a an understandable level for the patient, to minimize the words with a medical content that cannot be understood by the patient, and to enrich them with visual information such as videos and diagrams. Also, the patients may have acquired information on the subjects on the surgical procedure themselves (especially through the internet), which may not actually be correct, and patients with a low educational level may feel ashamed to ask the questions for explanation. Thus, the doctor has to be open in the evaluation phase of ICFs, give opportunity to the patients to ask questions, and should spare adequate time for the patient. Additionally, giving permission to an individual such as a relative or friend whom the patient trusts during the informed consent phase may help the patient to understand the ICFs readability and the procedure to be applied, and it may provide emotional support. We think that the application of all these strategies would let the patients understand the procedure and increase the recall rates of the procedure risks.

Conclusion

A readability level of the urology ICFs used in our country was detected to be low and difficult in this study. Also, a significant difference was not detected in the readability among the open, endoscopic, and laparoscopic surgery ICFs. We think that attention should be paid to this subject, which is both medically and legally binding for the doctors, and verbal and visual support should be provided in addition to ICFs during patient informing. Presenting proof-based information at a clear, understandable, and appropriate reading level in consent texts would contribute the improvement of communication between urologists and patients in the preoperative and postoperative process, and would cause a better informing of the patients, especially on post-surgery results. We think that the cooperation of the concerned institutions is required for the revision of the ICFs available and the improvement of the texts according to the strategies recommended.

Cite this paper as: Sönmez MG, Kozanhan B, Özkent MS, Ecer G, Boğa MS, Demirelli E, et al. Evaluation of the readability of informed consent forms used in urology: Is there a difference between open, endoscopic, and laparoscopic surgery?. Turk J Surg 2018; 10.5152/turkjsurg.2017.3973.

Authors declared that the research was conducted according to the principles of the World Medical Association eclaration of Helsinki “Ethical Principles for Medical Research Involving Human Subjects” (amended in October 2013).

Not required in this study.

Externally peer-reviewed.

Concept - M.G.S., B.K.; Design - M.G.S., B.K., M.S.Ö.; Supervision - M.G.S., B.K., A.Ö.; Resource - M.G.S., B.K., M.S.Ö., G.E., M.S.B., E.D., A.Ö.; Materials - M.G.S., B.K., M.S.Ö., G.E., M.S.B., E.D., A.Ö.; Data Collection and/or Processing -M.G.S., B.K.; Analysis and/or Interpretation - M.G.S., B.K., A.Ö.; Literature Search - M.G.S., B.K.; Writing Manuscript - M.G.S., B.K.; Critical Reviews - M.G.S., B.K., A.Ö.

The authors have no conflicts of interest to declare.

The authors declared that this study has received no financial support.

References

1. Borello A, Ferrarese A, Passera R, Surace A, Marola S, Buccelli C, et al. Use of a simplified consent form to facilitate patient understanding of informed consent for laparoscopic cholecystectomy. Open Med (Wars) 2016; 11: 564-573.
2. Ritterband LM, Thorndike FP, Cox DJ, Kovatchev BP, Gonder-Frederick LA. A behavior change model for internet interventions. Ann Behav Med 2009; 38: 18-27.
3. Kozanhan B, Tuta MS. Readability of Patient Education Texts Presented on the Internet in the Field of Anesthesiology. Turkiye Klinikleri J Anest Reanim 2017; 15: 63-70.
4. Boztaş N, Özbilgin Ş, Öçmen E, Altuntaş G, Özkardeşler S, Hancı V, et al. Evaluating the Readibility of Informed Consent Forms Available Before Anaesthesia: A Comparative Study. Turk J Anaesth Reanim 2014; 42: 140-144.
5. Tanrıöver MD, Yıldırım HH, Ready FND, Çakır B, Akalın HE. Sağlık Okuryazarlığı Araştırması. 2014.
6. Ateşman E. Measuring readability in Turkish. A.U. Tömer Language Journal 1997; 58: 171-174.
7. Bezirci B, Yılmaz AE. A software library for measurement of readability of texts and a new readability metric for turkish. DEÜ FMD 2010; 12: 49-62.
8. Flesch R. A new readability yardstick. J Appl Phycol 1948; 32: 221.
9. Gunning R. “The Technique of Clear Writing”, McGraw-Hill International Book Co, New York. 1952.
10. The Metaphysics Resaerch Lab. In The Stanford Encyclopedia of Philosophy. “Informed Con-sent,” 2011. Available from URL: http://plato.stanford.edu/entries/informed-consent (Accessed July 15, 2015).
11. Eltorai AE, Naqvi SS, Ghanian S, Eberson CP, Weiss AP, Born CT, et al. Readability of Invasive Procedure Consent Forms. Clin Transl Sci 2015; 8: 830-833.
12. Mello MM, Studdert DM, DesRoches CM, Peugh J, Zapert K, Brennan TA, Sage WM. Effects of a malpractice crisis on specialist supply and patient access to care. Ann Surg 2005; 242: 621-628.
13. Paasche-Orlow MK, Taylor HA, Brancati FL. Readability standards for informed-consent forms as compared with actual readability. N Engl J Med 2003; 348: 721-726.
14. Sugarman J, McCrory DC, Powell D, Krasny A, Adams B, Ball E, et al. Empirical research on informed consent: an annotated bibliography. Hastings Cent Rep 1999; 29: 1-42.
15. Crepeau AE, McKinney BI, Fox-Ryvicker M, Castelli J, Penna J, Wang ED. Prospective evaluation of patient comprehension of informed consent. J Bone Joint Surg Am 2011; 93: e114 (1-7).
16. Eltorai AE, Sharma P, Wang J, Daniels AH. Most American academy of orthopaedic surgeons’ online patient education material exceeds average patient reading level. Clin Orthop Relat Res 2015; 473: 1181-1186.
17. Eltorai AE, Han A, Truntzer J, Daniels AH. Readability of patient education materials on the American Orthopaedic Society for Sports Medicine website. Phys Sports Med 2014; 42: 125-130.
18. Eltorai AE, Ghanian S, Adams CA Jr, Born CT, Daniels AH. Readability of patient education materials on the American association for surgery of trauma website. Arch Trauma Res 2014; 3: e18161.
19. Barro R, Lee JW. Educational Attainment Dataset. [Online] Available from URL: http://www.barrolee.com/ 2011.
20. Mariscal-Crespo MI, Coronado-Vázquez MV, Ramirez-Durán MV. Global analysis of the readability of the informed consent forms used in public hospitals of Spain. Rev Calid Asist 2017; 32: 200-208.
21. San Norberto EM, Gómez-Alonso D, Trigueros JM, Quiroga J, Gualis J, Vaquero C. Readability of surgical informed consent in Spain. Cir Esp 2014; 92: 201-207.
22. Gargoum FS, O’Keeffe ST. Readability and content of patient information leaflets for endoscopic procedures. Ir J Med Sci 2014; 183: 429-432.
23. Eltorai AE, Naqvi SS, Ghanian S, Eberson CP, Weiss AP, Born CT et al. Readability of Invasive Procedure Consent Forms. Clin Transl Sci 2015; 8: 830-833.
24. Sahin N, Oztürk A, Ozkan Y, Demirhan Erdemir A. What do patients recall from informed consent given before orthopedic surgery? Acta Orthop Traumatol Turc 2010; 44: 469-475.
25. Shukla AN, Daly MK, Legutko P. Informed consent for cataract surgery: patient understanding of verbal, written, and videotapedinformation. J Cataract Refract Surg 2012; 38: 80-84.