Video game experience affects performance, cognitive load, and brain activity in laparoscopic surgery training

Abstract

Objective: Video games can be a valuable tool for surgery training. Individuals who interact or play video games tend to have a better visuospatial ability when compared to non-gamers. Numerous studies suggest that video game experience is associated with faster acquisition, greater sharpening, and longer retention of laparoscopic skills. Given the neurocognitive complexity of surgery skill, multimodal approaches are required to understand how video game playing enhances laparoscopy skill.

Material and Methods: Twenty-seven students with no laparoscopy experience and varying levels of video game experience performed standard laparoscopic training tasks. Their performance, subjective cognitive loading, and prefrontal cortical activity were recorded and analyzed. As a reference point to use in comparing the two novice groups, we also included data from 13 surgeons with varying levels of laparoscopy experience and no video game experience.

Results: Results indicated that video game experience was correlated with higher performance (R² = 0.22, p< 0.01) and lower cognitive load (R² = 0.21, p< 0.001), and the prefrontal cortical activation of students with gaming experience was relatively lower than those without gaming experience. In terms of these variables, gaming experience in novices tended to produce effects similar to those of laparoscopy experience in surgeons.

Conclusion: Our results suggest that along the dimensions of performance, cognitive load, and brain activity, the effects of video gaming experience on novice laparoscopy trainees are similar to those of real-world laparoscopy experience on surgeons. We believe that the neural underpinnings of surgery skill and its links with gaming experience need to be investigated further using wearable functional brain imaging.

Keywords: Mental workload, NASA-TLX, laparoscopy, surgical education

Introduction

Laparoscopic surgery offers substantial benefits to patients, including small incisions, rapid recovery, short hospital stays, and reduced post-operative pain. These translate into increased patient safety and significant economic benefits to healthcare systems. However, laparoscopic surgery is difficult and imposes additional demands on surgeons’ perceptual and cognitive abilities. A laparoscopic surgeon operates with an indirect, narrow visual access and minimal tactile feedback. Such conditions require new skills with different learning curves and new training methods beyond the traditional master-apprentice format. It is critical for residents to reach expertise in a safe training environment with documented criteria. There is increasing interest in characterising not only the observed performance but also the cognitive effort and physiological and brain activity profiles of trainees with the ultimate aim of devising better training and assessment methodologies (1-3). While direct observation may indicate that a trainee performs adequately, it may fail to predict the long-term retention of skill or actual performance beyond the training environment, and trainees who perform identically may differ in subsequent real-world performance.

Video games can be a valuable tool for surgery training. Video gamers demonstrate superior eye-hand coordination, faster reaction times, superior spatial visualization skills, high capacity for visual attention and spatial distribution. Both laparoscopic surgery and computer games require eye-hand coordination, visuospatial cognitive ability, attention and perception skills. Individuals who interact or play video games tend to have a better visuospatial ability when compared to non-gamers (4,5).

Numerous studies suggest that video game experience is associated with faster acquisition, greater sharpening, and longer retention of laparoscopic skills (6-11). Video game playing also appears to have value as warm-up preparatory exercise for surgery. These advantages accrue preferentially to laparoscopic or robotic rather than to traditional surgery (12). Yet, neither the direction of causality nor the mechanisms through which video game experience affects surgery skills are well understood (13). To our knowledge, studies to date investigating these links have exclusively utilized overt performance and behavioural measures. However, given the neurocognitive complexity of surgery skill, multimodal approaches are required.

We investigated the impact of video game playing experience on the performance, subjective task load, and prefrontal (PFC) brain activity of novice trainees and compared them with the corresponding variables in expert surgeons of varying levels of laparoscopy experience. In order to measure performance, we chiefly employed task completion times. For cognitive load, we used NASA-TLX, which has been widely used to measure subjective task load in surgery (14-16). It is a multidimensional ratings scale that provides an overall index of mental workload as well as the relative contributions of six subscales: mental, physical, and temporal task demands; and effort, frustration, and perceived performance. We also used a high-density, wireless functional near-infrared spectroscopy (fNIRS) device, which allowed us to discover hemoglobin concentration changes as a proxy for brain function.

Material and Methods

Subjects

Data from thirteen surgeons with varying levels of laparoscopy experience and no video game experience, and 27 students with no laparoscopy experience and varying levels of video game experience were used in this study. The students were subdivided into 12 non-gamer students (with no experience in video gaming) and 15 gamer students (with experience in video gaming). Subject demographics are listed in Table 1. Research Ethics Board of Medipol University approved this study (10840098-604.01.01-E.33230), and it was performed in agreement with the Declaration of Helsinki. All participants signed informed consent and could withdraw from the study at any time. Participants had normal or corrected to-normal vision.

Table 1. Group demographics

Experimental Design

Participants performed standard laparoscopic training tasks including peg transfer (Task 1) and string pass (Task 2) using a laparoscopic trainer box. Peg transfer task involved grasping, lifting and relocating rings from one rod to another using both laparoscopy graspers and was performed on a ring stack base. String pass involved grasping a piece of string and passing it through the holes using both graspers and was performed on a threading base. Data were recorded including time to completion, error rate, and overall work quality. Following the completion of each task, the subjects filled out the NASA task load index (NASA-TLX) questionnaire. At the beginning of the experiment, two 2 minute-long videos demonstrating the tasks were shown on a computer screen to the subject. After the video session, the 15 min training was repeated by each subject for gamers and non-gamers. Further details of the procedure were provided in a recent study where we reported an analysis of the brain activity of surgeons and a subset of the student participants without regard to game playing experience (3). All participants filled out a questionnaire detailing their video game experience including frequency, duration and category. The gamers were divided into three groups based on their replies to the questionnaire: only shooter game group (that played first-person shooter and/or third person shooter and/or role-playing games), only strategy game group (realtime strategy, turn based strategy and multiplayer battle arena games), shooter + strategy game group (both strategy and shooter games).

Imaging and Data Analysis

fNIRS data were collected using a high-density fNIRS device (NIRSIT, OBELAB, Korea) with 24-light sources at 780 and 850 nm and 32 detectors, with a sample rate of 8.138 Hz. The channels overlap with parts of the dorsolateral and ventrolateral prefrontal and the upper part of the orbitofrontal and medial PFC. Completion times of three laparoscopic tasks were recorded. The participants used NASA-TLX to evaluate six criteria: mental, physical, and temporal task demands; and effort, frustration, and perceived performance. Each criterion was scored from 1 to 20. A total mental workload score was obtained from the sum of the criteria scores. In order to analyze the fNIRS data, source-detector pair readings (with a separation of 3.35 cm) at two distinct wavelengths are first converted into hemoglobin concentration changes via the modified BeerLambert law, and the average of the task episode are calculated (3). In this paper, standard deviation of oxyhemoglobin concentration changes over an episode is denoted HbO and represents the extent of local cortical activation of a subject during the corresponding experimental episode.

Statistical Analysis

Statistical analysis was performed using GraphPad Prism version 9 for Windows, GraphPad Software. When conducting regression analysis comparing two numerical variables, linear fit with analysis of variance was used. The descriptive results comparing two groups, such as completion time vs. game experience; completion time vs. laparoscopy experience; NASA total vs. game experience and NASA total vs. laparoscopy experience, HbO changes contained non-paired data. In order to assess the statistical significance of the difference between the two groups of non-paired results, we used the nonparametric Kolmogorov test. We did not utilize null-hypotheses whose rejection would have required corrections for multiple comparisons or false discovery.

Results

We present the behavioral and subjective metrics as well as the cortical activations of novice students (non-gamer and gamer) and expert surgeons, measured while performing laparoscopy training tasks. Forty participants (27 students, 13 surgeons, mean age 27.1 ± 4.8 years) were enrolled in the study. The participants’ demographics, previous experience with laparoscopic surgery and gaming experience are shown in Table 1. Figure 1 compares task completion time, NASA-TLX score, and taskevoked oxyhemoglobin changes in the left prefrontal cortex of the three groups of participants. In Figure 2 and Figure 3, intergroup comparisons of performance and cognitive load that were summarized in Figure 1 are further elaborated within each group. Finally, the subject averaged distributions of cortical activation over the PFC of the participants are shown in Figure 4.

Figure 1. Performance, cognitive load, and prefrontal cortical activations of non-gamer students (gray triangle indicates the median), gamer students (black squares), and surgeons (red circles). The students have no laparoscopy experience and the surgeons have no gaming experience. Error bars indicate sample standard deviations (*p< 0.05; **p< 0.01). (A) Task completion time. (B) Mean NASA-TLX score. (C) Oxygenated hemoglobin oxyhemoglogin concentration changes in the left prefrontal cortex measured by fNIRS.

Figure 2. Performance and its dependence on the gaming experience of students and on laparoscopy experience of surgeons. (A) Completion time v gaming experience for students. Gamers are shown as only strategy game players (red circles), only shooter game players (green triangle), and both strategy and shooter game players (blue circles). Best fit line to the gamer data is shown (R² = 0.22, p< 0.01). (B) Completion time v laparoscopy experience for surgeons. The solid black line indicate the linear best fit and the dotted lines indicate the 95% confidence interval (R² = 0.15, p= 0.17).

Figure 3. Cognitive load and its dependence on the gaming experience of students and on laparoscopy experience of surgeons (*p< 0.05; ***p< 0.001). (A) Individual dimensions of cognitive load shown by the NASA-TLX subscores for non-gamer students (gray), gamer students (black), and surgeons (red). Error bars indicate sample standard deviation. (B) Total NASA-TLX score v gaming experience for students (R² = 0.21, p< 0.001). (C) Total NASA-TLX score v laparoscopy experience for surgeons (R² = 0.36, p< 0.0001). In the scatter plots, the solid black lines indicate the linear best fit to the data points and the dotted lines indicate the 95% confidence interval.

Figure 4. Frontal view of the task-evoked cortical activations measured by fNIRS. The subject averaged topographic distributions of oxyhemoglobin over the prefrontal cortex are shown. (A) Non-gamer students. (B) Gamer students. (C) Surgeons.

Figure 1A shows that the surgeons completed the task in a significantly shorter period of time when compared to gamers and non-gamers. A significant difference in completion time was noted between surgeons and non-gamers (p< 0.01) confirming the difference between the two groups. Although gamers appeared to be faster, the difference between gamers and non-gamers did not reach significance in Task 1. In Task 2 (not shown), there were similar trends although group differences were not statistically significant. Figure 1B shows that the surgeons had lower NASA-TLX workload scores when compared to gamers (p< 0.01) and non-gamers (p< 0.04) during Task 1. There was a similar trend for Task 2. Significant difference in task load was seen between gamers and nongamers (p< 0.02). Figure 1C indicates that the left prefrontal cortical activation of surgeons in Task 1 was significantly lower than that of gamers (p< 0.004) and non-gamers (p< 0.02). As in the previous comparisons, Task 2 differences between the groups were similar.

Figure 2A: Through regression analysis, we found a significant association between completion time and gaming experience. The extent of game experience was negatively correlated with completion time (R² = 0.22, p< 0.01). This figure only presents the results for Task 1. We observed a similarly significant association in Task 2 (R² = 0.18, p< 0.02). This figure also shows gaming categories which gamers play (the colour coded presentation used to show gaming categories). No significant different was seen between only shooters player vs. only strategy players; only shooters player vs. strategy + shooters players; only strategy players vs. strategy + shooters player and game experience. Figure 2B suggests that more experienced surgeons tended to be faster; however, laparoscopy experience was not significantly correlated with completion time of Task 1 (R² = 0.15 p= 0.17). Similar results were found in Task 2.

Figure 3A: We show the NASA-TLX subscales that indicate the distinct dimensions of cognitive load. Surgeon had lower scores of the six subscales of the NASA-TLX questionnaire compared to gamers and non-gamers for Task 1. A significant difference in physical (p< 0.02) and temporal demands (p< 0.0007) was noted between surgeons and non-gamers during Task 1. The effort of surgeons was significantly lower compared to gamers (p< 0.05) in completing the tasks. No significant difference was seen between the surgeons, gamers, and non-gamers in performance, frustration and mental demand. In Task 2, no significant difference was seen for pairs of groups in individual subscales. Figure 3B indicates that novice participants with higher game experience reported significantly lower NASA-TLX workload scores (R² = 0.21, p< 0.001). Similarly (Figure 3C) we found that more years of laparoscopy experience correlated with significantly lower NASA-TLX workload scores (R² = 0.36, p< 0.0001). In Figure 3B and Figure 3C, we present NASA-TLX scores for both Task 1 and Task 2. With regard to the topographic distribution of brain activity in three groups, Figure 4 indicates that the left prefrontal cortical activation in nongamers was substantially higher than that in gamers which, in turn, was somewhat higher than that and surgeons.

Discussion

Our results suggest that some of the effects of video gaming experience on novice laparoscopy trainees are similar to those of real-world laparoscopy experience on surgeons. We showed this by using performance and subjective metrics as well as brain activity. To our knowledge, this is the first study that includes cognitive and brain metrics, and not just behavioural ones, in the investigation of video game experience in relation to laparoscopy skill, and directly compares these to those obtained from expert surgeons.

Taking novice students with no laparoscopy or gaming experience as a baseline, task completion time, self-reported cognitive load, and left PFC activation all were decreased with increasing gaming experience or with greater laparoscopy experience. Some of these inter-group differences were statistically significant and all followed a clear trend. Furthermore, within the group of gamer students, students with greater gaming experience completed the training task significantly faster. In previous studies, video game playing correlated with better surgical technique in medical school students and impacted the traditional skills of knot tying, incision making and suturing (9). Evidence shows that first-person shooter games preferentially enhance attentional control and executive function (5). However, whether a particular genre of video game plays a particular role has yet to be determined in a randomized controlled study. We did not see any difference in the effect of genres of game, likely due to insufficient data. In addition to the effect of game playing on performance, the number of laparoscopy procedures performed in the past may have enhanced surgeons’ task performance.

There was a significant negative correlation between the cognitive load and gaming experience in students and laparoscopy experience in surgeons. This result is significant since NASA-TLX scores have been shown to independently predict future OR performance (14). In addition, higher cognitive load during surgery may lead to distraction, consideration of fewer options than those available, or inflexibility in choosing strategies. Low load on the other hand allows greater amounts of data to be processed, leading to appropriate responses to unexpected events (17).

PFC activation provided that clearest inter-group discrimination, particularly with regard to differences between non-gamer and gamer novices. Brain activity in the left PFC, in particular, is reduced as a result of greater gaming or laparoscopy experience. The reduction in activity is consistent with the known dominance of the left hemisphere in motor action regardless of handedness (18), interference processing (19,20) and overall bi-manual coordination (21,22). By contrast, PFC lateralization is reduced in PTSD and other disorders (23). Previous fNIRS studies of laparoscopy skill have indicated that greater skill is accompanied by behavioral automation, which tends to reduce the engagement of executive areas in the PFC (24).

Our study had several limitations. The number of participants was low. A greater number of participants would allow us to rule out or show the significance of some of the trends observed. It may also reveal the differential effects of the genre of video game. Secondly, student participants did not all play the same set of games. More controlled gaming experience may help increase the accuracy and validity of the results. Our results show only correlation and not causation. Underlying factor (such as higher dexterity or motivation) could be causing both higher gaming experience as well as better laparoscopy training performance. This shortcoming may be circumvented by an interventional study that manipulates gaming experience systematically. Lastly, the quantification of video game experience may have been subject to inaccuracy since it was self-reported. Both in gaming and laparoscopy experience some self-reporting inaccuracy is evident from the fact that there appears to be a bias to report in multiples of fixed values.

Conclusion

Our results indicate that multimodal investigations may shed light on how video games affect not only performance in surgery training, but cognitive load and brain activity, as well. The understanding of neural underpinnings of surgery skill and its links with gaming experience will likely increase in the near future as wearable functional brain imaging becomes more widely available.

Cite this article as: Keleş HO, Omurtag A. Video game experience affects performance, cognitive load, and brain activity in laparoscopic surgery training. Turk J Surg 2023; 39 (2): 95-101.

This study was approved by İstanbul Medipol University Non-Invasive Clinical Research Ethics Committee (Decision no: 577, Date: 17.07.2019).

Externally peer-reviewed.vvvvv

Concept - HOK, AO; Design - HOK, AO; Supervision - HOK; Funding - HOK; Data Collection and/or Processing - HOK; Analysis and/or Interpretation - HOK, AO; Literature Review - HOK; Writer - HOK, AO; Critical Review - AO.

The authors have no conflicts of interest to declare.

The authors declared that this study has received no financial support.

References

1. Modi HN, Singh H, Yang GZ, Darzi A, Leff DR. A decade of imaging surgeons’ brain function (part I): Terminology, techniques, and clinical translation. Surgery 2017; 162(5): 1121-30. https://doi.org/10.1016/j. surg.2017.05.021
2. Zakeri Z, Mansfield N, Sunderland C, Omurtag A. Physiological correlates of cognitive load in laparoscopic surgery. Sci Rep 2020; 10(1): 12927. https://doi.org/10.1038/s41598-020-69553-3
3. Keles HO, Cengiz C, Demiral I, Ozmen MM, Omurtag A. High density optical neuroimaging predicts surgeons’s subjective experience and skill levels. PLoS One 2021; 16(2): e0247117. https://doi.org/10.1371/ journal.pone.0247117
4. Nahum M, Bavelier D. Video games as rich environments to foster brain plasticity. Handb Clin Neurol 2020; 168: 117-36. https://doi. org/10.1016/B978-0-444-63934-9.00010-X
5. Green CS, Bavelier D. Learning, attentional control, and action video games. Curr Biol 2012; 22(6): R197-206. https://doi.org/10.1016/j. cub.2012.02.012
6. Rosser JC Jr, Lynch PJ, Cuddihy L, Gentile DA, Klonsky J, Merrell R. The impact of video games on training surgeons in the 21st century. Arch Surg 2007; 142(2): 181-6. https://doi.org/10.1001/archsurg.142.2.181
7. Ou Y, McGlone ER, Camm CF, Khan OA. Does playing video games improve laparoscopic skills? Int J Surg 2013; 11(5): 365-9. https://doi. org/10.1016/j.ijsu.2013.02.020
8. Lynch J, Aughwane P, Hammond TM. Video games and surgical ability: A literature review. J Surg Educ 2010; 67(3): 184-9. https://doi. org/10.1016/j.jsurg.2010.02.010
9. de Araujo TB, Silveira FR, Souza DL, Strey YT, Flores CD, Webster RS. Impact of video game genre on surgical skills development: A feasibility study. J Surg Res 2016; 201(1): 235-43. https://doi.org/10.1016/j. jss.2015.07.035
10. Datta R, Chon SH, Dratsch T, Timmermann F, Muller L, Plum PS, et al. Are gamers better laparoscopic surgeons? Impact of gaming skills on laparoscopic performance in “Generation Y” students. PLoS One 2020; 15(8): e0232341. https://doi.org/10.1371/journal.pone.0232341
11. Chalhoub E, Tanos V, Campo R, Kesrouani A, El Rassy E, Rizkallah J, et al. The role of video games in facilitating the psychomotor skills training in laparoscopic surgery. Gynecol Surg 2016; 13: 419-24. https:// doi.org/10.1007/s10397-016-0986-9
12. Hvolbek AP, Nilsson PM, Sanguedolce F, Lund L. A prospective study of the effect of video games on robotic surgery skills using the highfidelity virtual reality RobotiX simulator. Adv Med Educ Pract 2019; 10: 627-34. https://doi.org/10.2147/AMEP.S199323
13. Jalink MB, Goris J, Heineman E, Pierie JP, ten Cate Hoedemaker HO. The effects of video games on laparoscopic simulator skills. Am J Surg 2014; 208(1): 151-6. https://doi.org/10.1016/j.amjsurg.2013.11.006
14. Yurko YY, Scerbo MW, Prabhu AS, Acker CE, Stefanidis D. Higher mental workload is associated with poorer laparoscopic performance as measured by the NASA-TLX tool. Simul Healthc 2010; 5(5): 267-71. https:// doi.org/10.1097/SIH.0b013e3181e3f329
15. Miranda G, Casmiro M, Cavassi G, Naspetti R, Miranda E, Sacchetti R, et al., editors. Comparative Analysis of Subjective Workload in Laparoscopy and Open Surgery Using NASA-TLX2019; Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-96098-2_11
16. Hart SG. Nasa-Task Load Index (NASA-TLX); 20 years later. Proc Hum Factors Ergon Soc Annu Meet 2006; 50(9): 904-8. https://doi. org/10.1177/154193120605000909
17. Carswell CM, Clarke D, Seales WB. Assessing mental workload during laparoscopic surgery. Surg Innov 2005; 12(1): 80-90. https://doi. org/10.1177/155335060501200112
18. Serrien DJ, Sovijärvi-Spapé MM. Manual dexterity: Functional lateralisation patterns and motor efficiency. Brain Cogn 2016; 108: 42-6. https://doi.org/10.1016/j.bandc.2016.07.005
19. Zhang L, Sun J, Sun B, Luo Q, Gong H. Studying hemispheric lateralization during a Stroop task through near-infrared spectroscopybased connectivity. J Biomed Opt 2014; 19(5): 57012. https://doi. org/10.1117/1.JBO.19.5.057012
20. Proverbio AM, Azzari R, Adorni R. Is there a left hemispheric asymmetry for tool affordance processing? Neuropsychologia 2013; 51(13): 2690- 701. https://doi.org/10.1016/j.neuropsychologia.2013.09.023
21. Rushworth MF, Krams M, Passingham RE. The attentional role of the left parietal cortex: The distinct lateralization and localization of motor attention in the human brain. J Cogn Neurosci 2001; 13(5): 698- 710. https://doi.org/10.1162/089892901750363244
22. Jäncke L, Peters M, Himmelbach M, Nösselt T, Shah J, Steinmetz H. fMRI study of bimanual coordination. Neuropsychologia 2000; 38(2): 164-74. https://doi.org/10.1016/S0028-3932(99)00062-7
23. Tian F, Yennu A, Smith-Osborne A, Gonzalez-Lima F, North CS, Liu H. Prefrontal responses to digit span memory phases in patients with post-traumatic stress disorder (PTSD): A functional near infrared spectroscopy study. Neuroimage Clin 2014; 4: 808-19. https://doi. org/10.1016/j.nicl.2014.05.005
24. Nemani A, Yücel MA, Kruger U, Gee DW, Cooper C, Schwaitzberg SD, et al. Assessing bimanual motor skills with optical neuroimaging. Sci Adv 2018; 4(10): eaat3807. https://doi.org/10.1126/sciadv. aat3807