Abstract
Purpose
Gamification is rapidly gaining popularity in medical education, though its role in enhancing feedback has been less explored. The value of feedback is universally acknowledged, yet its delivery and effects remain highly variable due to multiple barriers. This study aimed to evaluate the impact of competition, as a gamification strategy, on implementing a feedback framework among surgical faculty and residents.
Methods
A
A nonrandomized interventional study was conducted at an academic institution’s surgery residency program. Faculty and residents on the trauma and acute care surgery (TACS) and the minimally invasive and bariatric surgery (MIS) services were trained on a new feedback framework, which was posted in operating rooms. Postoperative surveys recorded when feedback was shared. Services competed in two- to four-week-long competitions, with the highest participation receiving a free lunch.
Results
Nineteen faculty and 56 residents were included. Residents had a higher average postoperative survey response rate than faculty (6.67 ± 5.26 responses vs 4.26 ± 2.85 responses, p = 0.04). There were more responses from both faculty (5.57 ± 3.11 responses vs 2.85 ± 1.72 responses, p = 0.01) and residents (8.57 ± 6.05 responses vs 4.62 ± 3.40 responses, p = 0.05) during competition than non-competition weeks. The TACS service had significantly more responses during competition periods.
Conclusions
Unique and complex pressures of the surgical learning environment contribute to ongoing challenges with feedback. Our gamification approach of organized, team-based competition improved utilization of a new feedback framework among faculty and residents. Targeted gamified initiatives have the potential to transform the feedback culture in meaningful ways.
Keywords
Surgical education
operative feedback
gamification
competition
A
A
A
A
A
Introduction
The landscape of medical education continues to evolve as the demographics of our learners diversify and technological capabilities rapidly expand. Gamification has increasingly grown in popularity in medical education as an adjunct to conventional teaching approaches by applying game design elements to traditionally nongame phenomena [14]. Game-based learning is intended to strengthen learning behaviors and attitudes to augment the interests of learners and optimize learning outcomes [5].
The incorporation of game design elements, such as leaderboards, scores or points, prizes, and social collaboration, is meant to promote active learning and educational engagement [1, 68]. The present literature on gamification in medical education has largely focused on improving learner motivation, confidence, knowledge retention, and the enjoyment of educational experiences [810]. However, less attention has been directed at how gamification models can be used within other educational contexts such as feedback—an essential yet notoriously problematic educational process to operationalize.
Providing actionable and impactful feedback to surgical residents remains an ongoing challenge. Multiple barriers to delivering feedback exist, including the time and effort warranted to provide meaningful feedback, the potential for uncomfortable or negative emotions, and the presence of competing priorities [1116]. Furthermore, the fast-paced, dynamic climate of the operating room (OR) creates a uniquely complex learning environment that contributes to difficulties surrounding feedback for surgical residents [1718]. Although the value of feedback is universally acknowledged, it remains variable, inconsistent, and thus, often suboptimal, largely due to challenges with overcoming these barriers associated with feedback. As a result, learners remain discontent and risk missing out on meaningful opportunities to effectively develop and advance their skills. Although extensive investigations and different approaches to improve operative feedback have been undertaken, dissatisfaction with feedback remains common among trainees [1922].
Targeted and innovative strategies to refine specific aspects of feedback practices have the potential to enhance feedback delivery. Given the overall positive trend seen in gamification in medical education, it would be worthwhile to explore how the theoretical framework of gamification can be employed to boost participant motivation and engagement with feedback. We aimed to evaluate how competition as a gamification strategy impacts the implementation of a new feedback framework among surgical faculty and residents.
Material and methods
Study design and population
We conducted a nonrandomized interventional study in a general surgery residency program at a single academic institution. Faculty and residents of all post-graduate year (PGY) classes from two surgery services—trauma and acute care surgery (TACS), minimally invasive and bariatric surgery (MIS)—were invited to participate over a six-month study period.
A
This study was reviewed and deemed exempt from oversight by the local Institutional Review Board.
Gamification
A new feedback framework was designed and adapted from a validated operative teaching model—the briefing, intraoperative teaching, and debriefing (BID) model [23]. Our framework was introduced to all faculty and residents rotating on the TACS and MIS services at the start of the study period. Participants were instructed on the different components of the framework, how to utilize it, and the importance of completing postoperative surveys.
A
Weekly emails were sent to all participants and provided reminders of the framework components and its utilization. Posters of the framework were displayed as visual cues in the ORs and scrub sinks (Fig. 1).
Several strategies based on gamification tactics were employed to promote engagement and use of the feedback framework. Regular competitions were held between the two services’ faculty and residents throughout the study period. Competitions ranged between two to four weeks in duration, and the timing of residents rotating on and off services was considered when scheduling competition periods. Competitions were announced over email, and the weekly emails provided updates on the services’ progress and also highlighted top performers. At the end of each competition, the service that had the highest participation and use of the feedback framework was awarded a free lunch.
Data collection
Data were collected from pre- and post-intervention surveys and postoperative surveys that were created on a secure web application, REDCap. Pre- and post-intervention surveys included data on participant characteristics. Postoperative surveys were presented as quick response (QR) codes on the framework posters for participants to access. Electronic links to the postoperative surveys were also included in the weekly reminder emails to participants. Participants were asked to complete the survey after their operative cases. Surveys recorded whether feedback was shared, and responses were monitored weekly.
Statistical analysis
Descriptive statistics were calculated for all survey respondents. Student’s unpaired t-tests were used to compare continuous variables, and chi-square tests were used to compare categorical variables. Average weekly postoperative survey responses were analyzed by surgical service, participant role, as well as competition periods. A p value < 0.05 was considered statistically significant. Statistical analyses were conducted using Stata software version 17 (StataCorp, College Station, TX).
Results
Participant characteristics
A
We invited 19 faculty and 56 residents to participate in the study (Table 1). Of the 19 faculty members, there were 11 from the TACS service and 8 from the MIS service. In general, there were 5 TACS residents and 3 MIS residents on the services at a time. Pre-intervention survey response rates were a total of 48.0% (n = 36), including 57.9% faculty (n = 11/19) and 44.6% residents (n = 25/56), compared to post-intervention rates of a total of 66.7% (n = 50), with 78.9% faculty (n = 15/19) and 62.5% residents (n = 35/56). The majority of survey respondents were in senior-level roles, consisting of faculty in practice for at least 10 years and residents in PGY classes 3 to 5.
Postoperative surveys
There were no differences in average responses per week between the TACS service and the MIS service (4.52 ± 3.60 responses vs 6.41 ± 5.70 responses, p = 0.15) (Table 2).
A
When the participants were organized by role, residents had a higher average response rate than faculty (6.67 ± 5.26 responses vs 4.26 ± 2.85 responses, p = 0.04).
Table 2
Average Weekly Postoperative Survey Responses
 
All TACS Service
All MIS Service
P value
Responses/week
4.52 ± 3.60
6.41 ± 5.70
0.15
During competition weeks
6.21 ± 3.93
7.93 ± 7.12
0.44
During regular weeks
2.69 ± 2.10
4.77 ± 3.14
0.06
 
All Faculty
All Residents
P value
Responses/week
4.26 ± 2.85
6.67 ± 5.26
0.04
During competition weeks
5.57 ± 3.11
8.57 ± 6.05
0.11
During regular weeks
2.85 ± 1.72
4.62 ± 3.40
0.11
Abbreviations: TACS, trauma and acute care surgery; MIS, minimally invasive surgery
There was a significantly higher response rate per week from the TACS service during competition weeks compared to non-competition weeks (6.21 ± 3.93 responses vs 2.69 ± 2.10 responses, p < 0.01) (Table 3). This remained consistent after separating responses by role for TACs faculty (3.21 ± 2.39 responses vs 1.38 ± 1.04 responses, p = 0.02) and TACS residents (3.00 ± 2.32 responses vs 1.31 ± 1.49 responses, p = 0.03) in comparing competition to non-competition weeks. Similarly, regardless of surgical service, the average weekly response rates for all faculty (5.57 ± 3.11 responses vs 2.85 ± 1.72 responses, p = 0.01) and all residents (8.57 ± 6.05 responses vs 4.62 ± 3.40 responses, p = 0.05) were higher during competition weeks than non-competition weeks. There were no significant differences identified with the MIS service.
Table 3
Average Weekly Postoperative Survey Responses for Competition and Non-Competition Weeks
 
Competition Weeks
Non-Competition Weeks
P value
All TACS service
6.21 ± 3.93
2.69 ± 2.10
< 0.01
TACS faculty
3.21 ± 2.39
1.38 ± 1.04
0.02
TACS residents
3.00 ± 2.32
1.31 ± 1.49
0.03
All MIS service
7.93 ± 7.12
4.77 ± 3.14
0.15
MIS faculty
2.36 ± 1.82
1.46 ± 1.51
0.18
MIS residents
5.57 ± 6.28
3.31 ± 2.39
0.23
All faculty combined
5.57 ± 3.11
2.85 ± 1.72
0.01
All residents combined
8.57 ± 6.05
4.62 ± 3.40
0.05
Abbreviations: TACS, trauma and acute care surgery; MIS, minimally invasive surgery
Discussion
Our study incorporated a gamification approach with the introduction of a new feedback framework for surgical faculty and residents. Overall, we found that faculty and residents responded positively to gamification, as demonstrated by increased utilization of the framework during times of competition. While feedback remains a complex process with multiple barriers contributing to its impact, targeted strategies can be employed to overcome specific challenges. Purposeful gamification can be a strong motivating factor in increasing engagement and drive to enhance surgical feedback.
The surgical learning environment presents unique challenges to perioperative teaching and feedback delivery. Extensive efforts have been taken to seek out effective and efficient approaches to assess, teach, and provide feedback to residents in these settings [1922, 2427]. Much of the current literature has strived to improve the culture of feedback by trialing different initiatives, though no gold standard method exists for perioperative feedback. Despite universal recognition of the value of feedback, its delivery, effectiveness, and impact remain variable. Successful implementation of new feedback initiatives, and thus, the subsequent ideal cultivation of an optimal feedback culture, requires an understanding of barriers to implementation that can be addressed. Furthermore, based on the complexity of the feedback process, tackling specific barriers one at a time may be more impactful in producing effective and sustainable change.
Given the multitude of barriers to feedback from both educators and learners, it is apparent why the motivation to initiate the feedback process may feel insurmountable at times. To address this, our study focused on utilizing gamification as a guiding scaffold for implementing a new feedback framework, aiming to increase motivation to deliver and seek feedback. Gamification is an emerging approach in medical education, with game elements increasingly recognized for improving educational experiences [14]. From gamified anatomy and radiology curricula for medical students to featuring resident skills competitions in emergency medicine and thoracic surgery, game-based learning has demonstrated elevated interest and engagement across learners of diverse levels and specialties [9, 2830]. Our study builds on the present literature by demonstrating that gamification can also promote the use of a feedback framework among surgical faculty and residents.
Specifically in surgical fields, where surgical personalities are traditionally known to be competitive, extroverted, task-focused, and results-oriented, gamification has the potential to be particularly effective [3133]. Our findings demonstrated that faculty and residents, especially from the TACS service, were responsive to organized, team-based competition. We surmise that incorporating gamification into the feedback process may have sparked the competitive nature of surgeons, yielding increased feedback exchanges. Framing feedback in a gamified way may also make the process feel more playful than evaluative, thereby mitigating the perceived intensity of feedback exchanges for both giver and receiver. Both faculty and residents reacted favorably to our gamification approach, thus notably demonstrating its ability to captivate both cohorts involved in the feedback process. Further investigations on participants’ attitudes and perceptions, specifically surrounding gamification, may provide deeper insight into the broader impact of gamification on the feedback culture within surgical training.
Actively engaging educators and learners through competition draws upon the extrinsic motivation of competition to stimulate the intrinsic motivation of self-directed learning [4, 34]. Although surgical faculty and residents often possess strong internal drive and discipline, the demands and pressures of the surgical learning environment can still be overwhelmingly difficult to overcome to sustain high-quality feedback. Incorporating game design elements, such as team-based competition, can serve as both an extrinsic motivator and a regular prompt to encourage participation in effective feedback practices, thus making this a less burdensome challenge. Various game-based learning strategies have been applied in surgical education to boost learners’ internal motivation and educational engagement. Positive effects of gamification have been reported in areas such as robotic simulation training and preparing for the American Board of Surgery In-Training Examination (ABSITE) and American Board of Surgery (ABS) qualifying exam [3537]. Conversely, other investigations have shown no improvement in assessment scores and even negative effects, including learner fatigue, demotivation, and attrition [4, 3839]. Thus, research on gamification in medical education remains variable and context-dependent, with a paucity of literature and underutilization of gamification tactics specific to the surgical environment. Future efforts can explore the conditions under which gamification is most effective.
The landscape of surgical training and education continues to evolve. The transition to competency-based medical education and implementation of entrustable professional activities (EPAs) is a transformative movement in graduate medical education that will require time, buy-in, and motivation from faculty and residents to be carried out meaningfully. Promoting cross-specialty competition, creating short-term wins, and recognizing high and low performers are all gamification processes employed in the successful EPA implementation at an academic institution [40]. Adopting gamified models in educational curricula has the potential to stimulate learning-related behavior, augment learner engagement and motivation, and subsequently, accelerate skills training and mastery compared to traditional pedagogical methods. The effective integration of feedback and EPAs can generate valuable opportunities for both educators and learners. While our study showed that competition enhanced the use of a feedback framework, additional work is needed to examine how gamified models influence resident knowledge, skills, and satisfaction. Gamified learning in today’s surgical environment remains a promising area for exploration with significant opportunities to enrich the educational experience for all.
This study should be interpreted in light of several limitations. Firstly, we acknowledge the sample size from a single academic institution may restrict the generalizability of our findings. Further work can expand across specialties and learners of varying structural and cultural contexts. Additionally, although the postoperative surveys were intended to capture use of the feedback framework and represent instances of feedback delivery, responses may not have always reflected actual feedback delivery. It will be worthwhile for future research to distinguish framework utilization from feedback encounters. Moreover, it is important to note that competition itself may shift motivation away from feedback and learning, thus diverting the focus from the educational value to be gained from feedback interactions. Identifying the appropriate balance between intrinsic and extrinsic motivators, as well as the optimal timing of game-based strategies, will be essential to ensure the meaningful adoption of gamified learning for its intended outcomes. Despite these limitations, our study provides a foundation for further exploration of gamification in surgical education, including its effects on knowledge retention, skills development, sustainability, and culture. It will be of paramount importance to understand which game elements best align with specific audiences, environments, objectives, and outcomes in the education community.
Conclusions
Providing formative feedback for surgical residents remains an ongoing challenge. Many surrounding pressures of the surgical learning environment can impede effective feedback encounters. Gamification offers a practical approach to promote both educator and learner engagement with more impactful feedback. Targeted game-based initiatives, much like ours, have the potential to transform the culture of feedback in meaningful ways and support the advancement of residents into confident and competent practice-ready surgeons.
Fig. 1
Example Poster of the Framework and QR Codes
Click here to Correct
Table 1. Participant Characteristics
A
 
Faculty
  
Residents
 
Pre, n (%)
Post, n (%)
  
Pre, n (%)
Post, n (%)
Total respondents
11
15
 
Total respondents
25
35
Male
10 (90.9)
9 (60.0)
 
Male
11 (44.0)
18 (51.4)
Female
1 (9.1)
6 (40.0)
 
Female
14 (56.0)
17 (48.6)
Years in practice
   
PGY level
  
< 5 years
3 (27.3)
4 (26.7)
 
PGY1
8 (32.0)
13 (37.1)
5–10 years
1 (9.1)
2 (13.3)
 
PGY2
4 (16.0)
3 (8.6)
> 10 years
7 (63.6)
9 (60.0)
 
PGY3
7 (28.0)
7 (20.0)
    
PGY4
4 (16.0)
5 (14.3)
    
PGY5
2 (8.0)
7 (20.0)
Abbreviations: PGY, post-graduate year
A
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
A
Data availability statement
The data that support the findings of this study are not publicly available and are available from the corresponding author upon reasonable request.
References
1.
Van Gaalen AEJ, Brouwer J, Schönrock-Adema J, et al. Gamification of health professions education: a systematic review. Adv Health Sci Educ Theory Pract. 2021;26(2):683–711. doi: 10.1007/s10459-020-10000-3.
2.
Singhal S, Hough J, Cripps D. Twelve tips for incorporating gamification into medical education. MedEdPublish. 2019;8:216. doi: 10.15694/mep.2019.000216.1
3.
Gentry SV, Gauthier A, L'Estrade Ehrstrom B, et al. Serious Gaming and Gamification Education in Health Professions: Systematic Review. J Med Internet Res. 2019;21(3):e12994. doi: 10.2196/12994.
4.
Rutledge C, Walsh CM, Swinger N, et al. Gamification in Action: Theoretical and Practical Considerations for Medical Educators. Acad Med. 2018;93(7):1014–1020. doi: 10.1097/ACM.0000000000002183.
5.
Wang YF, Hsu YF, Fang KT, Kuo LT. Gamification in medical education: identifying and prioritizing key elements through Delphi method. Med Educ Online. 2024;29(1):2302231. doi: 10.1080/10872981.2024.2302231.
6.
Petrucci AM, Kaneva P, Lebedeva E, et al. You have a message! Social networking as a motivator for FLS training. J Surg Educ. 2015 May-Jun;72(3):542–8. doi: 10.1016/j.jsurg.2014.10.007.
7.
Van Nuland SE, Roach VA, Wilson TD, Belliveau DJ. Head to head: The role of academic competition in undergraduate anatomical education. Anat Sci Educ. 2015 Sep-Oct;8(5):404–12. doi: 10.1002/ase.1498.
8.
Nevin CR, Westfall AO, Rodriguez JM, et al. Gamification as a tool for enhancing graduate medical education. Postgrad Med J. 2014;90(1070):685–93. doi: 10.1136/postgradmedj-2013-132486.
9.
Gue S, Ray J, Ganti L. Gamification of graduate medical education in an emergency medicine residency program. Int J Emerg Med. 2022;15(1):41. doi: 10.1186/s12245-022-00445-1.
10.
Szeto MD, Strock D, Anderson J, et al. Gamification and Game-Based Strategies for Dermatology Education: Narrative Review. JMIR Dermatol. 2021;4(2):e30325. doi: 10.2196/30325.
11.
McCutcheon S, Duchemin AM. Overcoming barriers to effective feedback: A solution-focused faculty development approach. Int J Med Educ. 2020;11:230–2. doi: 10.5116/ijme.5f7c.3157.
12.
Reddy ST, Zegarek MH, Fromme HB, et al. Barriers and facilitators to effective feedback: A qualitative analysis of data from multispecialty resident focus groups. J Grad Med Educ. 2015;7(2):214–9. doi: 10.4300/JGME-D-14-00461.1.
13.
Pugh CM, DaRosa DA, Glenn D, Bell RH Jr. A comparison of faculty and resident perception of resident learning needs in the operating room. J Surg Educ. 2007;64(5):250–5. doi: 10.1016/j.jsurg.2007.07.007.
14.
Jensen AR, Wright AS, Kim S, Horvath KD, Calhoun KE. Educational feedback in the operating room: A gap between resident and faculty perceptions. Am J Surg. 2012;204(2):248–55. doi: 10.1016/j.amjsurg.2011.08.019.
15.
McKendy KM, Watanabe Y, Lee L, et al. Perioperative feedback in surgical training: A systematic review. Am J Surg. 2017;214(1):117–26. doi: 10.1016/j.amjsurg.2016.12.014.
16.
Trehan A, Barnett-Vanes A, Carty MJ, et al. The impact of feedback of intraoperative technical performance in surgery: A systematic review. BMJ Open. 2015;5(6):e006759. doi: 10.1136/bmjopen-2014-006759.
17.
Onuoha O, Heins SJ, Clapp JT, et al. Improving formative feedback in the operating room setting: Developing and implementing an initiative to improve feedback quality and culture. Acad Med. 2022;97(2):222–227. doi: 10.1097/ACM.0000000000004229.
18.
Bello RJ, Sarmiento S, Meyer ML, et al. Understanding surgical resident and fellow perspectives on their operative performance feedback needs: A qualitative study. J Surg Educ. 2018;75(6):1498–1503. doi: 10.1016/j.jsurg.2018.04.002.
19.
Bohnen JD, George BC, Williams RG, et al. The feasibility of real-time intraoperative performance assessment with SIMPL (System for Improving and Measuring Procedural Learning): Early experience from a multi-institutional trial. J Surg Educ. 2016;73(6):e118-e130. doi: 10.1016/j.jsurg.2016.08.010.
20.
Eaton M, Scully R, Schuller M, et al. Value and barriers to use of the SIMPL tool for resident feedback. J Surg Educ. 2019;76(3):620–627. doi: 10.1016/j.jsurg.2019.01.012.
21.
Deal SB, Scully RE, Wnuk G, George BC, Alseidi AA. Crowd-sourced and attending assessment of general surgery resident operative performance using global ratings scales. J Surg Educ. 2020;77(6):e214-e219. doi: 10.1016/j.jsurg.2020.07.011.
22.
Harriman D, Singla R, Nguan C. The resident report card: A tool for operative feedback and evaluation of technical skills. J Surg Res. 2019;239:261–268. doi: 10.1016/j.jss.2019.02.006.
23.
Roberts NK, Williams RG, Kim MJ, Dunnington GL. The briefing, intraoperative teaching, debriefing model for teaching in the operating room. J Am Coll Surg. 2009;208(2):299–303. doi: 10.1016/j.jamcollsurg.2008.10.024.
24.
Shaughnessy MP, Ahle SL, Oliveira K, Longo WE, Yoo PS. Improving satisfaction with operating room feedback: An effective, low-profile, no-cost intervention. J Surg Educ. 2019 Nov-Dec;76(6):e138-e145. doi: 10.1016/j.jsurg.2019.10.002.
25.
Zhou NJ, Kamil RJ, Hillel AT, et al. The role of preoperative briefing and postoperative debriefing in surgical education. J Surg Educ. 2021 Jul-Aug;78(4):1182–1188. doi: 10.1016/j.jsurg.2020.11.001.
26.
Moore MD, Abelson JS, O'Mahoney P, Bagautdinov I, Yeo H, Watkins AC. Using GoPro to Give Video-Assisted Operative Feedback for Surgery Residents: A Feasibility and Utility Assessment. J Surg Educ. 2018 Mar-Apr;75(2):497–502. doi: 10.1016/j.jsurg.2017.07.024.
27.
McKendy KM, Watanabe Y, Lee L, et al. Perioperative feedback in surgical training: A systematic review. Am J Surg. 2017;214(1):117–126. doi: 10.1016/j.amjsurg.2016.12.014.
28.
Ang ET, Chan JM, Gopal V, Li Shia N. Gamifying anatomy education. Clin Anat. 2018;31(7):997–1005. doi: 10.1002/ca.23249.
29.
Bouthillier M, Canil A, Cheng BYC, Lebel K, Dobson JL. Inaugural Pan-Canadian RADGames: Results From a Successful Approach to Radiology Education for Medical Students. Acad Radiol. 2023;30(1):113–121. doi: 10.1016/j.acra.2022.07.005.
30.
Mokadam NA, Lee R, Vaporciyan AA, et al. Gamification in thoracic surgical education: Using competition to fuel performance. J Thorac Cardiovasc Surg. 2015;150(5):1052–8. doi: 10.1016/j.jtcvs.2015.07.064.
31.
Sier VQ, Schmitz RF, Schepers A, van der Vorst JR. Exploring the surgical personality. Surgeon. 2023;21(1):1–7. doi: 10.1016/j.surge.2022.01.008.
32.
Hoffman BM, Coons MJ, Kuo PC. Personality differences between surgery residents, nonsurgery residents, and medical students. Surgery. 2010;148(2):187–93. doi: 10.1016/j.surg.2010.04.005.
33.
Thomas JH. The surgical personality: fact or fiction. Am J Surg. 1997;174(6):573–7. doi: 10.1016/s0002-9610(97)00208-0.
34.
Kirsch J, Spreckelsen C. Caution with competitive gamification in medical education: unexpected results of a randomised cross-over study. BMC Med Educ. 2023;23(1):259. doi: 10.1186/s12909-023-04258-5.
35.
Nakamoto K, Jones DB, Adra SW. Gamification of robotic simulation to train general surgery residents. Surg Endosc. 2023;37(4):3136–3144. doi: 10.1007/s00464-022-09520-3.
36.
Hancock KJ, Klimberg VS, Williams TP, Tyler DS, Radhakrishnan R, Tran S. Surgical Jeopardy: Play to Learn. J Surg Res. 2021;257:9–14. doi: 10.1016/j.jss.2020.07.050.
37.
McAuliffe JC, McAuliffe RH Jr, Romero-Velez G, Statter M, Melvin WS, Muscarella P 2nd. Feasibility and efficacy of gamification in general surgery residency: Preliminary outcomes of residency teams. Am J Surg. 2020;219(2):283–288. doi: 10.1016/j.amjsurg.2019.10.051.
38.
Hakulinen L, Auvinen T, Korhonen A. Empirical study on the effect of achievement badges in TRAKLA2 online learning environment. In: Learning and Teaching in Computing and Engineering (LaTiCE), 2013. IEEE Explore Digital Library:47–57. http://ieeexplore.ieee.org/document/6542238/. doi: 10.1109/LaTiCE.2013.34
39.
Chang TP, Doughty CB, Mitchell D, et al. Leveraging Quick Response Code Technology to Facilitate Simulation-Based Leaderboard Competition. Simul Healthc. 2018;13(1):64–71. doi: 10.1097/SIH.0000000000000281.
40.
Stahl CC, Collins E, Jung SA, et al. Implementation of Entrustable Professional Activities into a General Surgery Residency. J Surg Educ. 2020 Jul-Aug;77(4):739–748. doi: 10.1016/j.jsurg.2020.01.012.
Total words in MS: 2511
Total words in Title: 0
Total words in Abstract: 239
Total Keyword count: 4
Total Images in MS: 1
Total Tables in MS: 3
Total Reference count: 40