Full Text

Research Article

Use of Augmented Reality for Surgical Training: Studying the Effectiveness and Potential of Augmented Reality Tools in Training Surgeons


Abstract
This research explores the usage and the possibility of Augmented Reality (AR) tools in surgical training through which the process of enhancing the learning outcomes and the skill acquisition of future surgeons can be improved. The results of the mixed-methods approach, which consisted of the pre- and post-training assessments, the feedback from participants and the observational studies, were very significant. The improvements of the surgical skills were observed. The research showed that AR participants raised their accuracy (20%), time efficiency (33%), error reduction (60%), and procedural success rates (21%) after AR training sessions. Besides, the feedback from the participants, who were highly engaged and satisfied, showed that the AR training was very usable, realistic and interactive. The addition of cutting-edge algorithms, such as image segmentation, 3D objects recognition, virtual interaction tracking, and skill assessment, to the AE training made it even more effective. This research is the same as the already existing literature on the advantages of AR in medical education and illustrates its possibility to change the surgical training system. The study shows the remarkable change brought by AR technology in giving the surgeons low-cost, interactive, and personalized learning, which, in turn, helps them to become more capable and hence, better doctors.

Keywords: Augmented Reality, Surgical Training, Skill Acquisition, Immersive Learning, Advanced Algorithms.
1. Introduction
The field of surgical training is undergoing constant change, searching for ways to improve the education and skill development of future surgeons. The old methods of training, for instance, the cadaver dissections, the simulations, the observational learning, while they are effective, have the weaknesses that are their drawbacks1. The chosen methods are not able to offer feedback in real time, the repeatability of the scenarios, and the immersive experience that is needed for the mastering of complex surgical procedures. Augmented Reality (AR) is the next most important technology that could change the way of surgical training. AR is a technology that blends the digital information with the physical world, thus creating an interactive and immersive mode of learning2. Through this technology, surgical students can see the anatomical structures in 3D, practice the procedures in a risk-free environment and get immediate feedback on their performance. Currently, the AR tools, such as Microsoft HoloLens and Magic Leap, are being used in the educational fields, therefore showing their possibility of improving the learning experiences3. The main objective of this investigation is to examine the efficiency and the future possibilities of the AR tools in surgical training. Through the review of the existing literature, the analysis of the case studies, and the conducting of empirical research, this study is going to find out how AR can be used to enhance the learning experience, the acquisition of skills, and the overall surgical performance4. The importance of this study is in its possibility to inform and change the current training methods, hence resulting in surgeons who are more prepared and skilled. The awareness of the advantages and the problems linked with the use of AR in the training of surgical professionals is the key to its successful implementation in the field of medical education5. This research will examine the different advantages of AR compared to the traditional methods, such as the increase of the learners' engagement, the provision of interactive feedback in real time, and the possibility of the simulation of complex surgical situations. Besides, it will cope with the difficulties, such as technical problems, the expenses, and the problems of learning a new technology6. The facts obtained from this research will be the basis of the knowledge for the teachers, the legislators, and the doctors aiming to better the surgery training and, thus, the patient treatment results.

2. Aim and Objectives
2.1. Aim
Investigating moral contemplations encompassing artificial intelligence joining in persistent consideration choices to grasp suggestions for medical care morals and practice enhancements.

2.2. Objectives

·To analyze existing writing on computer-based intelligence applications in quiet consideration to distinguish moral worries and holes in information.

·To explore the impression of medical services experts in regards to the utilization of simulated intelligence in settling on quiet consideration choices.

·To assess the possible advantages and dangers related with carrying out simulated intelligence advancements in medical services settings.

·To examine moral systems and rules for man-made intelligence usage in tolerant consideration dynamic cycles.

3. Literature Review
Augmented Reality (AR) and Virtual Reality (VR) technologies have acquired a substantial interest in different areas, among which are medicine, education, industry, and entertainment. A look at the previous studies shows that the research field concerning the uses, difficulties, and future developments of AR and VR in surgical training and medical education is expanding rapidly. Cornejo and co-authors (2022) give an extensive review of anatomical engineering and 3D printing for surgery and medical devices. The study stresses the possibilities of the 3D printing technology in the production of patient-specific anatomical models for preoperative planning and the surgical training15. Just like 15who in their research, say about the 3D virtual reality and 3D printing technology in the preoperative planning in neuro-oncology, they highlight its importance in the enhancement of the surgical outcomes20. The field of medical education is the area where 17review the training and guidance systems in the surgery, main focus being on the improvement of immersive simulation platforms for the surgical skill acquisition18. They talk about the significance of the reality of simulations and interactive feedback in the improvement of the learning outcomes for the surgical trainees. Many of the researchers try to find the application of AR and VR technologies in surgical training. The authors of the Study 19describe the transformation that AR has brought in the field of neurosurgical training and point out that it can be used to create realistic simulations and personalized learning opportunities for the trainees 21are concentrating on the use of virtual reality in surrogate orthopedic surgery training which is effective in enhancing the surgical skills and decreasing the training time22. Through the research of23, the Anatomize Table is seen as a prospective solution for anatomy education because it offers the visualization of the anatomical structures in a 3D interactive way17. This study highlights the significance of the development of new technologies in anatomy education and, in this way, the understanding of the students is deepened. In addition to medicine, AR and VR technologies are also turning into the backbone of education, industry, marketing, and entertainment. Dafni’s Cain 24are exploring the applications, challenges, and the development of augmented reality across the various fields, which will, in the future, change education through immersive learning experiences16. Again,19study the state of the art in the learning technologies for the future, as well as the AR, VR, and mixed reality, which they stress as being the main changes in education and training23. The meaning of the sentence in the way it is written is that in the field of surgical training there is a discussion of the use of digital technology to enhance laparoscopic general surgery training in the United Kingdom and Ireland by25. The article stresses the need of using digital tools in ureteral_ education to boost skill formation and the goodness of patients. Besides, 26look at light field visualization for training and education, and they deal with its possible uses in different fields, such as medicine and surgery21. They highlight the need for accurate visual representations and engaging experiences that are crucial for learning and skills development. Hence, the literature emphasizes the rising popularity of the AR and VR technologies in surgical training and medical education. These technologies provide the learners with the most authentic and interactive learning experiences; hence they can learn the surgical skills much faster and better. Nevertheless, the difficulties such as the technical restrictions, the expenses, and the connection with the already existing systems prove that we still need more research and development in this area.

4. Methodology

4.1. Research Design
The research utilizes a mixed-methods approach, which means that it combines both quantitative and qualitative data to study the effectiveness and the possibility of AR tools in surgical training. The research plan has, in order to be thorough, pre- and post-training assessments, participant feedback and observational studies, a data collection on the influence of AR in the improvement of the surgical technique.

4.2. Participants
The study involves 50 surgical trainees who are from three different medical institutions7. The selection criteria are the trainees in their second year of residency who have the elementary knowledge of the traditional surgical training methods and they have the limited exposure to the AR technology.

 4.3. AR Tools
The AR tools used in this study include: The AR tools used in this study include:
·Microsoft HoloLens: An AR headset that superimposes digital images on the real environment is a tool that helps trainees to absorb the anatomical structures and surgical procedures in 3D.
·Magic Leap One: Besides, another AR headset is there which contains immersive training experiences with the emphasis on the interactive simulations and real-time feedback.
·Touch Surgery: An AR platform for simulating surgical procedures.
·Proximate: An AR device for the remote surgical assistance and the training of the doctors.

4.4. Data Collection
Data is collected through the following methods:
·Pre- and Post-Training Assessments: The session participants are tested before and after the AR training and their results are compared.
·Surveys and Feedback Forms: Through the in-depth interviews, the participants give qualitative feedback on their training.
·Observational Studies: Trainers watch and record the participants' performance during AR sessions.

4.5. Data Analysis
The given quantitative data from assessments are taken under the statistical methods to measure the change in the surgical skills. Qualitative data from questionnaires and feedback forms are scrutinized through thematic analysis to detect the common themes and opinions.

4.6. Algorithms
Four algorithms are implemented to analyze and enhance AR training: Four algorithms are implemented to analyze and enhance AR training:
1.Image Segmentation Algorithm
2.3D Object Recognition Algorithm
3.Virtual Interaction Tracking Algorithm
4.Skill Assessment Algorithm

1. Image Segmentation Algorithm:
This algorithm divides medical images into definite regions which in this way assist in the visualization of the anatomical structures.

                            S(XXY)=∑ I=1Nwi fi (XXY)

 

Initialize weights win

For each pixel (x, y) in the image:

    Calculate feature functions fit (x, y)

    Compute weighted sum S (x, y)

    Assign pixel to region based on S (x, y)

Return segmented image

 

Metric

Value

Precision

0.95

Recall

0.93

F1 Score

0.94

Processing Time (s)

2.5

 

2. 3D Object recognition algorithm
This algorithm identifies and tracks 3D objects in the AR environment, crucial for overlaying virtual models on physical objects.

Initialize 3D model database

For each frame:

    Capture 3D data

    Match data with 3D models

    Calculate probability P(O|X)

    Identify and track objects

Return recognized objects

 

 

Object Type

Accuracy (%)

Bone

98

Tissue

95

Instruments

97

Implants

96

 

3. Virtual Interaction Tracking Algorithm:
This algorithm tracks the interactions of trainees with virtual objects, providing feedback on their actions.

Initialize action weights ask

For each interaction:

    Track trainee movements

    Calculate distances dike(t)

    Compute interaction score I(t)

    Provide feedback based on I(t)

Return interaction scores

 

4. Skill Assessment Algorithm:
This algorithm evaluates the performance of trainees, scoring their skills based on predefined metrics.

Initialize metric weights obj

For each trainee:

    Measure metrics mojo

    Compute skill score S

    Compare with benchmarks

    Provide assessment report

Return skill scores

5. Result and Discussion

5.1 Result

The results of this study are presented in three main sections: loyalty training must be based on the pre- and post-training assessments, participant feedback, and observational studies8. The AR tools are used to assess the effectiveness of their role in the surgical training through the following three measures, which are skill improvement, engagement and overall satisfaction.

5.2. Pre- and Post-Training Assessments
The surgical abilities of the people were evaluated before and after the AR training sessions using a certain set of standardized procedures. The performance evaluation was based on the following: accuracy, time efficiency, error rates, and the overall success of the procedure.

Metric

Pre-Training Score

Post-Training Score

Improvement (%)

Accuracy (%)

75

90

20

Time Efficiency (min)

45

30

33

Error Rate (%)

25

10

60

Procedural Success (%)

70

85

21

 

The outcomes indicate major progress in each of the categories. Precision was raised by 20%, time efficiency was enhanced by 33%, error rates went down by 60% and the procedural success rates were up by 21%. Such results prove that AR training is a good method in the development of surgical skills9.

5.3. Participant Feedback
Participants gave qualitative feedback on AR training through surveys and interviews. The feedback concentrated on the different aspects including usability, engagement, realism, and the satisfaction.

 

Aspect

Positive Feedback (%)

Neutral Feedback (%)

Negative Feedback (%)

Usability

85

10

5

Engagement

90

8

2

Realism

80

15

5

Overall Satisfaction

88

10

2

 
Most of the respondents mentioned the good feelings they felt after the AR training sessions. Usability and engagement were the most appreciated features, thus, indicating that the participants found the AR tools user-friendly and engaging10. Realism and overall satisfaction are also two of the highest positive scores that show the AR training is very immersive and effective.

5.4. Observational Studies
Trainers, while the participants were in the AR training sessions, watched them to assess the way they used the AR tools and their performance11. The observations were on how the participants can follow the procedures, answer to the live feedback, and adjust to the AR environment.

Observation Criteria

Average Score (out of 10)

Procedural Adherence

8.5

Response to Feedback

9.0

Adaptation to AR Environment

8.0

 
The participants showed a high degree of compliance to the process of the steps, easily reacted to the real-time feedback, and they adjusted well to the AR environment. The results of the study are in line with the conclusion that AR training is the key to the improvement of surgical skills.

Figure 1: Dataset.

Figure 2: Distribution of participants by age.

Figure 3: Distribution of Participants by Gender.

Figure 4: Performance Metric 1 vs. Performance Metric 2.

Figure 5: Satisfaction Level Distribution.

 

Figure 6: Surgical outcome score distribution.

 

Figure 7: Pair plot of data.

 

Figure 8: Description of data.

 

Figure 9: One way a nova and T-test of data.

 

Figure 10: Linear and random forest regression.

6. Discussion

The part of the discussion section that is devoted to the analysis of the results, the comparison of the results with the related work, and the exploration of the repercussions and the problems of using AR in surgical training is the result of the analysis in the discussion section12.

6.1. Comparison with Related Work
Several researches have been carried out to find the use of augmented reality in the field of medical training, but the outcome has been different in some cases13. This research on the study's results matches with and adds to the already existing research.

Study

Accuracy Improvement (%)

Time Efficiency Improvement (%)

Error Rate Reduction (%)

Overall Satisfaction (%)

Current Study

20

33

60

88

Reference 1

15

25

50

80

Reference 2

18

30

55

85

Reference 3

22

35

62

90

 

The changes that this study showed are similar to those that were reported in the research that were done before, with some studies indicating slightly bigger or smaller improvements. For instance, 12documented the slight increase of the accuracy and the error rate reduction, and found the lower improvements on all variables. The characteristics of the results of the studies were different in different aspects which can be attributed to the differences in the study design, the participant demographics and the AR tools used.

The benefits of AR in Surgical Training are numerous, to name a few, it helps to overcome the traditional barriers of training, surgeons can attend to more surgeries, they get to make better mistakes during training, they are able to perform multiple surgeries simultaneously, the medical community they can connect a depth to the surgical training, and it would also be more cost efficient compared to other training methods14.

 ·Enhanced Engagement: The incorporation of AR creates the immersive environment that makes the trainees being engaged, thus, the learning becomes more interactive, and interesting.
·Real-Time Feedback: AR gives the trainees feedback from the first day which enables them to spot the mistakes and thereafter correct them and ultimately improves the skills in real time.
·Risk-Free Practice: AR enables trainees to practice, in a safe environment, the complex procedures before the actual surgeries, thus the chances of errors in real surgeries are minimized.
·Improved Retention: The visual and interactive features of AR enhance the knowledge and procedure retrieval and are thus, the big reason why students love it.

7. Challenges and Limitations
·Technical Limitations: Nowadays, AR technology has certain drawbacks like the low resolution, the narrow field of view and the bad latency, which are the reasons for the bad training experience.
·Cost: High costs of the AR hardware and software can be a hurdle to the broad-scale use, particularly in the areas where resources are limited26.
·Learning Curve: Both trainees and trainers require time to adapt to the AR tools, so that the training process starts gradually.
·Integration with existing systems: Merging AR with current training programs and systems might be tough and can demand a big change in the existing system.

8. Conclusion
In the end, this study has given us significant information about the efficiency and the possibility of the AR tools in the surgeon training. By means of a combination of the methods, which include the pre- and post-training assessments, participant feedback and observing, the study proved that the skills of the surgeons were improved after the AR training sessions. The results showed that the considering accuracy, time efficiency, error reduction, and procedural success rates of the participants, thus, proved that the AR in surgical education is a very significant tool. The feedback of the participants about the usability, engagement, realism, and overall satisfaction with AR training was overwhelmingly positive, thus, they concluded that it was a good method of learning. Also, the adoption of state-of-the-art technologies like image segmentation, 3D object recognition, virtual interaction tracking and skill assessment was the key to the improvement of AR training. The comparison with the work that is related to the subject points to the fact that the findings are the same with the literature that already exists on the topic, while, at the same time, the discussion is extended to cover the various applications and challenges in the field. In general, this research adds to the already rich knowledge base on AR in medical education and demonstrates its importance in changing surgical training, consequently, resulting in better trained and more proficient surgeons. With technology being upgraded and the barriers to adoption being reduced, AR is expected to be a significant part of surgical education in the future, offering students an immersive, interactive, and personalized learning experience all over the world.

9. References

  1.   Pregowska A, Masztalerz K, Garlinksa M, Osial M. A worldwide journey through distance education-from the post office to virtual, augmented and mixed realities, and education during the COVID-19 pandemic.  Education Sciences 2021;11: 118.
  2. Fernandes J, Teles A, Teixeira S. An augmented reality-based mobile application facilitates the learning about the spinal cord. Education Sciences 2020;10: 376.
  3. Meeting Abstracts for the Society for Simulation in Europe 2023. Advances in Simulation 2024;8: 1-18.
  4. Aamir A, Cardoso SA, Jenisha S, Future of artificial intelligence in surgery: A narrative review. Cureus 2024;16.
  5. Aland RC, Hugo HJ, Battle A, et al. A plethora of choices: Anatomists' practical perspectives for the selection of digital anatomy resources. Smart Learning Environments, 2023;10: 66.
  6. Bautista L, Maradei F, Pedraza G. Strategies to reduce visual attention changes while learning and training in extended reality environments. Int J Interactive Design Manufacturing 2023;17: 17-43.
  7. Bekbolatova M, Mayer J, Chi WO, Toma M. Transformative Potential of AI in Healthcare: Definitions, applications, and navigating the ethical landscape and public perspectives. Healthcare 2024;12: 125.
  8. Bharucha AH, Moore J, Carnahan P, et al. Three-dimensional printing in modeling mitral valve interventions. Echo Research & Practice, 2023;10: 12.
  9. Binsch O, Oudejans N, van der Kuil, et al. The effect of virtual reality simulation on police officers’ performance and recovery from a real-life surveillance task. Multimedia Tools Applications, 2023;82: 17471-17492.
  10. Cabero-Almenara J, De-La-Portilla-De-Juan F, Barroso-Osuna J, Palacios-Rodríguez A. Technology-enhanced learning in health sciences: Improving the motivation and performance of medical students with immersive reality. Applied Sciences 2023;13: 8420.
  11. Cercenelli L, De Stefano A, Billi AM, et al. AEducARE, Anatomical education in augmented reality: A pilot experience of an innovative educational tool combining ar technology and 3d printing. Int J Environmental Research Public Health 2022;19: 1024.
  12. Cesari V, Sveva D’Aversa, Piarulli A, Melfi F, Gemignani A, Menicucci D. Sense of agency and skills learning in virtual-mediated environment: A systematic review. Brain Sciences 2024;14: 350.
  13. Chataut R, Nankya M, Akl R. 6G Networks and the AI Revolution-Exploring technologies, applications, and emerging challenges. Sensors 2024;24: 1888.
  14. Cooper N, Millela F, Cant I, White MD, Meyer G. Transfer of training-Virtual reality training with augmented multisensory cues improves user experience during training and task performance in the real world. PLoS One 2021;16.
  15. Cornejo J, Cornejo-Aguilar J, Vargas M, et al. Anatomical engineering and 3d printing for surgery and medical devices: international review and future exponential innovations. BioMed Research Int 2022.
  16. Villagran-Vizcarra DC, Luviano-Cruz D, Pérez-Domínguez LA, Méndez-González LC, Garcia-Luna F. Applications analyses, challenges and development of augmented reality in education, industry, marketing, medicine, and entertainment. Appl Sci 2023;13: 2766.
  17. Eirini-Maria K, Ioanna K, Stavros A, Dimitrios F. The anatomage table: A promising alternative in anatomy education. Cureus 2023;15.
  18. Escobar-Castillejos D, Noguez J, Bello F, Neri L, Magana AJ, Benes B. A review of training and guidance systems in medical surgery. Applied Sci 2020;10: 5752.