Skip to main content

The heterogeneous distribution of surgical techniques, as well as the different degrees of specialization acquired through practice and experience, underscores the critical importance of collaborations among surgical personnel in maintaining an accessible and high-quality healthcare system. This is even more remarkable when referring specifically to surgeons, given the high complexity of the tasks they perform and the challenges involved in training and transmitting these skills.

In this context, mSurgery technology emerges as a game-changer, expanding the physical boundaries of the operating room (OR) by facilitating remote assistance for trainees or specialized interventions. This innovative technology opens doors to expert professionals worldwide, breaking down geographical barriers and associated costs.

Real-Time Bidirectional Communication

The mSurgery platform facilitates seamless streaming and bidirectional communication in real time, boasting a minimal latency of less than 400 ms*. It is distinguished by its ability to connect a wide variety of video sources directly from the OR (medical equipment, integrated systems, etc.), allowing for the simultaneous and synchronized viewing of multiple video sources. The technical complexity lies not only in the ability to transmit real-time images from devices such as endoscopes or the console of a Intuitive‘s da Vinci surgical robot but also in presenting these images, with minimal latency and maximum resolution, at qualities of up to 4K. Moreover, it is accessible through various devices such as virtual reality glasses, computers, tablets, or mobile phones with internet connectivity, without the need for installing specific applications, as the platform is entirely web-based. The ability to transmit all details in real-time from the OR provides a comprehensive context of what is happening in the operating room, providing extensive information to remote participants.

Dynamic and Interactive Collaborations

The platform features a dynamic grid that allows the leading surgeon to configure the different elements displayed during the intervention, including videos of medical equipment, 360-degree cameras, stereoscopic videos, first-person cameras, and even 3D models. These configurations are entirely dynamic and can be modified in real-time, offering the possibility to display one or multiple images simultaneously, change video sources, and adjust the size of each grid to facilitate concentration on specific details. Additionally, this grid includes a virtual whiteboard where digital annotations can be made to enhance communication and understanding.

Fig. 1 Dynamic grid and digital whiteboard.  Video sources: participant cameras, Da Vinci console, lead surgeon at the controls of the surgical robot and 360 camera of the entire operating room.

First-Person View: Share the Lead Surgeon’s Experience

mSurgery recognizes the importance of the first-person view as a key point in the success of remote collaborations, sharing exactly the same perspective as the lead surgeon without additional obstacles. This ensures the reliability of recommendations and instructions shared by remote participants, directly impacting patient safety. To achieve this, in addition to capturing the field of view of the lead surgeon through surgical robots or endoscopic cameras, the mSurgery platform integrates the ability to use augmented reality glasses that provide a first-person view in traditional open-field surgeries. Through powerful software tools, mSurgery offers the possibility to experience the same viewpoint of the surgeon during the intervention, all in real-time, generating an unprecedented, shared experience.

Fig. 2 Surgeons using augmented reality glasses during traditional open-field surgery.

Immersive Technologies: Dive into the Operating Room

By using 360-degree immersive cameras and technologies such as virtual reality, augmented reality, and mixed reality developed in mSurgery, a fully immersive experience is enabled, taking the capabilities of remote collaborations to another level. With mSurgery, we offer a collaborative telepresence sensation that emulates the reality of being present in the operating room.

Connectivity: Accessible Wherever You Are

The mSurgery platform not only accommodates a diverse array of connectivity models but also ensures versatility in its usage. It seamlessly operates through Ethernet or 4G/5G mobile networks, extending its reach to remote or inaccessible areas where conventional coverage may be lacking. Moreover, it can utilize satellite networks like Starlink (SpaceX) to ensure connectivity, even in remote or inaccessible areas, expanding its reach and accessibility. Furthermore, the platform showcases its adaptability by adjusting transmission to maintain optimal latency and image quality, even under challenging connectivity scenarios. This commitment to flexibility and reliability fosters a conducive environment for secure, stable, and accessible collaborations.

Conclusions

Its ability to integrate a wide variety of information sources directly from the OR, as well as the possibility of transmitting all this information in real-time, dynamically and interactively, while maintaining high quality and through the use of immersive technologies, places mSurgery at the forefront of current collaborative technologies, presenting a wide range of functionalities and revolutionizing the concept of remote surgical collaborations as we know them.