Telesurgery with cognitive 3D model guidance during robot-assisted partial nephrectomy: first experience across Europe | Sica | Uro-Technology Journal

Open Access | Case Report
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Telesurgery with cognitive 3D model guidance during robotassisted partial nephrectomy: first experience across Europe


Michele Sicaa, *,#, Juliette Mezierea,#, Daniele Amparorea, Paolo Verria, Federico Piramidea, Gabriele Volpib, Sabrina De Cillisa,
Alberto Bredac, Alexandre Mottried, Francesco Porpigliaa,¶, Enrico Checcuccib,¶

a Department of Oncology, Division of Urology, University of Turin, San Luigi Gonzaga Hospital, Turin, Italy.
b Department of Urology, Fundació Puigvert, Autonomous University of Barcelona, Barcelona, Spain.
c Department of Urology, OLV Hospital, Aalst, Belgium; ORSI Academy, Melle, Belgium.
d Department of Surgery, Candiolo Cancer Institute, FPO-IRCCS, Candiolo, Turin, Italy.

# These authors contributed equally to the first authorship.
These authors contributed equally to the senior authorship.
* Corresponding author: Michele Sica
Mailing address: Department of Oncology, Division of Urology, University of Turin, San Luigi Gonzaga Hospital, Regione Gonzole, 10, 10043 Orbassano TO, Italy.
Email: michele.sica1991@gmail.com

This article belongs to the Special Issue: Nightmare and complex cases in Urology

Received: 15 January 2023 / Revised: 17 March 2023 / Accepted: 27 March 2023 / Published: 30 March 2023

DOI: 10.31491/UTJ.2023.03.007

Abstract

Telesurgery has found application in the modern era using 3D technology to improve surgical performance and organ preservation outcomes. Virtual congresses were created during the Covid-19 pandemic, giving to the participants the possibility to interact through digital platforms. This study aimed to describe the feasibility of using remotely guided telesurgery while applying 3D technology to aid the surgeon with intraoperative navigation as well as preoperative planning. The generated three-dimensional reconstruction (from the CT scan and ‘segmentation’ performed by a dedicated software) was refined by a biomedical engineer under the supervision of the urologist to obtain a detailed 3D model of the organ and surrounding structures. Intraoperatively, the 3D virtual model was displayed and consulted during the intervention by the first surgeon in a cognitive manner aimed to maximize the benefits of real-time navigation. During the Techno Urology Meeting (TUM) of 2021 we offered this technology to two surgeons using the real-time connection provided by Zoom through the Tile-Pro software while an expert surgeon from Italy aided with intraoperative navigation. The patients were aged 49 and 58 years old, respectively, while tumor maximum diameters were 60 and 30 mm for the first case, and 46 mm for the second case. No major complications occurred in either case or blood transfusion was necessary intra or postoperatively. Telementoring provided the possibility to operate with the assistance of an expert surgeon who was not present in the operating room but could virtually supervise and help during critical steps.

Keywords

Telesurgey, 3D models, robotics, kidney cancer


Introduction

The concept of “precision surgery” is intrinsic to the management of genitourinary tumors today [1]. A detailed understanding of the surgical anatomy is the key point for tailored treatment planning, especially for renal surgery and preservation of renal function, which covers a key role today [2-4].
In this context, 3D reconstruction of standard two-dimensional cross-sectional imaging has been increasingly popular as it allows a better representation and understanding of the surgical anatomy resulting in a tailor-made surgery for each patient [5].
This technology is perceived as a useful tool in patient counseling, surgical planning, and training, as it avoids the “building-in-mind” process of two-dimensional crosssectional imaging, allowing a better understanding of the anatomy, vasculature, and location of organs.
Importantly, the correct interpretation of information obtained from standard preoperative 2D images (contrastenhanced CT or MRI) requires extensive anatomical knowledge and clinical experience. In addition, the mental transformation from 2D to 3D is not a simple process. Therefore, following these principles and trying to overcome these problems, 3D technology finds its role, gradually becoming an important tool in daily clinical practice [6].
In the past, automatic rendering of 2D images resulted in low-quality 3D reconstructions, which were of little use for accurate preoperative planning or intraoperative navigation. Today, thanks to technological innovations, the development of dedicated software, and collaboration between bioengineers, radiologists, and urologists, it is possible to obtain high-definition 3D models.
Virtual 3D models have several fields of application: preoperative patient counseling (such as 3D printed models), surgical training and simulations, preoperative surgical planning, and intraoperative surgical navigation [7, 8].
Such technology, however, is currently available only in a few specialized centers, and their fruition is not common. Several studies have shown how such technology could play an essential role in preoperative planning in all settings to pursue the path of precision surgery [9-12].
In an era of technological boom and concomitant confinement due to the COVID-19 pandemic, platforms and software which allow patients’ remote management has been developed: telemedicine is one example that has invaded the urological setting as well [13, 14]. Telesurgery, which in the past had been explored for laparoscopic techniques [15] has found application in the modern era using 3D technology to improve surgical performance and to ensure organ preservation even in difficult neoplasms [16].
The COVID-19 pandemic bent all scientific circles, making not only patient management (diagnosis, treatment, follow-up) difficult, but also the scientific reports being developed through congresses. Therefore, virtual congresses where participants could interact through digital platforms for professional development were also created in this area [17]. The use of this technology confirmed the advantages related to 3D-guided surgery, as highlighted in our previous works [9, 18-20]. In particular, the surgeon was able to study the case preoperatively after sharing the model.
This study aimed to describe the feasibility of using remotely guided telesurgery by also applying 3D technology to aid the surgeon in intraoperative navigation as well as preoperative planning.

Case report

3D models creation

To realize this project, we started with the creation of the 3D model following a rigorous approach [9].
The first step is the sharing of the images on dedicated and authorized cloud platforms (www.mymedics3d.com). On such platforms it is possible to upload CT-scan DICOM images, making them accessible from anywhere in the world. Using DICOM image visualization software, it is necessary to analyze the object, select the most useful images (e.g., arterial, or late phase images of a CT scan), and modify and adjust specific parameters (e.g., image contrast and brightness) according to the needs of the project. This phase is referred to as the “preprocessing phase.” Next, a rendering of the volume is created and then “segmentation’’ is performed, which is a process being performed semi-automatically by dedicated software. At the end of the process, the generated three-dimensional reconstruction is usually refined by a biomedical engineer under the supervision of the urologist. The goal is to obtain a 3D model, a detailed reproduction of the organ and surrounding structures. This is made possible by so-called thresholding, which is based on selecting a specific range of a defined parameter (e.g., grayscale). The final steps in the process are the creation of a transcription code for visualizing the reconstruction in an interactive 3D-PDF format to improve understanding of the relationships between the tumor and surrounding structures, and the conversion of each part into stereolithographic (STL) format. Then, thanks to the same cloud platform, virtual reconstructions can be downloaded and displayed on an electronic device for use in preoperative planning (Figure 1 and 2).

Figure 1. CT-scan and 3D reconstruction of case 1.

Figure 2. CT-scan and 3D reconstruction of case 2.

Intraoperative navigation

Intraoperatively, the 3D virtual models can be displayed and consulted during the intervention by the first surgeon, in a cognitive (on-demand) manner, aimed to maximize the benefits of real-time navigation.
During the 2021 edition of the Techno Urology Meeting (TUM), taking advantage of the changeover to the virtual format of the Congress, we offered this technology to surgeons invited to operate even during procedures performed remotely.
Thanks to a real-time connection provided by Zoom (https://zoom.us), an expert 3D-model navigator was able to interact with the surgeon, modifying the virtual images displayed directly inside the robotic console, thanks to the Tile-pro software.
For the first time, two cognitive 3D robot-assisted partial nephrectomy operations were performed, guided live by one urologist expert in intraoperative navigation (D.A.) who assisted the surgeons (A.M. and A.B.) in the most difficult phases of the operation (Figure 3).

Figure 3. Intraoperative navigation with 3D models cognitive assistance.

Clinical Cases

The first case was a 49-year-old female patient. Her past medical history included arterial hypertension, dyslipidemia, and a prior appendectomy. Incidental ultrasound found two right-sided renal masses at the lower pole measuring 60 and 30 mm at the CT scan study (PADUA Score 10 and 7, R.E.N.A.L score 8 and 6). The patient was admitted to the Department of Urology O.L.V Hospital in Aalst, Belgium.
The second case was a 58-year-old male patient. His previous medical history included arterial hypertension, a history of peptic ulcer, removal of a dorsal cutaneous squamous carcinoma, and a rhino septoplasty. An incidental ultrasound finding of a right-sided renal mass was confirmed by a CT scan and a 46 mm solid right renal mass located at the inferior pole was evaluated (PADUA score 8, R.E.N.A.L. score 7). The patient was admitted to the Department of Uro-Oncology at Fundació Puigvert, Barcelona.
For both patients, consent was obtained for surgery, including the use of a telesurgery platform to remotely involve another consultant surgeon during the procedure. The connection between the sites was easy to establish and was maintained during all the procedures without the occurrence of technical issues.
The size of the tumors was respectively 60 mm and 33 mm in the first case and 46 mm in the second case. The operative time was respectively 98 min and 82 min. Blood loss was 120 cc in the first patient and 130 cc in the second one. No blood transfusion was necessary intra or postoperatively in both case. The value of hemoglobin at admission was 12.8 g/dl and the value of hemoglobin at discharge was 12.4 g/dl in the first patient and 13.3 g/dl and 13.2 g/dl in the second one, respectively. The duration of hospital stay was 4 and 5 days, respectively; the bladder catheter was removed on the 2nd postoperative day for the same patients. The characteristics of patients undergoing surgery are summarized and divided by case (case 1 patient of Fundació Puigvert and case 2 patient of OLV Hospital) in Table 1.

Table 1
Characteristics of clinical cases.

Case 1 Case 2
Preoperative Features
Sex Male Female
Age (years) 58 49
BMI 28 31.5
Age-adjusted Charlson’s Index 3 1
PADUA score 8 10 and 7 (double mass)
R.E.N.A.L. score 7 8 and 6 (double mass)
cTNM T1b T1b
Intraoperative Features
Connection time (s) 20 28
Latency time (s) 1 2
Type of Anesthesia General anesthesia General anesthesia
Type of clamping Super selective clamping Super selective clamping
Time of clamping (min) 18 14
Operative time (min) 98 82
Blood loss (ml) 120 130
Postoperative Features
Drainage removal (days) None None
Removal catheter (days) 2 2
Hospitalization (days) 4 5
Histological type RCC RCC
pTNM pT1bNxMx pT1aNxMx
Clavien-Dindo POD 0 0

Conclusions

Robot-assisted Partial Nephrectomy (RAPN) outcomes are strictly related to the surgeon’s experience and a good method of increasing the learning curve is having the opportunity to connect with more experienced surgeons.
In our series, we introduced the possibility to have 3D Tele assistance during a broadcasted RAPN provided by a skilled robotic surgeon confirming, as highlighted in our previous works, that the use of 3D Virtual Models gives the surgeon a more accurate pre- and intraoperative understanding of the renal mass nephelometry details and surgical complexity.
Surely this technology must face some issues: first, a stable and high-performance internet connection (e.g., 5G) is needed to allow the dataflow between the two parties involved. Secondly, the connection must be protected and, maybe, encrypted, to protect patients’ data from informatic attacks. Lastly, the urologist maneuvering the model, although he/she may be self-taught, would benefit from dedicated training, which could be fulfilled using the same concept of telementoring proposed for live surgery.
In conclusion, our experience suggests that telementoring with 3D models cognitive assistance can be easily performed, supporting the surgeon during the crucial steps of complex procedures such as RAPN. In the actual technology-driven era, the implementation of telesurgery will allow for reducing the physical barriers and distance avoiding the need for physical travel.

Declarations

Authors’ contributions

Sica M: Study concepts, Study design, Formal analysis and interpretation, Manuscript preparation, Manuscript editing. Meziere J: Study concepts, Study design, Formal analysis and interpretation, Manuscript preparation, Manuscript editing. Verri P: Data acquisition, Data Formal analysis. Daniele Amparore: Study design, Manuscript review. Piramide F: Data acquisition, Data Formal analysis, and interpretation. Volpi G: Data acquisition, Data Formal analysis. De Cillis S: Data Formal analysis and interpretation. Breda A: Study design, Manuscript review. Mottrie A: Study design, Manuscript review. Porpiglia F: Study concepts, Study design, Manuscript editing, Manuscript review. Checcucci E: Study concepts, Study design, Manuscript editing, Manuscript review.

Availability of data and materials

Not applicable.

Financial support and sponsorship

None.

Conflicts of interest

All authors declared that there are no conflicts of interest.

Ethical approval and consent to participate

Informed consent for publication was obtained from all patients.

References

1. Autorino R, Porpiglia F, Dasgupta P, Rassweiler J, Catto JW, Hampton LJ, et al. Precision surgery and genitourinary cancers. Eur J Surg Oncol, 2017, 43(5): 893-908. [Crossref]

2. Grivas N, Kalampokis N, Larcher A, Tyritzis S, Rha KH, Ficarra V, et al. Robot-assisted versus open partial nephrectomy: comparison of outcomes. A systematic review. Minerva Urol Nefrol, 2019, 71(2): 113-120. [Crossref]

3. Bertolo RG, Zargar H, Autorino R, Fiori C, Kaouk JH, Russo P, et al. Estimated glomerular filtration rate, renal scan and volumetric assessment of the kidney before and after partial nephrectomy: a review of the current literature. Minerva Urol Nefrol, 2017, 69(6): 539-547. [Crossref]

4. Bertolo R, Fiori C, Piramide F, Amparore D, Barrera M, Sardo D, et al. Assessment of the relationship between renal volume and renal function after minimally-invasive partial nephrectomy: the role of computed tomography and nuclear renal scan. Minerva Urol Nefrol, 2018, 70(5): 509-517. [Crossref]

5. Bertolo R, Autorino R, Simone G, Derweesh I, Garisto JD, Minervini A, et al. Outcomes of Robot-assisted Partial Nephrectomy for Clinical T2 Renal Tumors: A Multicenter Analysis (ROSULA Collaborative Group). Eur Urol, 2018, 74(2): 226-232. [Crossref]

6. Checcucci E, De Cillis S, & Porpiglia F. 3D-printed models and virtual reality as new tools for image-guided robotassisted nephron-sparing surgery: a systematic review of the newest evidences. Curr Opin Urol, 2020, 30(1): 55- 64. [Crossref]

7. Porpiglia F, Amparore D, Checcucci E, Autorino R, Manfredi M, Iannizzi G, et al. Current Use of Threedimensional Model Technology in Urology: A Road Map for Personalised Surgical Planning. Eur Urol Focus, 2018, 4(5): 652-656. [Crossref]

8. Parikh N, & Sharma P. Three-Dimensional Printing in Urology: History, Current Applications, and Future Directions. Urology, 2018, 121: 3-10. [Crossref]

9. Checcucci E, Amparore D, Pecoraro A, Peretti D, Aimar R, S DEC, et al. 3D mixed reality holograms for preoperative surgical planning of nephron-sparing surgery: evaluation of surgeons’ perception. Minerva Urol Nephrol, 2021, 73(3): 367-375. [Crossref]

10. Amparore D, Pecoraro A, Checcucci E, S DEC, Piramide F, Volpi G, et al. 3D imaging technologies in minimally invasive kidney and prostate cancer surgery: which is the urologists’ perception? Minerva Urol Nephrol, 2022, 74(2): 178-185. [Crossref]

11. Porpiglia F, Bertolo R, Checcucci E, Amparore D, Autorino R, Dasgupta P, et al. Development and validation of 3D printed virtual models for robot-assisted radical prostatectomy and partial nephrectomy: urologists’ and patients’ perception. World J Urol, 2018, 36(2): 201-207. [Crossref]

12. Checcucci E, Amparore D, Fiori C, Manfredi M, Ivano M, Di Dio M, et al. 3D imaging applications for robotic urologic surgery: an ESUT YAUWP review. World J Urol, 2020, 38(4): 869-881. [Crossref]

13. Checcucci E, De Luca S, Alessio P, Verri P, Granato S, De Cillis S, et al. Implementing telemedicine for the management of benign urologic conditions: a single centre experience in Italy. World J Urol, 2021, 39(8): 3109-3115. [Crossref]

14. Bruschi M, Micali S, Porpiglia F, Celia A, De Stefani S, Grande M, et al. Laparoscopic telementored adrenalectomy: the Italian experience. Surg Endosc, 2005, 19(6): 836-840. [Crossref]

15. Shin DH, Dalag L, Azhar RA, Santomauro M, Satkunasivam R, Metcalfe C, et al. A novel interface for the telementoring of robotic surgery. BJU Int, 2015, 116(2): 302-308. [Crossref]

16. Porpiglia F, Checcucci E, Autorino R, Amparore D, Cooperberg MR, Ficarra V, et al. Traditional and Virtual Congress Meetings During the COVID-19 Pandemic and the Post-COVID-19 Era: Is it Time to Change the Paradigm? Eur Urol, 2020, 78(3): 301-303. [Crossref]

17. Amparore D, Pecoraro A, Checcucci E, Piramide F, Verri P, De Cillis S, et al. Three-dimensional Virtual Models’ Assistance During Minimally Invasive Partial Nephrectomy Minimizes the Impairment of Kidney Function. Eur Urol Oncol, 2022, 5(1): 104-108. [Crossref]

18. Piramide F, Kowalewski KF, Cacciamani G, Rivero Belenchon I, Taratkin M, Carbonara U, et al. Three-dimensional Model-assisted Minimally Invasive Partial Nephrectomy: A Systematic Review with Meta-analysis of Comparative Studies. Eur Urol Oncol, 2022, 5(6): 640-650. [Crossref]

19. Amparore D, Pecoraro A, Piramide F, Verri P, Checcucci E, De Cillis S, et al. Three-dimensional imaging reconstruction of the kidney’s anatomy for a tailored minimally invasive partial nephrectomy: A pilot study. Asian J Urol, 2022, 9(3): 263-271. [Crossref]

20. Checcucci E, Amparore D, Volpi G, & Porpiglia F. A snapshot into the future of image-guided surgery for renal cancer. Asian J Urol, 2022, 9(3): 201-203. [Crossref]



Subscribe to receive issue release notifications
and newsletters from journals