Assisting Difficult Liver Operations Using 3D Printed Models

Abstract

Liver cancer is estimated to be the fifth most common in the world, while it is also considered the third leading cause of cancer death. In cases of primary liver cancer, surgery in combination with chemotherapy and radiotherapy can lead to a complete cure or significantly increase the patient’s life expectancy. Since the liver is an organ that performs several critical functions in the human body, the precise estimation of the disease (position and size of tumors and its vicinity to vessels) plays a vital role in a successful operation. In some cases, the removal of the tumor may be successful, but the percentage of the hepatic remnant may not be sufficient to sustain life. Therefore, accurate imaging of the tumor of the liver and proper planning of a difficult surgery to remove tumor(s) from a patient’s liver can be a lifesaver and lead to a complete cure of the disease. The aim of the present study is the initial accurate representation of the liver (parenchyma, tumors, vessels) as a digital three-dimensional (3D) model using advanced image processing and machine learning techniques and its 3D printing in 1:1 scale representing the full size of the liver with the tumor(s). A model of this type has been used at our University surgical department to plan complex hepatobiliary surgeries, provide more accurate information to the patients and their families, as well as improve the training of medical students and resident surgeons and fellows.

1. Introduction

Three-dimensional (3D) printing has received a lot of publicity recently. The reasons are many, but perhaps the main one is the reduction of the cost of both consumables and the 3D printing devices, as well as the wide availability of specialized open-source software that are necessary for the production of 3D printing [1]. However, its application in medical science may yet be more limited than one would expect, mainly due to the strict rules that one must follow in order to apply an innovative medical treatment.

In the last few years, the global scientific society has focused its attention on 3D modeling and 3D printing technology. This relatively new technology has a broad range of applications [2,3,4,5], with the medical industry not to be excluded from this evolution. This is due to the fact that 3D printers are faster, cheaper, and easier to use when compared with similar technologies, parameters that make 3D printing a cost-effective and time-saving method.

3D printers are not an invention of recent years, since the first successful application of the prosthetic process to create physical models from digital copies was made in the mid-1980s by Charles, W. Hull [6]. Nowadays, there is a wide variety of 3D printers that differ in the technology used to produce the models, materials, and costs. Like traditional printers, 3D printers use a variety of technologies to create their final products. More information about the types and techniques used for 3D printing can be found in relevant publications in the international literature [7].

Concerning the different medical specialties and subspecialties [8,9], there have been several important and remarkable efforts made during the last decade for this technology to constitute a valuable tool. Education and training on human organ models, profound study of disease models, education and training of students and residents, preoperative planning, intraoperative assessment of complex surgical operations that demand accuracy, post-operative evaluation, and patient counseling are fields where 3D printing is involved [10]. It appears to be a valuable tool for the surgeon in order to plan complex surgical operations carefully, with great accuracy and with fewer complications.

The current study is part of research funded by Greek National and European funds for 3D liver model printing and imaging modality development.

2. Materials and Methods

The use of X-ray examinations has led to a revolution in medical science and especially in the surgical specialties as the surgical team is able to investigate the inner body structure, comprehend in detail an organ’s anatomy and localize the underlying damage before the surgery. From the beginning, plain radiography had as its main scope the map** and visualization of the anatomy of the patient’s tissues in order to assist in a demanding surgery. However, plain radiography could not provide the 3D information of the imaged body structure.

The development of tomographic systems of computerized tomography (CT) and magnetic resonance imaging (MRI) gave even more value and functionality to medical imaging. The series of tomography images provide important 3D information (shape, size, structure) of the inner body organs and their damages, but the visualization of the 3D anatomy is not easy as the demonstration of a solid 3D model is made on flat two dimensional (2D) screens (in general imaging peripherals) and the perception of the third dimension is subject to the physician’s experience since it is done through 2.5D technologies [11]. These 2D graphical projections and similar techniques are used to produce images or scenes that simulate the appearance of 3D objects.

The standard deliverables of a CT or MRI examination is always a series of DICOM (digital imaging and communications in medicine) images characterized by high geometric accuracy and high radiometric resolution (12-bit information on grayscale values), rendering the material density of a tissue during the recording of each examination section. The intense (bright) pixels represent bones, while the darker ones, depending on their physical properties, represent soft molecules (muscles, fat, visceral organs, etc.). The intensities in the scale of gray values on the DICOM images are related to the tissues’ densities. More specifically, trapped air inside the stomach or any other organ appears in darker grayscale values, while bones and blood enriched with shading fluid traveling inside the vessels appear in lighter grayscale values [12].

Although the information recorded is 3D, what can be directly and almost automatically extracted as a 3D model is the whole part of the human body that is scanned by the tomographic instrument. Isolation of specific tissue sections recorded by CT scans should be based on the density (variations in the grayscale) of the pixels belonging to specific tissues, e.g., the liver. In general, due to the proximity and indistinguishable boundaries between the internal human organs, the separation of the tissues belonging to specific organs is unclear (Figure 1).

The application of simple digital image processing techniques (e.g., threshold filters, region growing, and other segmentation techniques) certainly helps to isolate the tissues belonging to a specific visceral organ, especially in the case of the liver. In particular, the use of a three-phase CT scan in high resolution (providing a distance of less than 1 mm in successive sections) allows the separation of different structures within the hepatic parenchyma (vessels and organ pathology).

The first approach to creating a 3D model of a patient’s liver involves the processing of three-phase computed tomography [13]. The present work describes the efforts made in the last two years to create models of internal human organs from synthetic materials through 3D printing to assist in difficult surgeries, and in particular, for the resection of liver tumors. The overall effort began with the submission of a proposal for funding to the Greek Research and Technology Agency in June 2017 and continues in the framework of the implementation of the Research Program with the acronym Liver3D co-financed by the European Union and Greek national funds through the Operational Program Competitiveness, Entrepreneurship and Innovation, under the call RESEARCH-CREATE-INNOVATE (project code: Τ1EDK-03599) and aims at the cooperation of research institutes with Small or Medium Enterprises (SMEs) for the transfer of know-how and to encourage innovation.

Our first approach was based on creating a 3D model and inner structure of a patient’s liver. This involved the processing of three-phase CT scan in three stages:

Stage (1) Extraction of the hepatic parenchyma by fully automated or semi-automated methods by delineation of the liver boundaries from neighboring organs in each image of the arterial phase (Figure 2).

Stage (2) Extraction of the lesion and vessels within the limits of the parenchyma (already limited in every CT scan image from the previous processing stage).

Stage (3) Extraction of the points belonging to the surfaces of the parenchyma, blood vessels, and the lesion and creation of models using model reconstruction algorithms (Figure 3).

Although the application of automatic segmentation gave acceptable results, the process of extracting the complete model of the liver parenchyma was not sufficiently automated. For this reason, artificial intelligence and deep learning techniques were used to extract the models of both the parenchyma but also of the organ pathology (i.e., tumors, hemangioma, etc.) [14]. In the first case, where this algorithm was applied, only the model of the parenchyma and the tumor were extracted and printed independently with different colors (Figure 4) and on a 1:1 scale.

The specific printed model (Figure 4) was used as a guide for the therapeutic approach a few days before the surgery (Figure 5), as well as for informing the patient. The research protocol and the study were approved by the Investigational Review Board (IRB) of the hospital where the research was conducted. Informed consent was obtained from all subjects involved in the study.

3. Results

In this first case, the print’s final deliverable was not considered ideal, as that description would be better suited to a transparent model that contains both the liver volume, the network of blood vessels, the tumor, and the parenchyma. Therefore, initially, the vascular networks (hepatic and portal vein and arteries) should be created apart from the liver and tumor model. Using appropriate software after the production of the 3D model of the parenchyma, the extraction of the vascular network (arteries, portal, and hepatic vein) was performed from the different phases (arterial, portal, delayed) of the CT scan images. The result was the model for the next case (Figure 6), which incorporated the complete liver anatomy into a unique 3D model file (as a standard wavefront.obj digital model file).

The next challenge was to transfer to life-size (1:1 scale) a structure of a transparent object the combines the vascular networks and the liver tumor, while retaining the high precision geometric model, as it was captured from the CT scan and was subsequently digitized and modeled from our specialized software application.

A possible solution was to print a mold instead of the liver parenchyma that would integrate the vascular network and the tumor and then fill it with transparent material originally in liquid form, so as not to create gaps, and then, when solidified, to allow the study and planning-rehearsal of the operation by the surgeon.

The difficulties that arose are mainly due to the uncertainty in providing correct placement and welding of the vascular networks both with each other and in relation to the tumor, as all the models are printed separately from each other. The problem was mainly solved by the application of three-dimensional transformations between the geometric reference systems to which the individual models of the vessels refer, achieving adjustment accuracy equal to the scanning resolution of the CT scans (close to 1 mm).

An intermediate goal in the implementation of our research activities is the assessment of the results after every surgical operation. More specifically, the evaluation focuses on the comparison of the volumetric quantity resulting from the difference of the parenchyma from the liver model in relation to the tumor removed during the operation. The following (Figure 7) illustrates the resected tumor after an operation performed, as well as the corresponding 3D printed model, which was obtained originally as a digital model from the processing of the CT scans.

Considering that during a surgical operation, in addition to the tumor, also margins of healthy tissue are resected for oncological reasons, the difference of 10.1% resulting from the comparative volumetric difference becomes even smaller. Therefore, the data from the volumetric comparisons encourage the application of 3D printing as an accurate method, both in terms of the location as well as the size of the lesion.

4. Discussion

What has been described so far is the difficult path, but one full of satisfaction and enthusiasm, that has been followed to provide an accurate illustration of the patient’s disease so that the treatment would be more targeted and adapted to the specific anatomy and pathology of every single case. This approach is part of a current trend in Medicine described as “personalized medicine” or “precision medicine”, and the ultimate goal is the individualized treatment of the disease in a way that would lead to fewer complications and/or side effects, greater safety and accuracy.

We chose liver and liver tumors as the subject of this research, as the complex anatomy and physiology of the liver make hepatectomy one of the most complicated surgical operations. Therefore, the assistance of advanced imaging technologies and 3D modeling methods is of critical importance both for the safety of the patient and the successful outcome of the operation. Also, with the above-mentioned map** and 3D representation of the liver, it is possible to apply an even more targeted and precise resection, which means that the patient will finally retain a healthier parenchyma, without questioning the oncological success of the operation.

Another conclusion from this initial experience is the importance of this imaging method for the acquisition of more detailed preoperative information to familiarize the patients and their intimates with their pathology and disease, the operation planning, and the possible complications.

3D imaging and 3D printing of the liver and tumor on a 1:1 scale is much more convincing and informative than any information a surgeon could give. Furthermore, the 3D imaging of the liver, its anatomy, and the tumor, has enabled us to discuss and plan the surgery in advance with the rest of the surgical team, as well as to explain this strategy and possible difficulties to students and surgeons.

Finally, we believe that these are just a foretaste of what will follow, as during this project and this collaboration, there was a constant “concern” for improvement. This has led us to the next step, which is related to the conversion of the 3D printed instrument into an augmentation model that can be used during the surgery to highlight and safely deal with the dangerous points along the way of hepatectomy.