Bio-inspired Multi-spectral Image Sensor and Augmented Reality Display for Near-infrared Fluorescence Image-guided Surgery PDF Download

Author: Nan Cui
Publisher:
ISBN:
Category : Electronic dissertations
Languages : en
Pages : 101

View

Book Description
Background: Cancer remains a major public health problem worldwide and poses a huge economic burden. Near-infrared (NIR) fluorescence image-guided surgery (IGS) utilizes molecular markers and imaging instruments to identify and locate tumors during surgical resection. Unfortunately, current state-of-the-art NIR fluorescence imaging systems are bulky, costly, and lack both fluorescence sensitivity under surgical illumination and co-registration accuracy between multimodal images. Additionally, the monitor-based display units are disruptive to the surgical workflow and are suboptimal at indicating the 3-dimensional position of labeled tumors. These major obstacles have prevented the wide acceptance of NIR fluorescence imaging as the standard of care for cancer surgery. The goal of this dissertation is to enhance cancer treatment by developing novel image sensors and presenting the information using holographic augmented reality (AR) display to the physician in intraoperative settings.Method: By mimicking the visual system of the Morpho butterfly, several single-chip, color-NIR fluorescence image sensors and systems were developed with CMOS technologies and pixelated interference filters. Using a holographic AR goggle platform, an NIR fluorescence IGS display system was developed. Optoelectronic evaluation was performed on the prototypes to evaluate the performance of each component, and small animal models and large animal models were used to verify the overall effectiveness of the integrated systems at cancer detection.Result: The single-chip bio-inspired multispectral logarithmic image sensor I developed has better main performance indicators than the state-of-the-art NIR fluorescence imaging instruments. The image sensors achieve up to 140 dB dynamic range. The sensitivity under surgical illumination achieves 6 x 108 [mu]V/(mW/cm2), which is up to 25 times higher. The signal-to-noise ratio is up to 56 dB, which is 11 dB greater. These enable high sensitivity fluorescence imaging under surgical illumination. The pixelated interference filters enable temperature-independent co-registration accuracy between multimodal images. Pre-clinical trials with small animal model demonstrate that the sensor can achieve up to 95% sensitivity and 94% specificity with tumor-targeted NIR molecular probes. The holographic AR goggle provides the physician with a non-disruptive 3-dimensional display in the clinical setup. This is the first display system that co-registers a virtual image with human eyes and allows video rate image transmission. The imaging system is tested in the veterinary science operating room on canine patients with naturally occurring cancers. In addition, a time domain pulse-width-modulation address-event-representation multispectral image sensor and a handheld multispectral camera prototype are developed.Conclusion: The major problems of current state-of-the-art NIR fluorescence imaging systems are successfully solved. Due to enhanced performance and user experience, the bio-inspired sensors and augmented reality display system will give medical care providers much needed technology to enable more accurate value-based healthcare.

Author: Shengkui Gao
Publisher:
ISBN:
Category : Electronic dissertations
Languages : en
Pages : 142

View

Book Description
Image guided surgery (IGS) utilizes emerging imaging technologies to provide additional structural and functional information to the physician in clinical settings. This additional visual information can help physicians delineate cancerous tissue during resection as well as avoid damage to near-by healthy tissue. Near-infrared (NIR) fluorescence imaging (700 nm to 900 nm wavelengths) is a promising imaging modality for IGS, namely for the following reasons: First, tissue absorption and scattering in the NIR window is very low, which allows for deeper imaging and localization of tumor tissue in the range of several millimeters to a centimeter depending on the tissue surrounding the tumor. Second, spontaneous tissue fluorescence emission is minimal in the NIR region, allowing for high signal-to-background ratio imaging compared to visible spectrum fluorescence imaging. Third, decoupling the fluorescence signal from the visible spectrum allows for optimization of NIR fluorescence while attaining high quality color images. Fourth, there are two FDA approved fluorescent dyes in the NIR region--namely methylene blue (MB) and indocyanine green--which can help to identify tumor tissue due to passive accumulation in human subjects. The aforementioned advantages have led to the development of NIR fluorescence imaging systems for a variety of clinical applications, such as sentinel lymph node imaging, angiography, and tumor margin assessment. With these technological advances, secondary surgeries due to positive tumor margins or damage to healthy organs can be largely mitigated, reducing the emotional and financial toll on the patient. Currently, several NIR fluorescence imaging systems (NFIS) are available commercially or are undergoing clinical trials, such as FLARE, SPY, PDE, Fluobeam, and others. These systems capture multi-spectral images using complex optical equipment and are combined with real-time image processing to present an augmented view to the surgeon. The information is presented on a standard monitor above the operating bed, which requires the physician to stop the surgical procedure and look up at the monitor. The break in the surgical flow sometimes outweighs the benefits of fluorescence based IGS, especially in time-critical surgical situations. Furthermore, these instruments tend to be very bulky and have a large foot print, which significantly complicates their adoption in an already crowded operating room. In this document, I present the development of a compact and wearable goggle system capable of real-time sensing of both NIR fluorescence and color information. The imaging system is inspired by the ommatidia of the monarch butterfly, in which pixelated spectral filters are integrated with light sensitive elements. The pixelated spectral filters are fabricated via a carefully optimized nanofabrication procedure and integrated with a CMOS imaging array. The entire imaging system has been optimized for high signal-to-background fluorescence imaging using an analytical approach, and the efficacy of the system has been experimentally verified. The bio-inspired spectral imaging sensor is integrated with an FPGA for compact and real-time signal processing and a wearable goggle for easy integration in the operating room. The complete imaging system is undergoing clinical trials at Washington University in the St. Louis Medical School for imaging sentinel lymph nodes in both breast cancer patients and melanoma patients.

Author: Nimrod Missael Garcia Hernandez
Publisher:
ISBN:
Category : Electronic dissertations
Languages : en
Pages : 151

View

Book Description
Image-guided surgery (IGS) can enhance cancer treatment by decreasing, and ideally eliminating, positive tumor margins and iatrogenic damage to healthy tissue. Current state-of-the-art near-infrared fluorescence imaging systems are bulky, costly, lack sensitivity under surgical illumination, and lack co-registration accuracy between multimodal images. As a result, an overwhelming majority of physicians still rely on their unaided eyes and palpation as the primary sensing modalities to distinguish cancerous from healthy tissue. In my thesis, I have addressed these challenges in IGC by mimicking the visual systems of several animals to construct low power, compact and highly sensitive multi-spectral and color-polarization sensors. I have realized single-chip multi-spectral imagers with 1000-fold higher sensitivity and 7-fold better spatial co-registration accuracy compared to clinical imaging systems in current use by monolithically integrating spectral tapetal and polarization filters with an array of vertically stacked photodetectors. These imaging sensors yield the unique capabilities of imaging simultaneously color, polarization, and multiple fluorophores for near-infrared fluorescence imaging. Preclinical and clinical data demonstrate seamless integration of this technologies in the surgical work flow while providing surgeons with real-time information on the location of cancerous tissue and sentinel lymph nodes, respectively. Due to its low cost, the bio-inspired sensors will provide resource-limited hospitals with much-needed technology to enable more accurate value-based health care.

Author: Steven Michael Blair
Publisher:
ISBN:
Category :
Languages : en
Pages :

View

Book Description

Author: Essa M. Aleassa
Publisher: Springer Nature
ISBN: 3030380920
Category : Medical
Languages : en
Pages : 275

View

Book Description
​This book represents a head-to-toe guide for clinicians who are interested in applying real-time near infrared (NIR) imaging for their patients. Expert surgeons from around the globe share their experience with NIR imaging, most commonly performed using indocyanine green (ICG) fluorescence. The chapters are structured to include a brief background, indications for use, followed by a technical description of the procedure. Each chapter is also accompanied by video examples and detailed information about necessary equipment, drug dosing, and alternative techniques. A pitfalls section serves as a “lessons learned” segment to bookend each chapter. Authors represent a comprehensive list of surgical subspecialties ranging from neurosurgery to plastic surgery. While it is not meant to serve as an exhaustive summary of ICG use in surgery, the goal is to highlight the successful use of this technology in a number of settings. As the technology and applications continue to expand, Video Atlas of Intraoperative Applications of Near Infrared Fluorescence Imaging serves as a foundation upon which to build.

Author: Terry M. Peters
Publisher: CRC Press
ISBN: 135165442X
Category : Science
Languages : en
Pages : 222

View

Book Description
Augmented reality (AR) is transforming how we work, learn, play and connect with the world, and is now being introduced to the field of medicine, where it is revolutionising healthcare as pioneering virtual elements are being added to real images to provide a more compelling and intuitive view during procedures. This book, which had its beginnings at the AE-CAI: Augmented Environments for Computer-Assisted Interventions MICCAI Workshop in Munich in 2015, is the first to review the area of mixed and augmented reality in medicine. Covering a range of examples of the use of AR in medicine, it explores its relevance to minimally-invasive interventions, how it can improve the accuracy of a procedure and reduce procedure time, and how it may be employed to reduce radiation risks. It also discusses how AR can be an effective tool in the education of physicians, medical students, nurses and other health professionals. Features: An ideal practical guide for medical professionals and students looking to understand the implementation, applications, and future of AR Contains the latest developments and technologies in this innovative field Edited by highly respected pioneers in the field, who have been immersed in AR as well as virtual reality and image-guided surgery since their inception, with chapter contributions from subject area specialists working with AR

Author: Hongen Liao
Publisher: Springer
ISBN: 3642408435
Category : Computers
Languages : en
Pages : 290

View

Book Description
This book constitutes the refereed proceedings of two workshops MAIR/AE-CAI 2013, held in conjunction with MICCAI 2013, held in Nagoya, Japan, in September 2013. The 29 revised full papers presented were carefully reviewed and selected from 44 submissions. The papers cover a wide range of topics addressing the main research efforts in the fields of medical image formation, analysis and interpretation, augmented reality and visualization, computer assisted intervention, interventional imaging, image-guided robotics, image-guided intervention, surgical planning and simulation, systematic extra- and intra-corporeal imaging modalities, and general biological and neuroscience image computing.

Author: Suman Bikash Mondal
Publisher:
ISBN:
Category : Electronic dissertations
Languages : en
Pages : 231

View

Book Description
Surgery remains the only curative option for most solid tumors. The standard-of-care usually involves tumor resection and sentinel lymph node biopsy for cancer staging. Surgeons rely on their vision and touch to distinguish healthy from cancer tissue during surgery, often leading to incomplete tumor resection that necessitates repeat surgery. Sentinel lymph node biopsy by conventional radioactive tracking exposes patients and caregivers to ionizing radiation, while blue dye tracking stains the tissue highlighting only superficial lymph nodes. Improper identification of sentinel lymph nodes may misdiagnose the stage of the cancer. Therefore there is a clinical need for accurate intraoperative tumor and sentinel lymph node visualization. Conventional imaging modalities such as x-ray computed tomography, positron emission tomography, magnetic resonance imaging, and ultrasound are excellent for preoperative cancer diagnosis and surgical planning. However, they are not suitable for intraoperative use, due to bulky complicated hardware, high cost, non-real-time imaging, severe restrictions to the surgical workflow and lack of sufficient resolution for tumor boundary assessment. This has propelled interest in fluorescence-guided surgery, due to availability of simple hardware that can achieve real-time, high resolution and sensitive imaging. Near-infrared fluorescence imaging is of particular interest due to low background absorbance by photoactive biomolecules, enabling thick tissue assessment. As a result several near-infrared fluorescence-guided surgery systems have been developed. However, they are limited by bulky hardware, disruptive information display and non-matched field of view to the user. To address these limitations we have developed a compact, light-weight and wearable goggle augmented imaging and navigation system (GAINS). It detects the near-infrared fluorescence from a tumor accumulated contrast agent, along with the normal color view and displays accurately aligned, color-fluorescence images via a head-mounted display worn by the surgeon, in real-time. GAINS is a platform technology and capable of very sensitive fluorescence detection. Image display options include both video see-through and optical see-through head-mounted displays for high-contrast image guidance as well as direct visual access to the surgical bed. Image capture options from large field of view camera as well high magnification handheld microscope, ensures macroscopic as well as microscopic assessment of the tumor bed. Aided by tumor targeted near-infrared contrast agents, GAINS guided complete tumor resection in subcutaneous, metastatic and spontaneous mouse models of cancer with high sensitivity and specificity, in real-time. Using a clinically-approved near-infrared contrast agent, GAINS provided real-time image guidance for accurate visualization of lymph nodes in a porcine model and sentinel lymph nodes in human breast cancer and melanoma patients with high sensitivity. This work has addressed issues that have limited clinical adoption of fluorescence-guided surgery and paved the way for research into developing this approach towards standard-of-care practice that can potentially improve surgical outcomes in cancer.

Author: Guoyan Zheng
Publisher: Springer
ISBN: 3319437755
Category : Computers
Languages : en
Pages : 450

View

Book Description
The 6th International Conference on Medical Imaging and Augmented Reality, MIAR 2016, was held in Bern, Switzerland during August 2016. The aim of MIAR is to bring together researchers in computer vision, graphics, robotics, and medical imaging to present the state-of-the-art developments in this ever-growing research area in topics such as: Medical Image Formation, Analysis and Interpretation Augmented Reality, Visualization and Simulation Computer Assisted Interventional and Robotics, Surgical Planning Systematic Extra- and Intra-corporeal Imaging Modalities General Biological and Neuroscience Image Computing

Author: Takeyoshi Dohi
Publisher: Springer Science & Business Media
ISBN: 3540799818
Category : Computers
Languages : en
Pages : 457

View

Book Description
This book constitutes the refereed proceedings of the 4th International Workshop on Medical Imaging and Augmented Reality, MIAR 2008, held in Tokyo, Japan, in August 2008. The 44 revised full papers presented together with 3 invited papers were carefully reviewed and selected from 90 submissions. The papers are organized in topical sections on surgical planning and simulation, medical image computing, image analysis, shape modeling and morphometry, image-guided robotics, image-guided intervention, interventional imaging, image registration, augmented reality, and image segmentation.