TY - JOUR
T1 - Robust Needle Localization and Enhancement Algorithm for Ultrasound by Deep Learning and Beam Steering Methods
AU - Gao, Jun
AU - Liu, Paul
AU - Liu, Guang-Di
AU - Zhang, Le
N1 - Publisher Copyright: © 2021, Institute of Computing Technology, Chinese Academy of Sciences.
PY - 2021/4/1
Y1 - 2021/4/1
N2 - Ultrasound (US) imaging is clinically used to guide needle insertions because it is safe, real-time, and low cost. The localization of the needle in the ultrasound image, however, remains a challenging problem due to specular reflection off the smooth surface of the needle, speckle noise, and similar line-like anatomical features. This study presents a novel robust needle localization and enhancement algorithm based on deep learning and beam steering methods with three key innovations. First, we employ beam steering to maximize the reflection intensity of the needle, which can help us to detect and locate the needle precisely. Second, we modify the U-Net which is an end-to-end network commonly used in biomedical segmentation by using two branches instead of one in the last up-sampling layer and adding three layers after the last down-sample layer. Thus, the modified U-Net can real-time segment the needle shaft region, detect the needle tip landmark location and determine whether an image frame contains the needle by one shot. Third, we develop a needle fusion framework that employs the outputs of the multi-task deep learning (MTL) framework to precisely locate the needle tip and enhance needle shaft visualization. Thus, the proposed algorithm can not only greatly reduce the processing time, but also significantly increase the needle localization accuracy and enhance the needle visualization for real-time clinical intervention applications.
AB - Ultrasound (US) imaging is clinically used to guide needle insertions because it is safe, real-time, and low cost. The localization of the needle in the ultrasound image, however, remains a challenging problem due to specular reflection off the smooth surface of the needle, speckle noise, and similar line-like anatomical features. This study presents a novel robust needle localization and enhancement algorithm based on deep learning and beam steering methods with three key innovations. First, we employ beam steering to maximize the reflection intensity of the needle, which can help us to detect and locate the needle precisely. Second, we modify the U-Net which is an end-to-end network commonly used in biomedical segmentation by using two branches instead of one in the last up-sampling layer and adding three layers after the last down-sample layer. Thus, the modified U-Net can real-time segment the needle shaft region, detect the needle tip landmark location and determine whether an image frame contains the needle by one shot. Third, we develop a needle fusion framework that employs the outputs of the multi-task deep learning (MTL) framework to precisely locate the needle tip and enhance needle shaft visualization. Thus, the proposed algorithm can not only greatly reduce the processing time, but also significantly increase the needle localization accuracy and enhance the needle visualization for real-time clinical intervention applications.
KW - classification
KW - deep learning
KW - optimization
KW - segmentation
KW - ultrasound
UR - http://www.scopus.com/inward/record.url?scp=85104453142&partnerID=8YFLogxK
U2 - https://doi.org/10.1007/s11390-021-0861-7
DO - https://doi.org/10.1007/s11390-021-0861-7
M3 - Article
SN - 1000-9000
VL - 36
SP - 334
EP - 346
JO - Journal of Computer Science and Technology
JF - Journal of Computer Science and Technology
IS - 2
ER -