TY - GEN
T1 - Deformable Image Registration with Geometry-informed Implicit Neural Representations
AU - van Harten, Louis D.
AU - van Herten, Rudolf L. M.
AU - Stoker, Jaap
AU - Išgum, Ivana
PY - 2023
Y1 - 2023
N2 - Deformable image registration is a crucial component in the analysis of motion in time series. In medical data, the deformation fields are often predictable to a certain degree: the muscles and other tissues causing the motion-of-interest form shapes that may be used as a geometric prior. Using an Implicit Neural Representation to parameterize a deformation field allows the coordinate space to be chosen arbitrarily. We propose to curve this coordinate space around anatomical structures that influence the motion in our time series, yielding a space that is aligned with the expected motion. The geometric information is therefore explicitly encoded into the neural representation, reducing the complexity of the optimized deformation function. We design and evaluate this concept using an abdominal 3D cine-MRI dataset, where the motion of interest is bowel motility. We align the coordinate system of the neural representations with automatically extracted centerlines of the small intestine. We show that explicitly encoding the intestine geometry in the neural representations can improve registration accuracy for bowel loops with active motility when compared to registration using neural representations in the original coordinate system. Additionally, we show that registration accuracy can be further improved using a model that combines a neural representation in image coordinates with a separate neural representation that operates in the proposed tangent coordinate system. This approach may improve the efficiency of deformable registration when describing motion-of-interest that is influenced by the shape of anatomical structures.
AB - Deformable image registration is a crucial component in the analysis of motion in time series. In medical data, the deformation fields are often predictable to a certain degree: the muscles and other tissues causing the motion-of-interest form shapes that may be used as a geometric prior. Using an Implicit Neural Representation to parameterize a deformation field allows the coordinate space to be chosen arbitrarily. We propose to curve this coordinate space around anatomical structures that influence the motion in our time series, yielding a space that is aligned with the expected motion. The geometric information is therefore explicitly encoded into the neural representation, reducing the complexity of the optimized deformation function. We design and evaluate this concept using an abdominal 3D cine-MRI dataset, where the motion of interest is bowel motility. We align the coordinate system of the neural representations with automatically extracted centerlines of the small intestine. We show that explicitly encoding the intestine geometry in the neural representations can improve registration accuracy for bowel loops with active motility when compared to registration using neural representations in the original coordinate system. Additionally, we show that registration accuracy can be further improved using a model that combines a neural representation in image coordinates with a separate neural representation that operates in the proposed tangent coordinate system. This approach may improve the efficiency of deformable registration when describing motion-of-interest that is influenced by the shape of anatomical structures.
UR - https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85189306512&origin=inward
M3 - Conference contribution
VL - 227
T3 - Proceedings of Machine Learning Research
SP - 730
EP - 742
BT - Medical Imaging with Deep Learning 2023, MIDL 2023
A2 - Oguz, Ipek
A2 - Noble, Jack
A2 - Li, Xiaoxiao
A2 - Styner, Martin
A2 - Baumgartner, Christian
A2 - Rusu, Mirabela
A2 - Heinmann, Tobias
A2 - Kontos, Despina
A2 - Landman, Bennett
A2 - Dawant, Benoit
PB - ML Research Press
T2 - 6th International Conference on Medical Imaging with Deep Learning, MIDL 2023
Y2 - 10 July 2023 through 12 July 2023
ER -