End-to-end unsupervised deformable image registration with a convolutional neural network

Bob D. de Vos, Floris F. Berendsen, Max A. Viergever, Marius Staring, Ivana Išgum

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

332 Citations (Scopus)

Abstract

In this work we propose a deep learning network for deformable image registration (DIRNet). The DIRNet consists of a convolutional neural network (ConvNet) regressor, a spatial transformer, and a resampler. The ConvNet analyzes a pair of fixed and moving images and outputs parameters for the spatial transformer, which generates the displacement vector field that enables the resampler to warp the moving image to the fixed image. The DIRNet is trained end-to-end by unsupervised optimization of a similarity metric between input image pairs. A trained DIRNet can be applied to perform registration on unseen image pairs in one pass, thus non-iteratively. Evaluation was performed with registration of images of handwritten digits (MNIST) and cardiac cine MR scans (Sunnybrook Cardiac Data). The results demonstrate that registration with DIRNet is as accurate as a conventional deformable image registration method with short execution times.
Original languageEnglish
Title of host publicationDeep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support - 3rd International Workshop, DLMIA 2017 and 7th International Workshop, ML-CDS 2017 Held in Conjunction with MICCAI 2017, Proceedings
EditorsTal Arbel, M. Jorge Cardoso
PublisherSpringer Verlag
Pages204-212
Volume10553 LNCS
ISBN (Print)9783319675572
DOIs
Publication statusPublished - 2017
Event3rd International Workshop on Deep Learning in Medical Image Analysis, DLMIA 2017 and 7th International Workshop on Multimodal Learning for Clinical Decision Support, ML-CDS 2017 held in Conjunction with 20th International Conference on Medical Image Co... - Quebec City, Canada
Duration: 14 Sept 201714 Sept 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Conference

Conference3rd International Workshop on Deep Learning in Medical Image Analysis, DLMIA 2017 and 7th International Workshop on Multimodal Learning for Clinical Decision Support, ML-CDS 2017 held in Conjunction with 20th International Conference on Medical Image Co...
Country/TerritoryCanada
CityQuebec City
Period14/09/201714/09/2017

Cite this