FANet: A Feedback Attention Network for Improved Biomedical Image Segmentation

Authors: Nikhil Kumar Tomar, Debesh Jha, Michael A. Riegler, Håvard D. Johansen, Dag Johansen, Jens Rittscher, Pål Halvorsen and Sharib Ali <br/> Research paper: https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9741842

Abstract

<div align="justify"> The increase of available large clinical and exper- imental datasets has contributed to a substantial amount of important contributions in the area of biomedical image anal- ysis. Image segmentation, which is crucial for any quantitative analysis, has especially attracted attention. Recent hardware advancement has led to the success of deep learning approaches. However, although deep learning models are being trained on large datasets, existing methods do not use the information from different learning epochs effectively. In this work, we leverage the information of each training epoch to prune the prediction maps of the subsequent epochs. We propose a novel architecture called feedback attention network (FANet) that unifies the previous epoch mask with the feature map of the current training epoch. The previous epoch mask is then used to provide a hard attention to the learned feature maps at different convolutional layers. The network also allows to rectify the predictions in an iterative fashion during the test time. We show that our proposed feedback attention model provides a substantial improvement on most segmentation metrics tested on seven publicly available biomedical imaging datasets demonstrating the effectiveness of FANet. </div>

Architecture

Dataset:

• Kvasir-SEG
• CVC-ClinicDB
• DRIVE
• CHASE DB1
• 2018 Data Science Bowl
• ISIC 2018
• EM

Qualitative results

Citation

Please cite our paper if you find it useful:

<pre> @article{tomar2021fanet, title={Fanet: A feedback attention network for improved biomedical image segmentation}, author={Tomar, Nikhil Kumar and Jha, Debesh and Riegler, Michael A and Johansen, H{\aa}vard D and Johansen, Dag and Rittscher, Jens and Halvorsen, P{\aa}l and Ali, Sharib}, journal={arXiv preprint arXiv:2103.17235}, year={2021} } </pre>

Contact

Please contact nikhilroxtomar@gmail.com and debesh@simula.no for any further questions.