RESEARCH ARTICLE


ProgNet: COVID-19 Prognosis Using Recurrent and Convolutional Neural Networks



Mohamed Fakhfakh1, Bassem Bouaziz1, Faiez Gargouri1, Lotfi Chaari2, *
1 University of Sfax, MIRACL Laboratory, Sfax, Tunisia
2 University of Toulouse, IRIT-ENSEEIHT, Toulouse, France


© 2020 Fakhfakh et al.

open-access license: This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International Public License (CC-BY 4.0), a copy of which is available at: https://creativecommons.org/licenses/by/4.0/legalcode. This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

* Address correspondence to this author at University of Toulouse, IRIT-ENSEEIHT, Toulouse, France; E-mail: lotfi.chaari@toulouse-inp.fr


Abstract

Aims:

Prognosis of lung mathology severity after Covid-19 infection using chest X-ray time series

Background:

We have been inspired by methods analysing time series of images in remote sensing for change detection. During the current Covid-19 pandemic, our motivation is to provide an automatic tool to predict severity of lung pathologies due to Covid-19. This can be done by analysing images of the same patient acquired at different dates. Since no analytical model is available, and also no accurate quantification tools can be used due to many unknowns about the pathology, feature-free methods are good candidates to analyse such temporal images.

Objective:

This contribution helps improving performances of medical structures facing the Covid-19 pandemic. The first impact is medical and social since more lives could be saved with a 92% rate of good prognosis. In addition to that, patients in intensive care units (up to 15%) could a posteriori suffer from less sequels due to an early and accurate prognosis of their PP. Moreover, accurate prognosis can lead to a better planning of patient’s transfer between units and hospitals, which is linked to the second claimed economical impact. Indeed, prognosis is linked to lower treatment costs due to an optimized predictive protocol using ragiological prognosis.

Methods:

Using Convolutional Neural Networks (CNN) in combination with Recurrent Neural Networks (RNN). Spatial and temporal features are combines to analyse image time series. A prognosis score is delivered indicating the severity of the pathology. Learning is made on a publicly available database.

Results:

When applied to radiological time-series, promising results are obtained with an accuracy rates higher than 92%. Sensitivity and specificity rates are also very interesting.

Conclusion:

Our method is segmentation-free, which makes it competitive with respect to other assessment methods relying on time-consuming lung segmentation algorithms. When applied on radiographic data, the proposed ProgNet architecture showed promising results with good classification performances, especially for ambiguous cases. Specifically, the reported low false positive rates are interesting for an accurate and personalised care workflow.

Keywords: Coronavirus, Deep learning, Artificial intelligence, Medical imaging, LSTM, X-ray images.