Accéder directement au contenu Accéder directement à la navigation
Article dans une revue

An FPGA-based design for real-time Super-Resolution Reconstruction

Abstract : For several decades, the camera spatial resolution is gradually increasing with the CMOS technology evolution. The image sensors provide more and more pixels, generating new constraints for suitable optics. As an alternative, promising solutions propose super-resolution (SR) techniques to reconstruct high-resolution images or video without modifying the sensor architecture. However, most of the SR implementations are far from reaching real-time performance on a low-budget hardware platform. Moreover, convincing state-of-the-art studies reveal that artifacts can be observed in highly textured areas of the image. In this paper, we propose a local adaptive spatial super resolution (LASSR) method to fix this limitation. LASSR is a two-step SR method including a machine learning-based texture analysis and a fast interpolation method that performs a pixel-by-pixel SR. Multiple evaluations of our method are also provided using standard image metrics for quantitative evaluation and also a psycho-visual assessment for a perceptual evaluation. A first FPGA-based implementation of the proposed method is then presented. It enables high-quality 2-4 k super-resolution videos to be performed at 16 fps, using only 13% of the FPGA capacity, opening the way to reach more than 60 fps by executing several parallel instances of the LASSR code on the FPGA.
Liste complète des métadonnées
Contributeur : Julien Dubois <>
Soumis le : vendredi 26 février 2021 - 23:50:47
Dernière modification le : lundi 1 mars 2021 - 10:13:24
Archivage à long terme le : : jeudi 27 mai 2021 - 19:12:03


Fichiers produits par l'(les) auteur(s)




Yoan Marin, Johel Mitéran, Julien Dubois, Barthélémy Heyrman, Dominique Ginhac. An FPGA-based design for real-time Super-Resolution Reconstruction. Journal of Real-Time Image Processing, Springer Verlag, In press, Special Issue, 17 (6), pp.1769-1785. ⟨10.1007/s11554-020-00944-5⟩. ⟨hal-02749722⟩



Consultations de la notice


Téléchargements de fichiers