Accéder directement au contenu Accéder directement à la navigation
Article dans une revue

An FPGA-based design for real-time Super-Resolution Reconstruction

Abstract : For several decades, the camera spatial resolution is gradually increasing with the CMOS technology evolution. The image sensors provide more and more pixels, generating new constraints for suitable optics. As an alternative, promising solutions propose super-resolution (SR) techniques to reconstruct high-resolution images or video without modifying the sensor architecture. However, most of the SR implementations are far from reaching real-time performance on a low-budget hardware platform. Moreover, convincing state-of-the-art studies reveal that artifacts can be observed in highly textured areas of the image. In this paper, we propose a local adaptive spatial super resolution (LASSR) method to fix this limitation. LASSR is a two-step SR method including a machine learning-based texture analysis and a fast interpolation method that performs a pixel-by-pixel SR. Multiple evaluations of our method are also provided using standard image metrics for quantitative evaluation and also a psycho-visual assessment for a perceptual evaluation. A first FPGA-based implementation of the proposed method is then presented. It enables high-quality 2-4 k super-resolution videos to be performed at 16 fps, using only 13% of the FPGA capacity, opening the way to reach more than 60 fps by executing several parallel instances of the LASSR code on the FPGA.
Liste complète des métadonnées

https://hal-univ-bourgogne.archives-ouvertes.fr/hal-02749722
Contributeur : Julien Dubois <>
Soumis le : mercredi 3 juin 2020 - 15:52:12
Dernière modification le : jeudi 4 juin 2020 - 08:48:15

Identifiants

  • HAL Id : hal-02749722, version 1

Collections

Citation

Yoan Marin, Julien Dubois, Johel Mitéran, Barthélémy Heyrman, Dominique Ginhac. An FPGA-based design for real-time Super-Resolution Reconstruction. Journal of Real-Time Image Processing, Springer Verlag, In press, Special Issue. ⟨hal-02749722⟩

Partager

Métriques

Consultations de la notice

24