For camera-based imaging, low resolution and noise outliers are the major challenges. Here, we propose a novel super-resolution method－total generalized variation (TGV) super-resolution based on fast l1-norm dictionary edge representations. First, anisotropic diffusion tensor (ADT) is utilized as high frequency edge information. The fast l1-norm dictionary representation method is used to create dictionaries of LR image and the corresponding high frequency edge information. This method can quickly build dictionaries on the same database, and avoid the influence of outliers. Then we combine the edge information ADT and TGV model as the new regularization function. Finally, the super-resolution cost function is established. The results show that the algorithm has high feasibility and robustness to simulation data and SO12233 target data. It can effectively remove noise outliers and obtain high-quality clear images. Compared with other classical algorithms, the proposed algorithm can obtain higher PSNR and SSIM values.
An anisotropic edge total generalized variation energy super-resolution based on fast l1-norm dictionary edge representations
First published at:Nov 15, 2019
 Maalouf A, Larabi M C. Colour image super-resolution using geometric grouplets[J]. IET Image Processing, 2012, 6(2): 168–180.
 Wang F, Wang W, Qiu Z L. A single super-resolution method via deep cascade network[J]. Opto-Electronic Engineering, 2018, 45(7): 170729.
王飞, 王伟, 邱智亮. 一种深度级联网络结构的单帧超分辨重建算法[J]. 光电工程, 2018, 45(7): 170729.
 Sun C, Lü J W, Li J W, et al. Method of rapid image su-per-resolution based on deconvolution[J]. Acta Optica Sinica, 2017, 37(12): 1210004.
孙超, 吕俊伟, 李健伟, 等. 基于去卷积的快速图像超分辨率方法[J]. 光学学报, 2017, 37(12): 1210004.
 Wang R G, Wang Q H, Yang J, et al. Image super-resolution reconstruction by fusing feature classification and independent dictionary training[J]. Opto-Electronic Engineering, 2018, 45(1): 170542.
汪荣贵, 汪庆辉, 杨娟, 等. 融合特征分类和独立字典训练的超分辨率重建[J]. 光电工程, 2018, 45(1): 170542.
 Ng M K, Shen H F, Lam E Y, et al. A total variation regularization based super-resolution reconstruction algorithm for digital video[J]. EURASIP Journal on Advances in Signal Processing, 2007, 2007: 074585.
 Marquina A, Osher S J. Image super-resolution by TV-regularization and Bregman iteration[J]. Journal of Scientific Computing, 2008, 37(3): 367–382.
 Li X L, Hu Y T, Gao X B, et al. A multi-frame image su-per-resolution method[J]. Signal Processing, 2010, 90(2): 405–414.
 Farsiu S, Robinson M D, Elad M, et al. Fast and robust multiframe super resolution[J]. IEEE Transactions on Image Processing, 2004, 13(10): 1327–1344.
 Yue L W, Shen H F, Yuan Q Q, et al. A locally adaptive L1-L2 norm for multi-frame super-resolution of images with mixed noise and outliers[J]. Signal Processing, 2014, 105: 156–174.
 Wang L F, Xiang S M, Meng G F, et al. Edge-directed sin-gle-image super-resolution via adaptive gradient magnitude self-interpolation[J]. IEEE Transactions on Circuits and Sys-tems for Video Technology, 2013, 23(8): 1289–1299.
 Sun J, Sun J, Xu Z B, et al. Gradient profile prior and its applications in image super-resolution and enhancement[J]. IEEE Transactions on Image Processing, 2011, 20(6): 1529–1542.
 Feng W S, Lei H. Single-image super-resolution with total generalised variation and Shearlet regularisations[J]. IET Im-age Processing, 2014, 8(12): 833–845.
 Ma Z Y, Liao R J, Tao X, et al. Handling motion blur in mul-ti-frame super-resolution[C]//Proceedings of 2015 IEEE Con-ference on Computer Vision and Pattern Recognition, 2015: 5224–5232.
 Yang J C, Wright J, Huang T, et al. Image super-resolution as sparse representation of raw image patches[C]//Proceedings of 2008 IEEE Conference on Computer Vision and Pattern Recognition, 2008: 1–8.
 Yang J C, Wright J, Huang T S, et al. Image super-resolution via sparse representation[J]. IEEE Transactions on Image Processing, 2010, 19(11): 2861–2873.
 He L, Qi H R, Zaretzki R. Beta process joint dictionary learning for coupled feature spaces with application to single image super-resolution[C]//Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition, 2013: 345–352.
 Liu W R, Li S T. Sparse representation with morphologic regularizations for single image super-resolution[J]. Signal Processing, 2014, 98: 410–422.
 Lu C W, Shi J P, Jia J Y. Online robust dictionary learn-ing[C]//Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition, 2013: 415–422.
 Ferstl D, Reinbacher C, Ranftl R, et al. Image guided depth upsampling using anisotropic total generalized varia-tion[C]//Proceedings of 2013 IEEE International Conference on Computer Vision, 2013: 993–1000.
 Ferstl D, Ruther M, Bischof H. Variational depth superresolu-tion using example-based edge representa-tions[C]//Proceedings of 2015 IEEE International Conference on Computer Vision, 2015: 513–521.
 Dong C, Loy C C, He K M, et al. Image super-resolution using deep convolutional networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38(2): 295–307.
 Bredies K, Kunisch K, Pock T. Total generalized variation[J]. SIAM Journal on Imaging Sciences, 2010, 3(3): 492–526.
 Benning M, Brune C, Burger M, et al. Higher-order TV meth-ods-enhancement via Bregman iteration[J]. Journal of Scientific Computing, 2013, 54(2–3): 269–310.
 Bissantz N, Dümbgen L, Munk A, et al. Convergence analysis of generalized iteratively reweighted least squares algorithms on convex function spaces[J]. SIAM Journal on Optimization, 2009, 19(4): 1828–1845.
 Kim J, Lee J K, Lee K M. Accurate image super-resolution using very deep convolutional networks[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition, 2016: 1646–1654.
National Natural Science Foundation of China (61877053) and General Scientific Research Projects of Zhejiang Education Department (Y201840087)
Get Citation: Mu Shaoshuo, Zhang Jiefang. An anisotropic edge total generalized variation energy super-resolution based on fast l1-norm dictionary edge representations[J]. Opto-Electronic Engineering, 2019, 46(11): 180499.