H. Seçkin DEMİR, Erdem AKAGÜNDÜZ

4934

Filter design for small target detection on infrared imagery using normalized-cross-correlation layer

In this paper, we introduce a machine learning approach to the problem of infrared small target detection filter design. For this purpose, similar to a convolutional layer of a neural network, the normalized-cross-correlational NCC layer, which we utilize for designing a target detection/recognition filter bank, is proposed. By employing the NCC layer in a neural network structure, we introduce a framework, in which supervised training is used to calculate the optimal filter shape and the optimum number of filters required for a specific target detection/recognition task on infrared images. We also propose the mean-absolute-deviation NCC MAD-NCC layer, an efficient implementation of the proposed NCC layer, designed especially for FPGA systems, in which square root operations are avoided for real-time computation. As a case study we work on dim-target detection on midwave infrared imagery and obtain the filters that can discriminate a dim target from various types of background clutter, specific to our operational concept.
Keywords:

Small target detection, filter design normalized-cross-correlation, convolutional neural networks,

PDF

___

  • [1] Zhang W, Cong M, Wang L. Algorithms for optical weak small targets detection and tracking: review. In: International Conference on Neural Networks and Signal Processing; Nanjing, China; 2003. pp. 643-647.
  • [2] Bai X, Zhang S, Du B, Liu Z, Jin T et al. Survey on dim small target detection in clutter background: wavelet, inter-frame and filter based algorithms. Procedia Engineering 2011; 15 (C): 479-483.
  • [3] Sanna A, Lamberti F. Advances in target detection and tracking in forward-looking infrared (FLIR) imagery. Sensors 2014; 14(11): 20297-20303.
  • [4] Warren RC. Detection of distant airborne targets in cluttered backgrounds in infrared image sequences. PhD, Engineering University of South Australia, Australia, 2002.
  • [5] Barnett J. Statistical analysis of median subtraction filtering with application to point target detection in infrared backgrounds. In: Infrared Systems and Components III. (SPIE); Los Angeles, CA, USA; 1989. pp. 10-18.
  • [6] Tom VT, Peli T, Leung M, Bondaryk JE. Morphology-based algorithm for point target detection in infrared backgrounds. In: Signal and Data Processing of Small Targets. (SPIE); Orlando, Florida, USA; 1993. pp. 2-11.
  • [7] Nitzberg R, Takken EH, Friedman D, Milton AF. Spatial filtering techniques for infrared (IR) sensors. In: Smart Sensors. (SPIE); Washington, D.C, USA; 1979. pp. 40-58.
  • [8] Schmidt WAC. Modified matched filter for cloud clutter suppression. IEEE Transactions on Pattern Analysis and Machine Intelligence 1990; 12 (6): 594-600.
  • [9] Wen P, Shi Z, Yu H, Wu X. A method for automatic infrared point target detection in a sea background based on morphology and wavelet transform. In: 3rd International Symposium on Multispectral Image Processing and Pattern Recognition. (SPIE); Beijing, China; 2003. pp. 248-253.
  • [10] Yang L, Yang J, Yang K. Adaptive detection for infrared small target under sea-sky complex background. Electronics Letters. 2004; 40 (17): 1083-1085.
  • [11] Bai X, Zhou F. Analysis of new top-hat transformation and the application for infrared dim small target detection. Pattern Recognition. 2010; 43 (6): 2145-2156.
  • [12] Bae TW, Zhang F, Kweon IS. Edge directional 2D LMS filter for infrared small target detection. Infrared Physics & Technology. 2012; 55 (1): 137-145.
  • [13] Deng H, Sun X, Liu M, Ye C, Zhou X. Small infrared target detection based on weighted local difference measure. IEEE Transactions on Geoscience and Remote Sensing. 2016; 54 (7): 4204-4214.
  • [14] Wang X, Lv G, Xu L. Infrared dim target detection based on visual attention. Infrared Physics & Technology 2012; 55 (6): 513-521.
  • [15] Kim S, Lee J. Scale invariant small target detection by optimizing signal-to-clutter ratio in heterogeneous background for infrared search and track. Pattern Recognition 2012; 45 (1): 393-406.
  • [16] Gao C, Meng D, Yang Y, Wang Y, Zhou X et al. Infrared patch-image model for small target detection in a single image. IEEE Transactions on Image Processing 2013; 22 (12): 4996-5009.
  • [17] Chen CP, Li H, Wei Y, Xia T, Tang YY. A local contrast method for small infrared target detection. IEEE Transactions on Geoscience and Remote Sensing 2014; 52 (1): 574-581.
  • [18] Han J, Ma Y, Huang J, Mei X, Ma J. An infrared small target detecting algorithm based on human visual system. IEEE Geoscience and Remote Sensing Letters 2016; 13 (3): 452-456.
  • [19] Wei Y, You X, Li H. Multiscale patch-based contrast measure for small infrared target detection. Pattern Recognition 2016; 58 (C): 216-226.
  • [20] Han J, Ma Y, Zhou B, Fan F, Liang K et al. A robust infrared small target detection algorithm based on human visual system. IEEE Geoscience and Remote Sensing Letters 2014; 11 (12): 2168-2172.
  • [21] Gregoris DJ, Yu SKW, Tritchew S, Sevigny L. Detection of dim targets in FLIR imagery using multiscale transforms. In: Infrared Technology XX. (SPIE); San Diego, CA, USA; 1994. pp. 62-71.
  • [22] Wang G, Zhang T, Wei L, Sang N. Efficient method for multiscale small target detection from a natural scene. Optical Engineering 1997; 35 (3): 761-768.
  • [23] Wang Z, Tian J, Liu J, Zheng S. Small infrared target fusion detection based on support vector machines in the wavelet domain. Optical Engineering 2006; 45 (7): 1-9.
  • [24] Kim S, Lee J. Scale invariant small target detection by optimizing signal-to-clutter ratio in heterogeneous background for infrared search and track. Pattern Recognition 2012; 45 (1): 393-406.
  • [25] Wei Y, You X, Li H. Multiscale patch-based contrast measure for small infrared target detection. Pattern Recognition 2016; 58 (C): 216-226.
  • [26] Deng H, Sun X, Liu M, Ye C, Zhou X. Entropy-based window selection for detecting dim and small infrared targets. Pattern Recognition 2017; 61 (C): 66-77.
  • [27] Qi S, Xu G, Mou Z, Huang D, Zheng X. A fast-saliency method for real-time infrared small target detection. Infrared Physics & Technology 2016; 77 (C): 440-450.
  • [28] Alam MS, Bhuiyan SMA. Trends in correlation-based pattern recognition and tracking in forward-looking infrared imagery. Sensors 2014; 14 (8): 13437–13475.
  • [29] Gundogdu E, Ozkan H, Demir HS, Ergezer H, Akagunduz E et al. Comparison of infrared and visible imagery for object tracking: Toward trackers with superior IR performance. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops; Boston, Massachusetts, USA; 2015. pp. 1-9.
  • [30] Shao L, Zhang H, de Haan G. An overview and performance evaluation of classification-based least squares trained filters. IEEE Transactions on Image Processing 2008; 17 (10): 1772-1782.
  • [31] Gundogdu E, Alatan AA. Good features to correlate for visual tracking. IEEE Transactions on Image Processing 2018; 27 (5): 2526-2540.
  • [32] Valmadre J, Bertinetto L, Henriques J, Vedaldi A, Torr PHS. End-to-end representation learning for correlation filter based tracking. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR); Honolulu, Hawaii, USA; 2017. pp. 5000-5008.
  • [33] Arora R, Basu A, Mianjy P, Mukherjee A. Understanding deep neural networks with rectified linear units. In: 6th International Conference on Learning Representations, ICLR, Vancouver, BC, Canada; 2018. pp. 1-6.
  • [34] Vedaldi A, Lenc K. MatConvNet: convolutional neural networks for MATLAB. In: 23rd ACM International Conference on Multimedia; Brisbane, Australia; 2015. pp. 689-692.
  • [35] Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R et al. Caffe: Convolutional architecture for fast feature embedding. In: Proceedings of the 22nd ACM International Conference on Multimedia; Orlando, Florida, USA; 2014. pp. 675-678.
  • [36] Kachhwal P, Rout BC. Novel square root algorithm and its FPGA implementation. In: 2014 International Conference on Signal Propagation and Computer Technology (ICSPCT); Ajmer, Rajasthan, India; 2014. pp. 158- 162.
  • [37] Shafer D. Infrared collimator system. Applied Optics 1993; 32(34): 7117-7118.
  • [38] Mudau AE, Willers CJ, Griffith D, le Roux FPJ. Non-uniformity correction and bad pixel replacement on LWIR and MWIR images. In: 2011 Saudi International Electronics, Communications and Photonics Conference (SIECPC); Riyadh, Saudi Arabia; 2011. pp. 1-5.
Turkish Journal of Electrical Engineering and Computer Science-Cover
  • ISSN: 1300-0632
  • Yayın Aralığı: Yılda 6 Sayı
  • Yayıncı: TÜBİTAK
Arşiv
Sayıdaki Diğer Makaleler

Can ALKAN

H. Seçkin DEMİR, Erdem AKAGÜNDÜZ

Yazeed M QASAYMEH, Abdullah ALMUHASIEN, Talha KAMRAN

Mahdi SAADATMAND, Babak MOZAFARI, Gevork B. GHAREHPETIAN, Soodabeh SOLEYMANI

Mohammad Amir Ghasemı SHABANKAREH

Fatih KORKMAZ

Erdinç AVAROĞLU, Taner TUNCER

Qing DUAN, Wanxing SHENG, Guanglin SHA, Zhen LI, Caihong ZHAO, Penghua LI, Chunyan MA

Bushra LATIF, Tauseef RANA

Mohammed Anwar MOHAMMED, Fadhil Salman ABED