Using the CSM and VSM techniques to speed up the ICA algorithm without a loss of quality

In blind source separation problems that are implemented based on the independent component analysis (ICA) algorithm, the separation speed and quality are related inversely. In this paper, the proposed algorithms eliminate this tradeoff by generating a faster separation while maintaining the quality. In the proposed algorithms, in each frequency bin and in all of the learning steps, the separation quality of the separating matrix is compared with another one that we define as a situated matrix, and the best matrix is considered as an initial separating matrix in the next learning step. In this paper, we propose 2 algorithms based on the constant situated matrix (CSM) and the variable situated matrix (VSM). Using the simulation results, on average, the proposed CSM and VSM algorithms are about 3 and 6 times faster than the ICA algorithm, respectively, while the quality of the separated signals remains almost unchanged or becomes slightly better.

Using the CSM and VSM techniques to speed up the ICA algorithm without a loss of quality

In blind source separation problems that are implemented based on the independent component analysis (ICA) algorithm, the separation speed and quality are related inversely. In this paper, the proposed algorithms eliminate this tradeoff by generating a faster separation while maintaining the quality. In the proposed algorithms, in each frequency bin and in all of the learning steps, the separation quality of the separating matrix is compared with another one that we define as a situated matrix, and the best matrix is considered as an initial separating matrix in the next learning step. In this paper, we propose 2 algorithms based on the constant situated matrix (CSM) and the variable situated matrix (VSM). Using the simulation results, on average, the proposed CSM and VSM algorithms are about 3 and 6 times faster than the ICA algorithm, respectively, while the quality of the separated signals remains almost unchanged or becomes slightly better.

___

  • M.S. Pedersen, A Survey of Convolutive Blind Source Separation Methods, Springer Handbook on Speech Processing and Speech Communication, 2006.
  • S. Lesage, “Under-determined source separation: comparison of two approaches based on sparse decompositions”, Proceedings of the 6th International Conference on Independent Component Analysis and Blind Signal Separation, 200 M. Mahdikhani, M.H. Kahaei, “Speed up ICA algorithm without loss of quality using DR-LCO algorithm”, International Journal of Electronics and Communications (AEU), Vol. 67, pp. 72–79, 2012
  • H. Sawada, R. Mukai, S. Araki, S. Makino, “Convolutive blind source separation for more than two sources in frequency domain”, Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Vol. 3, pp. 885–888, 2004.
  • H. Sawada, R. Mukai, S. Araki, S. Makino, “A robust and precise method for solving the permutation problem of frequency-domain blind source separation”, IEEE Transactions on Audio, Speech and Language Processing, Vol. 12, pp. 530–538, 2004.
  • T.W. Lee, Independent Component Analysis - Theory and Applications, Norwell, MA, USA, Kluwer, 1998.
  • Missaoui, Z. Lachiri, “Blind speech separation based on undecimated wavelet packet perceptual filter banks and independent component analysis”, International Journal of Computer Science Issues, Vol. 8, pp. 265–272, 2011.
  • S. Haykin, Neural Networks and Learning Machines, Upper Saddle River, NJ, USA, Pearson Education, 2009.
  • J.T. Chien, H.L. Hsieh, S. Furui, “A new mutual information measure for independent component analysis”, Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 1817–1820, 200
  • D. Langlois, S. Chartier, D. Gosselin, “An introduction to independent component analysis: InfoMax and FastICA algorithms”, Tutorials in Quantitative Methods for Psychology, Vol. 6, pp. 31–38, 2010.
  • F.S. Wang, H.W. Li, R. Li, “Novel nonGaussianity measure based BSS algorithm for dependent signals”, Lecture Notes in Computer Science, Vol. 4505, pp. 837–844, 2007.
  • S. Amari, A. Cichocki, H.H. Yang, “A new learning algorithm for blind signal separation”, Advances in Neural Information Processing Systems, Vol. 8, pp. 757–763, 1996.
  • Hyvarinen, J. Karhunen, E. Oja, Independent Component Analysis, New York, Wiley, 2001.
  • Pearlmutter, L.C. Parra, “Maximum likelihood blind source separation: a context-sensitive generalization of ICA”, Advances in Neural Information Processing Systems, Vol. 9, pp. 613–619, 1997.
  • J.T. Chien, B.C. Chen, “A new independent component analysis for speech recognition and separation”, IEEE Transactions on Audio, Speech and Language Processing, Vol. 14, pp. 1245–1254, 2006.
  • S. Makino, T.W. Lee, H. Sawada, Blind Speech Separation, New York, Springer, 2007.
  • A.J. Bell, T.J. Sejnowski, “An information-maximization approach to blind separation and blind deconvolution”, Neural Computation, Vol. 7, pp. 1129–1159, 1995.
  • J.F. Cardoso, “Infomax and maximum likelihood for blind source separation”, IEEE Signal Processing Letters, Vol. 4, pp. 112–114, 1997.
  • Hyvarinen, “Fast and robust fixed-point algorithms for independent component analysis”, IEEE Transactions on Neural Networks, Vol. 10, pp. 626–634, 1999.
  • Hyvarinen, E. Oja, “A fast fixed-point algorithm for independent component analysis”, Neural Computation, Vol. 9, pp. 1483–1492, 1997.
  • H. Saruwatari, S. Kurita, K. Takeda, “Blind source separation combining frequency-domain ICA and beamforming”, Acoustics, Speech, and Signal Processing, Vol. 5, pp. 2733–2736, 2001.
  • M.A. Giese, L. Omlor, “Anechoic blind source separation using Wigner marginals”, Journal of Machine Learning Research, Vol. 12, pp. 1111–1148, 2011.
  • L. Omlor, “New methods for anechoic demixing with application to shift invariant feature extraction”, PhD, Ulm University Faculty of Engineering and Computer Science, 2010.
  • L.E.D. Persia, D.H. Milone, M. Yanagida, “Indeterminacy free frequency-domain blind separation of reverberant audio sources”, IEEE Transactions on Audio, Speech, and Language Processing, Vol. 17, pp. 299–311, 2009.
  • L.E.D. Persia, D.H. Milone, M. Yanagida, “Pseudoanechoic blind source separation with improved Wiener postfilter”, XIII Reuni´ on de Trabajo en Procesamiento de la Informaci´ ony Control, 2009.
  • N. Cho, C.J. Kuo, “Underdetermined audio source separation from anechoic mixtures with long time delay”, Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1557–1560, 200
  • T. Melia, S. Rickard, “Underdetermined blind source separation in echoic environments using DESPRIT”, EURASIP Journal on Advances in Signal Processing, Vol. 2007, pp. 90, 2006.
  • S. Rickard, T. Melia, C. Fearon, “DESPRIT – histogram based blind source separation of more sources than sensors using subspace methods”, Proceedings of the IEEE Workshop on Applications of Signal Processing in Audio and Acoustics, pp. 5–8, 2005.
  • S. Ding, A. Cichocki, J. Huang, D. Wei, “Blind source separation of acoustic signals in realistic environments based on ICA in the time-frequency domain”, Journal of Pervasive Computing and Communications, Vol. 1, pp. 89–99, 200 M. MahdiKhani, M.H. Kahaei, “Blind source separation using virtual sensors”, 4th International Conference on Digital Telecommunications, pp. 107–110, 2009.
  • M.Z. Ikram, D.R. Morgan, “A beamforming approach to permutation alignment for multichannel frequency domain blind source separation”, IEEE International Conference on Acoustics, Speech, and Signal Processing, Vol. 1, pp. 881–884, 2002.
  • N. Mitianoudis, “Audio source separation using independent component analysis”, PhD, University of London, 200 J. Anem¨ uller, T.J. Sejnowski, S. Makeig, “Complex independent component analysis of frequency-domain electroencephalographic data”, Neural Networks, Vol. 16, pp. 1311–1323, 2003.
  • Y. Liu, “Frequency domain independent component analysis applied to wireless communications over frequencyselective channels”, PhD, University of Central Florida, 2005.
  • K. Tachibana, H. Saruwatari, Y. Mori, S. Miyabe, K. Shikano, A. Tanaka, “Efficient blind source separation combining closed-form second-order ICA and nonclosed-form higher-order ICA”, IEEE International Conference on Acoustics, Speech, and Signal Processing, Vol. 1, pp. 45–48, 2007.
  • R. Saab, O. Yılmaz, M.J. McKeown, R. Abugharbieh, “Underdetermined anechoic blind source separation via lqbasis-pursuit with q < 1”, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, Vol. 55, pp. 4004–4017, 2005.
  • R. Saab, O. Yılmaz, M.J. McKeown, R. Abugharbieh, “Blind separation of anechoic under-determined speech mixtures using multiple sensors”, IEEE International Symposium on Signal Processing and Information Technology, pp. 642–646, 2006.
  • G.J. Sz´ ekely, M.L. Rizzo, N.K. Bakirov, “Measuring and testing independence by correlation of distances”, Annals of Statistics, Vol. 35, pp. 2769–2794, 2007.
  • R´ enyi, “On measures of dependence”, Acta Mathematica Academiae Scientiarum Hungarica, Vol. 10, pp. 441–451, 19 P. Xie, S.L. Grant, “A fast and efficient frequency-domain method for convolutive blind source separation”, IEEE Region 5 Conference, pp. 1–4, 2008.
  • Colomes, C. Schmidmer, T. Thiede, W. Treurniet, “Perceptual quality assessment for digital audio (PEAQ): the new ITU standard for objective measurement of perceived audio quality”, 17th International Conference on High Quality Audio Coding, pp. 337–351, 1999.
  • R. Gribonval, L. Benaroya, E. Vincent, C. F´ evotte, “Proposals for performance measurement in source separation”, 4th International Symposium on Independent Component Analysis and Blind Signal Separation, pp. 763–768, 2003. ITU-T Recommendation P.862, “Perceptual evaluation of speech quality (PESQ), an objective method for end-toend speech quality assessment of narrowband telephone networks and speech codecs”, 2001.
  • L.D. Persia, D. Milone, H.L. Rufiner, M. Yanagida, “Perceptual evaluation of blind source separation for robust speech recognition”, Signal Processing, Vol. 88, pp. 2578–2583, 2008.
Turkish Journal of Electrical Engineering and Computer Science-Cover
  • ISSN: 1300-0632
  • Yayın Aralığı: Yılda 6 Sayı
  • Yayıncı: TÜBİTAK