Neural Computing and Applications

Lan, Yuan; Hu, Zongjiang; Soh, Yeng; Huang, Guang-Bin

doi: 10.1007/s00521-012-0946-xpmid: N/A

Over the last two decades, automatic speaker recognition has been an interesting and challenging problem to speech researchers. It can be classified into two different categories, speaker identification and speaker verification. In this paper, a new classifier, extreme learning machine, is examined on the text-independent speaker verification task and compared with SVM classifier. Extreme learning machine (ELM) classifiers have been proposed for generalized single hidden layer feedforward networks with a wide variety of hidden nodes. They are extremely fast in learning and perform well on many artificial and real regression and classification applications. The database used to evaluate the ELM and SVM classifiers is ELSDSR corpus, and the Mel-frequency Cepstral Coefficients were extracted and used as the input to the classifiers. Empirical studies have shown that ELM classifiers and its variants could perform better than SVM classifiers on the dataset provided with less training time.

Nian, Rui; He, Bo; Lendasse, Amaury

doi: 10.1007/s00521-012-0892-7pmid: N/A

In this paper, one geometrical topology hypothesis is present based on the optimal cognition principle, and the single-hidden layer feedforward neural network with extreme learning machine (ELM) is used for 3D object recognition. It is shown that the proposed approach can identify the inherent distribution and the dependence structure for each 3D object along multiple view angles by evaluating the local topological segments with a dipole topology model and developing the relevant mathematical criterion with ELM algorithm. The ELM ensemble is then used to combine the individual single-hidden layer feedforward neural network of each 3D object for performance improvements. The simulation results have shown the excellent performance and the effectiveness of the developed scheme.

Yang, Jucheng; Xie, Shanjuan; Yoon, Sook; Park, Dongsun; Fang, Zhijun; Yang, Shouyuan

doi: 10.1007/s00521-011-0806-0pmid: N/A

Considering fingerprint matching as a classification problem, the extreme learning machine (ELM) is a powerful classifier for assigning inputs to their corresponding classes, which offers better generalization performance, much faster learning speed, and minimal human intervention, and is therefore able to overcome the disadvantages of other gradient-based, standard optimization-based, and least squares-based learning techniques, such as high computational complexity, difficult parameter tuning, and so on. This paper proposes a novel fingerprint recognition system by first applying the ELM and Regularized ELM (R-ELM) to fingerprint matching to overcome the demerits of traditional learning methods. The proposed method includes the following steps: effective preprocessing, extraction of invariant moment features, and PCA for feature selection. Finally, ELM and R-ELM are used for fingerprint matching. Experimental results show that the proposed methods have a higher matching accuracy and are less time-consuming; thus, they are suitable for real-time processing. Other comparative studies involving traditional methods also show that the proposed methods with ELM and R-ELM outperform the traditional ones.

Zheng, Wenbin; Qian, Yuntao; Lu, Huijuan

doi: 10.1007/s00521-011-0808-ypmid: N/A

This article proposes a novel approach for text categorization based on a regularization extreme learning machine (RELM) in which its weights can be obtained analytically, and a bias-variance trade-off could be achieved by adding a regularization term into the linear system of single-hidden layer feedforward neural networks. To fit the input scale of RELM, the latent semantic analysis was used to represent text for dimensionality reduction. Moreover, a classification algorithm based on RELM was developed including the uni-label (i.e., a document can only be assigned to a unique category) and multi-label (i.e., a document can be assigned to multiple categories simultaneously) situations. The experimental results in two benchmarks show that the proposed method can produce good performance in most cases, and it could learn faster than popular methods such as feedforward neural networks or support vector machine.

Lee, Kevin; Man, Zhihong; Wang, Dianhui; Cao, Zhenwei

doi: 10.1007/s00521-012-0847-zpmid: N/A

In this paper, the classification of the two binary bioinformatics datasets, leukemia and colon tumor, is further studied by using the recently developed neural network-based finite impulse response extreme learning machine (FIR-ELM). It is seen that a time series analysis of the microarray samples is first performed to determine the filtering properties of the hidden layer of the neural classifier with FIR-ELM for feature identification. The linear separability of the data patterns in the microarray datasets is then studied. For improving the robustness of the neural classifier against noise and errors, a frequency domain gene feature selection algorithm is also proposed. It is shown in the simulation results that the FIR-ELM algorithm has an excellent performance for the classification of bioinformatics data in comparison with many existing classification algorithms.

Kan, Ee; Lim, Meng; Ong, Yew; Tan, Ah; Yeo, Swee

doi: 10.1007/s00521-012-0866-9pmid: N/A

Unmanned aerial vehicles (UAVs) rely on global positioning system (GPS) information to ascertain its position for navigation during mission execution. In the absence of GPS information, the capability of a UAV to carry out its intended mission is hindered. In this paper, we learn alternative means for UAVs to derive real-time positional reference information so as to ensure the continuity of the mission. We present extreme learning machine as a mechanism for learning the stored digital elevation information so as to aid UAVs to navigate through terrain without the need for GPS. The proposed algorithm accommodates the need of the on-line implementation by supporting multi-resolution terrain access, thus capable of generating an immediate path with high accuracy within the allowable time scale. Numerical tests have demonstrated the potential benefits of the approach.

Wang, Hai; Qian, Gang; Feng, Xiang-Qian

doi: 10.1007/s00521-012-0853-1pmid: N/A

Predicting consumer sentiments revealed in online reviews is crucial to suppliers and potential consumers. We combine online sequential extreme learning machines (OS-ELMs) and intuitionistic fuzzy sets to predict consumer sentiments and propose a generalized ensemble learning scheme. The outputs of OS-ELMs are equivalently transformed into an intuitionistic fuzzy matrix. Then, predictions are made by fusing the degree of membership and non-membership concurrently. Moreover, we implement ELM, OS-ELM, and the proposed fusion scheme for Chinese reviews sentiment prediction. The experimental results have clearly shown the effectiveness of the proposed scheme and the strategy of weighting and order inducing.

Muhammad, Ishaq; Tepe, Kemal; Abdel-Raheem, Esam

doi: 10.1007/s00521-011-0796-ypmid: N/A

This paper presents a new learning-based framework to jointly solve equalization and symbol detection problems in orthogonal frequency division multiplexing systems with quadrature amplitude modulation. The framework utilizes extreme learning machine (ELM), a recent addition to the class of supervised learning algorithms, to achieve fast training, high performance, and low error rates. The proposed ELM scheme employs infinitely differentiable nonlinear activation functions in least-square solution to learn the channel response, which is the equalization part. In addition to equalization, ELM performs symbol detection. Existing learning-based schemes require an additional symbol slicer for the symbol detection. The proposed framework does not experience training bottleneck imposed by gradient descent–based approaches. Simulation results show that the proposed framework outperforms other learning-based equalizers in terms of symbol error rate and training speeds.

Xu, Yan; Dai, Yuanyu; Dong, Zhao; Zhang, Rui; Meng, Ke

doi: 10.1007/s00521-011-0803-3pmid: N/A

As a novel and promising learning technology, extreme learning machine (ELM) is featured by its much faster training speed and better generalization performance over traditional learning techniques. ELM has found applications in solving many real-world engineering problems, including those in electric power systems. Maintaining frequency stability is one of the essential requirements for secure and reliable operations of a power system. Conventionally, its assessment involves solving a large set of nonlinear differential–algebraic equations, which is very time-consuming and can be only carried out off-line. This paper firstly reviews the ELM’s applications in power engineering and then develops an ELM-based predictor for real-time frequency stability assessment (FSA) of power systems. The inputs of the predictor are power system operational parameters, and the output is the frequency stability margin that measures the stability degree of the power system subject to a contingency. By off-line training with a frequency stability database, the predictor can be online applied for real-time FSA. Benefiting from the very fast speed of ELM, the predictor can be online updated for enhanced robustness and reliability. The developed predictor is examined on the New England 10-generator 39-bus test system, and the simulation results show that it can exactly (within acceptable errors) and rapidly (within very small computing time) predict the frequency stability.

Zhao, Lijie; Wang, Dianhui; Chai, Tianyou

doi: 10.1007/s00521-012-0837-1pmid: N/A

The accurate and reliable measurement of effluent quality indices is essential for the implementation of successful control and optimization of wastewater treatment plants. In order to enhance the estimate performance in terms of accuracy and reliability, we present a partial least-squares-based extreme learning machine (called PLS-ELM) in this paper. The partial least squares (PLS) regression is applied to the ELM framework to improve the algebraic property of the hidden output matrix, which can be ill-conditional due to the high multicollinearity of the hidden layer output. The main idea behind our proposed PLS-ELM is to achieve a robust generalization performance by extracting a reduced number of latent variables from the hidden layer and using orthogonal projection operations. The results from a case study of a municipal wastewater treatment plant show that the PLS-ELM can effectively capture the input–output relationship with favorable performance against the conventional ELM.