Access the full text.
Sign up today, get DeepDyve free for 14 days.
Loading next page...
/lp/hindawi-publishing-corporation/a-review-of-feature-selection-and-feature-extraction-methods-applied-wblLqQMSRK
References
References for this paper are not available at this time. We will be adding them shortly, thank you for your patience.
- Publisher
- Hindawi Publishing Corporation
- Copyright
- Copyright © 2015 Zena M. Hira and Duncan F. Gillies.
- ISSN
- 1687-8027
- eISSN
- 1687-8035
- Publisher site
- See Article on Publisher Site
Abstract
A Review of Feature Selection and Feature Extraction Methods Applied on Microarray Data div.banner_title_bkg div.trangle { border-color: #000000 transparent transparent transparent; opacity:0.7; /*new styles start*/ -ms-filter:"progid:DXImageTransform.Microsoft.Alpha(Opacity=70)" ;filter: alpha(opacity=70); /*new styles end*/ } div.banner_title_bkg_if div.trangle { border-color: transparent transparent #000000 transparent ; opacity:0.7; /*new styles start*/ -ms-filter:"progid:DXImageTransform.Microsoft.Alpha(Opacity=70)" ;filter: alpha(opacity=70); /*new styles end*/ } div.banner_title_bkg div.trangle { width: 260px; } #banner { background-image: url('http://images.hindawi.com/journals/abi/abi.banner.jpg'); background-position: 50% 0;} Hindawi Publishing Corporation Home Journals About Us Advances in Bioinformatics About this Journal Submit a Manuscript Table of Contents Journal Menu About this Journal · Abstracting and Indexing · Advance Access · Aims and Scope · Article Processing Charges · Articles in Press · Author Guidelines · Bibliographic Information · Citations to this Journal · Contact Information · Editorial Board · Editorial Workflow · Free eTOC Alerts · Publication Ethics · Reviewers Acknowledgment · Submit a Manuscript · Subscription Information · Table of Contents Open Special Issues · Published Special Issues · Special Issue Guidelines Abstract Full-Text PDF Full-Text HTML Full-Text ePUB Full-Text XML Linked References How to Cite this Article Advances in Bioinformatics Volume 2015 (2015), Article ID 198363, 13 pages http://dx.doi.org/10.1155/2015/198363 Review Article A Review of Feature Selection and Feature Extraction Methods Applied on Microarray Data Zena M. Hira and Duncan F. Gillies Department of Computing, Imperial College London, London SW7 2AZ, UK Received 25 March 2015; Accepted 18 May 2015 Academic Editor: Huixiao Hong Copyright © 2015 Zena M. Hira and Duncan F. Gillies. This is an open access article distributed under the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Abstract We summarise various ways of performing dimensionality reduction on high-dimensional microarray data. Many different feature selection and feature extraction methods exist and they are being widely used. All these methods aim to remove redundant and irrelevant features so that classification of new instances will be more accurate. A popular source of data is microarrays, a biological platform for gathering gene expressions. Analysing microarrays can be difficult due to the size of the data they provide. In addition the complicated relations among the different genes make analysis more difficult and removing excess features can improve the quality of the results. We present some of the most popular methods for selecting significant features and provide a comparison between them. Their advantages and disadvantages are outlined in order to provide a clearer idea of when to use each one of them for saving computational time and resources. 1. Introduction In machine learning as the dimensionality of the data rises, the amount of data required to provide a reliable analysis grows exponentially. Bellman referred to this phenomenon as the “curse of dimensionality” when considering problems in dynamic optimisation [ 1 ]. A popular approach to this problem of high-dimensional datasets is to search for a projection of the data onto a smaller number of variables (or features) which preserves the information as much as possible. Microarray data is typical of this type of small sample problem. Each data point (sample) can have up to 450,000 variables (gene probes) and processing a large number of data points involves high computational cost [ 2 ]. When the dimensionality of a dataset grows significantly there is an increasing difficulty in proving the result statistically significant due to the sparsity of the meaningful data in the dataset in question. Large datasets with the so-called “large , small ” problem (where is the number of features and is the number of samples) tend to be prone to overfitting. An overfitted model can mistake small fluctuations for important variance in the data which can lead to classification errors. This difficulty can also increase due to noisy features. Noise in a dataset is defined as “ the error in the variance of a measured variable ” which can result from errors in measurements or natural variation [ 3 ]. Machine learning algorithms tend to be affected by noisy data. Noise should be reduced as much as possible in order to avoid unnecessary complexity in the inferred models and improve the efficiency of the algorithm [ 4 ]. Common noise can be divided into two types [ 5 ]: (1) Attribute noise. (2) Class noise. Attribute noise is caused by errors in the attribute values (wrongly measured variables, missing values) while class noise is caused by samples that are labelled to belong in more than one class and/or misclassifications. As the dimensionality increases the computational cost also increases, usually exponentially. To overcome this problem it is necessary to find a way to reduce the number of features in consideration. Two techniques are often used: (1) Feature subset selection. (2) Feature extraction. Cancer is among the leading causes of death worldwide accounting for more than 8 million deaths according to the World Health Organization. It is expected that the deaths from cancer will rise to 14 million in the next two decades. Cancer is not a single disease. There are more than 100 known different types of cancer and probably many more. The term cancer is used to describe the abnormal growth of cells that can, for example, form extra tissue called mass and then attack other organs [ 6 ]. Microarray databases are a large source of genetic data, which, upon proper analysis, could enhance our understanding of biology and medicine. Many microarray experiments have been designed to investigate the genetic mechanisms of cancer, and analytical approaches have been applied in order to classify different types of cancer or distinguish between cancerous and noncancerous tissue. In the last ten years, machine learning techniques have been investigated in microarray data analysis. Several approaches have been tried in order to (i) distinguish between cancerous and noncancerous samples, (ii) classify different types of cancer, and (iii) identify subtypes of cancer that may progress aggressively. All these investigations are seeking to generate biologically meaningful interpretations of complex datasets that are sufficiently interesting to drive follow-up experimentation. This review paper is structured as follows. The next section is about feature selection methods (filters, wrappers, and embedded techniques) applied on microarray cancer data. Then we discuss feature extraction methods (linear and nonlinear) in microarray cancer data and the final section is about using prior knowledge in combination with a feature extraction or feature selection method to improve classification accuracy and algorithmic complexity. 2. Feature Subset Selection in Microarray Cancer Data Feature subset selection works by removing features that are not relevant or are redundant. The subset of features selected should follow the Occam’s Razor principle and also give the best performance according to some objective function. In many cases this is an NP-hard (nondeterministic polynomial-time hard) problem [ 7 , 8 ]. The size of the data to be processed has increased the past 5 years and therefore feature selection has become a requirement before any kind of classification takes place. Unlike feature extraction methods, feature selection techniques do not alter the original representation of the data [ 9 ]. One objective for both feature subset selection and feature extraction methods is to avoid overfitting the data in order to make further analysis possible. The simplest is feature selection, in which the number of gene probes in an experiment is reduced by selecting only the most significant according to some criterion such as high levels of activity. Feature selection algorithms are separated into three categories [ 10 , 11 ]: (i) The filters which extract features from the data without any learning involved. (ii) The wrappers that use learning techniques to evaluate which features are useful. (iii) The embedded techniques which combine the feature selection step and the classifier construction. 2.1. Filters Filters work without taking the classifier into consideration. This makes them very computationally efficient. They are divided into multivariate and univariate methods. Multivariate methods are able to find relationships among the features, while univariate methods consider each feature separately. Gene ranking is a popular statistical method. The following methods were proposed in order to rank the genes in a dataset based on their significance [ 12 ]: (i) (Univariate) Unconditional Mixture Modelling assumes two different states of the gene on and off and checks whether the underlying binary state of the gene affects the classification using mixture overlap probability. (ii) (Univariate) Information Gain Ranking approximates the conditional distribution , where is the class label and is the feature vector. Information gain is used as a surrogate for the conditional distribution. (iii) (Multivariate) Markov Blanket Filtering finds features that are independent of the class label so that removing them will not affect the accuracy. In multivariate methods, pair -scores are used for evaluating gene pairs depending on how well they can separate two classes in an attempt to identify genes that work together to provide a better classification [ 13 ]. Their results for the gene pair rankings were found to be “at least as interesting as the single genes found by an independent evaluation.” Methods based on correlation have also been suggested: (i) (Multivariate) Error-Weighted Uncorrelated Shrunken Centroid (EWUSC): this method is based on the uncorrelated shrunken centroid (USC) and shrunken centroid (SC). The shrunken centroid is found by dividing the average gene expression for each gene in each class by the standard deviation for that gene in the same class. This way higher weight is given to genes whose expression is the same among different samples in the same class. New samples are assigned to the label with the nearest average pattern (using squared distance). The uncorrelated shrunken centroid approach removes redundant features by finding genes that are highly correlated in the set of genes already found by SC. The EWUSC uses both of these steps and in addition adds error-weights (based on within-class variability) so that noisy genes will be downgraded and redundant genes are removed [ 14 ]. A comparison is shown in Figure 1 where the three different methods are tested on a relatively small (25000 genes and 78 samples) breast cancer dataset. The algorithms perform well when the number of relevant genes is less than 1000. (ii) (Multivariate) Minimum Redundancy Maximum Relevance (mRMR): mRMR is a method that maximises the relevancy of genes with the class label while it minimises the redundancy in each class. To do so, it uses several statistical measures. Mutual Information (MI) measures the information a random variable can give about another, in particular the gene activity and the class label. The method can be applied to both categorical and continuous variables. For categorical (discrete) variables, MI is used to find genes that are not redundant (minimise redundancy) and are maximally relevant with a target label [ 15 ] as shown in ( 1 ) and ( 2 ), respectively: where is the MI, and are genes, is the number of features in , and is a class label. For continuous variables the -statistic (ANOVA test or regression analysis to check whether the means of two populations are significantly different) is used to find the maximum relevance between a gene and a class label and then the correlation of the gene pair in that class is measured to minimise redundancy [ 15 ] as shown in ( 3 ) and ( 4 ), respectively: where is the -statistic, and are genes, is a class label, is the number of features in , and is the correlation. mRMR can be used in combination with entropy. Normalised mutual information is used to measure the relevance and redundancy of clusters of genes. Then the most relevant genes are combined and LOOCV (leave-one-out cross-validation) is performed to find the accuracy [ 16 ]. For continuous variables linear relationships are used instead of mutual information. MRMR methods give lower error accuracies for both categorical and discrete data. (iii) (Multivariate) Correlation-based feature selection (CFS) as stated by Hall [ 17 ] follows the principal that “ a good feature subset is one that contains features highly correlated with the class yet uncorrelated with each other. ” CFS evaluates a subset by considering the predictive ability of each one of its features individually and also their degree of redundancy (or correlation). The difference between CFS and other methods is that it provides a “ heuristic merit ” for a feature subset instead of each feature independently [ 18 ]. This means that given a function (heuristic), the algorithm can decide on its next moves by selecting the option that maximises the output of this function. Heuristic functions can also be designed to minimise the cost to the goal. Figure 1: Comparison between EWUSC, USC, and SC on breast cancer data [ 14 ]. ReliefF [ 19 ] is also widely used with cancer microarray data. It is a multivariate method that chooses the features that are the most distinguishable among the different classes. It repeatedly draws an instance (sample) and, based on its neighbours, it gives most weight to the features that help discriminate it from the neighbours of a different class [ 20 , 21 ]. A method using independent logistic regression with two steps was also proposed [ 22 ]. The first step is a univariate method in which the genes are ranked according to their Pearson correlation coefficients. The top genes are considered in the second phase, which is stepwise variable selection. This is a conditionally univariate method based on the inclusion (or exclusion) of a single gene at a time, conditioned on the variables already included. A comparison of ReliefF, Information Gain , Information Gain Ratio , and is shown in Figure 2 . The methods perform similarly across the number of genes selected. Information Gain Ratio is defined as the information gain over the intrinsic information. It performs normalisation to the information gain using split value information. The Pearson test evaluates the possibility of a value appearing by chance. Figure 2: Comparison between ReliefF, Information Gain, Information Gain Ratio, and test on ALL and MLL Leukaemia datasets [ 21 ]. Statistical methods often assume a Gaussian distribution on the data. The central limit theorem can guarantee that large datasets are always normally distributed. Even though all these methods can be highly accurate in classifying information there is no biological significance proven with the genes that are identified by them. None of the above methods have indicated whether the results are actually biologically relevant or not. In addition filter methods are generally faster than wrappers but do not take into account the classifier which can be a disadvantage. Ignoring the specific heuristics and biases of the classifier might lower the classification accuracy. 2.2. Wrappers Wrappers tend to perform better in selecting features since they take the model hypothesis into account by training and testing in the feature space. This leads to the big disadvantage of wrappers, the computational inefficiency which is more apparent as the feature space grows. Unlike filters, they can detect feature dependencies. Wrappers are separated in 2 categories: Randomised and Deterministic . A comparison is shown in Table 1 . Table 1: Deterministic versus randomised wrappers. 2.2.1. Deterministic Wrappers A number of deterministic investigations have been used to examine breast cancer such as a combination of a wrapper and sequential forward selection (SFS). SFS is a deterministic feature selection method that works by using hill-climbing search to add all possible single-attribute expansions to the current subset and evaluate them. It starts from an empty subset of genes and sequentially selects genes, one at a time, until no further improvement is achieved in the evaluation function. The feature that leads to the best score is added permanently [ 23 ]. For classification, support vector machines (SVMs), -nearest neighbours, and probabilistic neural networks were used in an attempt to classify between cancerous and noncancerous breast tumours [ 24 ]. Very accurate results were achieved using SVMs. Three methods based on SVMs are very widely used in microarray cancer datasets: (1) Gradient-based-leave-one-out gene selection (GLGS) [ 25 – 28 ] was originally introduced for selecting parameters for the SVMs. It starts by applying PCA on the dataset. A vector with scaling factors of the new low-dimensional space is calculated and optimised using a gradient-based algorithm. The pseudo scaling factors of the original genes are calculated. Genes are sequentially selected based on a correlation factor. (2) Leave-one-out calculation sequential forward selection (LOOCSFS) is a very widely used feature selection method for cancer data based on sequential forward selection (SFS). It adds features in an initially empty set and calculates the leave-one-out cross-validation error [ 29 ]. It is an almost unbiased estimator of the generalisation error using SVMs and C Bound. C Bound is the decision boundary and it is used as a supplementary criterion in the case where different features in the subset have the same leave-one-out cross-validation error (LOOCVE) [ 26 , 30 , 31 ]. SFS can also add constraints [ 32 ] on the size of the subset to be selected. It can be used in combination with a recursive support vector machine (R-SVM) algorithm that selects important genes or biomarkers [ 33 ]. The contribution factor , based on minimal error of the support vector machine, of each gene is calculated and ranked. The top ranked genes are chosen for the subset. LOOCSFS is expected to be an accurate estimator of the generalization error while GLGS scales very well with high-dimensional datasets. The number of the genes in the feature subset for both LOOCSFS and GLGS has to be given in advance which can be a disadvantage since the most important genes are not known in advance. GLGS is said to perform better than LOOCSFS. 2.2.2. Randomised Wrappers Most randomised wrappers use genetic algorithms (GA) (Algorithm 1 ) and simulated annealing (Algorithm 2 ). Best Incremental Ranked Subset (BIRS) [ 35 ] is an algorithm that scores genes based on their value and class label and then uses incremental ranked usefulness (based on the Markov blanket) to identify redundant genes. Linear discriminant analysis was used in combination with genetic algorithms. Subsets of genes are used as chromosomes and the best 10% of each generation is merged with the previous ones. Part of the chromosome is the discriminant coefficient which indicates the importance of a gene for a class label [ 36 ]. Genetic Algorithm-Support Vector Machine (GA-SVM) [ 37 ] creates a population of chromosomes as binary strings that represent the subset of features that are evaluated using SVMs. Simulated annealing works by assuming that some parts of the current solution belong to a better one and therefore proceeds to explore the neighbours seeking for solutions that minimise the objective function and therefore avoid global optima. Hybrid methods with simulated annealing and genetic algorithms have also been used [ 38 ]. A genetic algorithm is run as a first step before the simulated annealing in order to get the fittest individuals as inputs to the simulated annealing algorithm. Each solution is evaluated using Fuzzy -Means (a clustering algorithm that uses coefficients to describe how relevant a feature is to a cluster [ 39 , 40 ]). The problem with genetic algorithms is that the time complexity becomes , where is the number of samples, is the dimension of the data sets, represents the population size, and is the number of generations. In order for the algorithm to be effective the number of generations and the population size must be quite large. In addition like all wrappers, randomised algorithms take up more CPU time and more memory to run. Algorithm 1: Genetic algorithm. Algorithm 2: Simulated annealing algorithm. 2.3. Embedded Techniques Embedded techniques tend to do better computationally than wrappers but they make classifier dependent selections that might not work with any other classifier. That is because the optimal set of genes is built when the classifier is constructed and the selection is affected by the hypotheses the classifier makes. A well-known embedded technique is random forests. A random forest is a collection of classifiers. New random forests are created iteratively by discarding a small fraction of genes that have the lowest importance [ 41 ]. The forest with the smallest amount of features and the lowest error is selected to be the feature subset. A method called block diagonal linear discriminant analysis (BDLDA) [ 42 ] assumes that only a small number of genes are associated with a disease and therefore only a small number are needed in order for the classification to be accurate. To limit the number of features it imposes a block diagonal structure on the covariance matrix. In addition SVMs can be used for both feature selection and classification. Features that do not contribute to classification are eliminated in each round until no further improvement in the classification can be achieved [ 43 ]. Support vector machines-recursive feature elimination (SVM-RFE) starts with all the features and gradually excludes the ones that do not identify separating samples in different classes. A feature is considered useful based on its weight resulting from training SVMs with the current set of features. In order to increase the likelihood that only the “best” features are selected, feature elimination progresses gradually and includes cross-validation steps [ 26 , 44 – 46 ]. A major advantage of SVM-RFE is that it can select high-quality feature subsets for a particular classifier. It is however computationally expensive since it goes through all features one by one and it does not take into account any correlation the features might have [ 30 ]. SVM-RFE was compared against two wrappers: leave-one-out calculation sequential forward selection and gradient-based-leave-one-out. All three of these methods have similar computational times when run against a Hepatocellular Carcinoma dataset (7129 genes and 60 samples). GLGS outperforms the others, with LOOCSFS and SVM-RFE having similar performance errors [ 27 ]. The most commonly used methods on microarray data analysis are shown in Table 2 . Table 2: Feature selection methods applied on microarray data. 3. Feature Extraction in Microarray Cancer Data Early methods of machine learning applied to microarray data included simple clustering methods [ 47 ]. A widely used method was hierarchical clustering. Due to the flexibility of the clustering methods they became very popular among the biologists. As the technology advanced however the size of the data increased and a simple application of hierarchical clustering became too inefficient. The time complexity of hierarchical clustering is , where is the number of features. Biclustering followed hierarchical clustering as a way of simultaneously clustering both samples and features of a dataset leading to more meaningful clusters. It was shown that biclustering performs better than hierarchical clustering when it comes to microarray data but it is still a computationally demanding method [ 48 ]. Many other methods have been implemented for extracting only the important information from the microarrays thus reducing their size. Feature extraction creates new variables as combinations of others to reduce the dimensionality of the selected features. There are two broad categories for feature extraction algorithms: linear and nonlinear. The difference between linear and nonlinear problems is shown is Figure 3 . Figure 3: Linear versus nonlinear classification problems. 3.1. Linear Linear feature extraction assumes that the data lies on a lower-dimensional linear subspace. It projects them on this subspace using matrix factorization. Given a dataset : , there exists a projection matrix : and a projection : , where . Using (orthogonal property of eigenvectors), we get . A graphical representation is shown in Figure 4 . Figure 4: Dimensionality reduction using linear matrix factorization: projecting the data on a lower-dimensional linear subspace. The most well-known dimensionality reduction algorithm is principal component analysis (PCA). Using the covariance matrix and its eigenvalues and eigenvectors, PCA finds the “principal components” in the data which are uncorrelated eigenvectors each representing some proportion of variance in the data. PCA and many variations of it have been applied as a way of reducing the dimensionality of the data in cancer microarray data [ 58 – 64 ]. It has been argued [ 65 , 66 ] that when computing the principal components (PCs) of a dataset there is no guarantee that the PCs will be related to the class variable. Therefore, supervised principal component analysis (SPCA) was proposed, which selects the PCs based on the class variables. They named this extra step the gene screening step. Even though the supervised version of PCA performs better than the unsupervised, PCA has an important limitation: it cannot capture nonlinear relationships that often exist in data, especially in complex biological systems. SPCA works as follows: (1) Compute the relation measure between each gene with outcome using linear, logistic, or proportional hazards models. (2) Select genes most associated with the outcome using cross-validation of the models in step . (3) Estimate principal component scores using only the selected genes. (4) Fit regression with outcome using model in step . The method was highly effective in identifying important genes and in cross-validation tests was only outperformed by gene shaving, a statistical method for clustering, similar to hierarchical clustering. The main difference is that the genes can be part of more than one cluster. The term “shaving” comes from the removal or shaving of a percentage of the genes (normally 10%) that have the smallest absolute inner product with the leading principal component [ 67 ]. A similar linear approach is classical multidimensional scaling (classical MDS) or Principal Coordinates Analysis [ 68 ] which calculates the matrix of dissimilarities for any given matrix input. It was used for large genomic datasets because it is efficient in combination with Vector Quantization or -Means [ 69 ] which assigns each observation to a class, out of a total of classes [ 70 ]. 3.2. Nonlinear Nonlinear dimensionality reduction works in different ways. For example, a low-dimensional surface can be mapped on a high-dimensional space so that a nonlinear relationship among the features can be found. In theory, a lifting function can be used to map the features onto a higher-dimensional space. On a higher space the relationship among the features can be viewed as linear and therefore is easily detected. This is then mapped back on the lower-dimensional space and the relationship can be viewed as nonlinear. In practice kernel functions can be designed to create the same effect without the need to explicitly compute the lifting function. Another approach to nonlinear dimensionality reduction is by using manifolds. It is based on the assumption that the data (genes of interest) lie on an embedded nonlinear manifold which has lower dimension than the raw data space and lies within it. Several algorithms exist working in the manifold space and applied to microarrays. A commonly used method of finding an appropriate manifold, Isomap [ 71 ], constructs the manifold by joining each point only to its nearest neighbours. Distances between points are then taken as geodesic distances on the resulting graph. Many variants of Isomap have been used; for example, Balasubramanian and Schwartz proposed a tree connected version which differs in the way the neighbourhood graph is constructed [ 72 ]. The -nearest points are found by constructing a minimum spanning tree using an -radius hypersphere. This method aims to overcome the drawbacks expressed by Orsenigo and Vercellis [ 73 ] regarding the robustness of the Isomap algorithm when it comes to noise and outliers. These could cause potential problems with the neighbouring graph, especially when the graph is not fully connected. Isomap has been applied on microarray data with some very good results [ 73 , 74 ]. Compared to PCA, Isomap was able to extract more structural information about the data. In addition, other manifold algorithms have been used with microarray data such as Locally Linear Embedding (LLE) [ 75 ] and Laplacian Eigenmaps [ 76 , 77 ]. PCA and similar manifold methods are used also for data visualisation as shown in Figure 5 . Clusters can often be better separated using manifold LLE and Isomap but PCA is far faster than the other two. Figure 5: Visualisation of a Leukaemia dataset with PCA, manifold LLE, and manifold Isomap [ 34 ]. Another nonlinear method for classification is Kernel PCA . It has been widely used [ 78 , 79 ] since dimensionality reduction helps with the interpretability of the results. It does have an important limitation in terms of space complexity since it stores all the dot products of the training set and therefore the size of the matrix increases quadratically with the number of data points [ 80 ]. Neural methods can also be used for dimensionality reduction like Self Organizing Maps [ 81 ] (SOMs) or Kohonen maps that create a lower-dimensional mapping of an input by preserving its topological characteristics. They are composed of nodes or neurons and each node is associated with its own weight vector. SOMs training is considered to be “competitive” since when a training example is fed to the network its Euclidean distance with all nodes is calculated and it is assigned to that node with the smallest distance (Best Matching Unit (BMU)). The weight of that node along with its neighbouring nodes is adjusted to match the input. Another neural networks method for dimensionality reduction (and dimensionality expansion) uses autoencoders . Autoencoders are feed-forward neural networks which are trained to approximate a function by which data can be classified. For every training input the difference between the input and the output is measured (using square error) and it is back-propagated through the neural network to perform the weight updates to the different layers. In a paper that compares stacked autoencoders with PCA with Gaussian SVM on 13 gene expression datasets, it was shown that autoencoders perform better on the majority of datasets [ 82 ]. Autoencoders use fine-tuning, a back-propagation method for adjusting their parameters. Without back-propagation the autoencoders get very low accuracies. A general problem with the stacked autoencoders method is that a large number of internal layers can easily “memorise” the training data and create a model with zero error which will overfit the data and so be unable to classify future test data. SOMs have been used as a method of dimensionality reduction for gene expression data [ 77 , 83 ] but it was never broadly adopted for analysis because it needs just the right amount of data to perform well. Insufficient or extraneous data can cause randomness to the clusters. Independent component analysis is also widely used in microarrays [ 84 , 85 ] in combination with a clustering method. Independent Components Analysis (ICA) finds the correlation among the data and decorrelates the data by maximizing or minimizing the contrast information. This is called “whitening.” The whitened matrix is then rotated to minimise the Gaussianity of the projection and in effect retrieve statistically independent data. It can be applied in combination with PCA. It is said that ICA works better if the data has been preprocessed with PCA [ 86 ]. This could merely be due to the decrease in computational load caused by the high dimension. The advantages and disadvantages of feature extraction and feature selection are shown in Table 3 and in ( 5 ). Table 3: Advantages and disadvantages between feature selection and feature extraction. Feature Selection and Feature Extraction: Difference between Feature Selection (Top) and Feature Extraction (Bottom) . Consider 4. Prior Knowledge Prior knowledge has previously been used in microarray studies with the objective of improving the classification accuracy. One early method for adding prior knowledge in a machine learning algorithm was introduced by Segal et al. [ 87 ]. It first partitions the variables into modules, which are gene sets that have the same statistical behaviour (share the same parents in a probabilistic network), and then uses this information to learn patterns. The modules were constructed using Bayesian networks and a Bayesian scoring function to decide how well a variable fits in a module. The parents for each module were restricted to only some hundreds of possible genes since those genes were most likely to play a regulatory role for the other genes. To learn the module networks Regression Trees were used. The gene expression data were taken from yeast in order to investigate how it responds to different stress conditions. The results were then verified using the Saccharomyces Genome Database. Adding prior knowledge reduces the complexity of the model and the number of parameters making analysis easier. A disadvantage however of this method is that it relies only on gene expression data, which is noisy. Many sources of external biological information are available and can be integrated with machine learning and/or dimensionality reduction methods. This will help overcoming one of the limitations of machine learning classification methods which is that they do not provide the necessary biological connection with the output. Adding external information in microarray data can give an insight on the functional annotation of the genes and the role they play in a disease, such as cancer. 4.1. Gene Ontology Gene Ontology (GO) terms are a popular source of prior knowledge since they describe known functions of genes. Protein information found in the genes’ GO indices has been combined with their expressions in order to identify more meaningful relationships among the genes [ 88 ]. A study infused GO information in a dissimilarity matrix [ 89 ] using Lin’s similarity measure [ 90 ]. GO terms were also used as a way of weighting the longest partial path shared by two genes [ 91 ]. This was used with expression data in order to produce clusters using a pairwise similarity matrix of gene expressions and the weight of the GO paths. GO terms information integrated with gene expression was used by Chen and Wang [ 92 ], similar genes were clustered together, and SPCA was used to find the PCs. GO terms have been used to derive information about the biological similarity of a pair of genes. This similarity was used as a modified distance metric for clustering [ 93 ]. Using a similar idea in a later publication, similarity measures were used to assign prior probabilities for genes to belong in specific clusters [ 94 ] using an expectation maximisation model. Not all of these methods have been compared to other forms of dimensionality reduction such as PCA or manifold which is a serious limitation as to their actual performance. It is however the case that in all of those papers an important problem regarding GO terms is described. Some genes do not belong in a functional group and therefore cannot be used. Additionally GO terms tend to be very general when it comes to the functional categories and this leads to bigger gene clusters that are not necessarily relevant in microarray experiments. 4.2. Protein-Protein Interaction Other studies have used protein-protein interaction (PPI) networks for the same purpose [ 95 ]. Subnetworks are identified using PPI information. Iteratively more interactions are added to each subnetwork and scored using mutual information between the expression information and the class label in order to find the most significant subnetwork. The initial study showed that there is potential for using PPI networks but there is a lot of work to be done. Prior knowledge methods tend to use prior knowledge in order to filter data out or even penalise features. These features are called outliers and normally are the ones that vary from the average. The Statistical-Algorithmic Method for Bicluster Analysis (SAMBA) algorithm [ 96 ] is a biclustering framework that combines PPI and DNA binding information. It identifies subsets that jointly respond in a subset of conditions. It creates a bipartite graph that corresponds to genes and conditions. A probabilistic model is created based on weights assigned on the significant biclusters. The results for lymphoma microarray showed that the clusters produced were highly relevant to the disease. A positive feature of the SAMBA algorithms is that it can detect overlapping subsets but it has important limitations in the weighting process. All sources are assigned equal weights and they are not penalised according to their importance or reliability of the source. 4.3. Gene Pathways The most promising results were shown when using pathway information as prior knowledge. Many databases containing information on networks of molecular interaction in different organisms exist (KEGG, Pathway Interaction Database, Reactome, etc.). It is widely believed that these lower level interactions can be seen as the building blocks of genetic systems and can be used to understand high-level functions of the biological systems. KEGG pathways have been quite popular in network constrained methods which use networks to identify gene relations to diseases. Not many methods used pathway knowledge but most of them treat pathways as networks with directed edges. A network-based penalty function for variable selection has been introduced [ 97 ]. The framework used penalised regression, after imposing a smoothness assumption on the regression coefficients based on their location on the gene network. The biological motivation of this penalty is that the genes that are linked on the networks are expected to have similar functions and therefore bigger coefficients. The weights are also penalised using the sum of squares of the scaled difference of the coefficients between neighbour vertices in the network in order to smooth the regression coefficients. The results were promising in terms of identifying networks and subnetworks of genes that are responsible for a disease. However the authors only used 33 networks and not the entire set of available networks. A similar approach also exists. It is theoretical model which according to the authors can be applied to cancer microarray data but to date has not been explored [ 98 ]. The proposed method was based on Fourier transformation and spectral graph analysis. The gene expression profiles were reconstructed using prior knowledge to modify the distance from gene networks. They use the assumption that the information lies in the low frequency component of the expression while the high frequency component is mostly noise. Using spectral decomposition the smaller eigenvalues and corresponding eigenvectors are kept (the smaller the eigenvalue the smoother the graph). A linear classifier can be inferred by penalising the regression coefficients based on network information. The biological Pathway-Based Feature Selection (BPFS) algorithm [ 99 ] also utilizes pathway information for microarray classification. It uses SVMs to calculate the marginal classification power of the genes and puts those genes in a separate set. Then the influence factor for each of the genes in the second set is calculated. This is an indication of the interaction of every gene in the second set with the already selected genes. If the influence factor is low the genes are added to the set of the selected genes. The influence factor is the sum of the shortest pathway distances that connect the gene to be added with each other gene in the set. 5. Summary This paper has presented different ways of reducing the dimensionality of high-dimensional microarray cancer data. The increase in the amount of data to be analysed has made dimensionality reduction methods essential in order to get meaningful results. Different feature selection and feature extraction methods were described and compared. Their advantages and disadvantages were also discussed. In addition we presented several methods that incorporate prior knowledge from various biological sources which is a way of increasing the accuracy and reducing the computational complexity of existing methods. Conflict of Interests The authors declare that there is no conflict of interests regarding the publication of this paper. References R. E. Bellman, Dynamic Programming , Princeton University Press, Princeton, NJ, USA, 1957. S. Y. Kung and M. W. Mak, Machine Learning in Bioinformatics, Chapter 1: Feature Selection for Genomic and Proteomic Data Mining , John Wiley & Sons, Hoboken, NJ, USA, 2009. J. Han, Data Mining: Concepts and Techniques , Morgan Kaufmann Publishers, San Francisco, Calif, USA, 2005. D. M. Strong, Y. W. Lee, and R. Y. Wang, “Data quality in context,” Communications of the ACM , vol. 40, no. 5, pp. 103–110, 1997. View at Google Scholar · View at Scopus X. Zhu and X. Wu, “Class noise vs. attribute noise: a quantitative study of their impacts,” Artificial Intelligence Review , vol. 22, no. 3, pp. 177–210, 2004. View at Publisher · View at Google Scholar C. de Martel, J. Ferlay, S. Franceschi et al., “Global burden of cancers attributable to infections in 2008: a review and synthetic analysis,” The Lancet Oncology , vol. 13, no. 6, pp. 607–615, 2012. View at Publisher · View at Google Scholar · View at Scopus A. L. Blum and R. L. Rivest, “Training a 3-node neural network is NP-complete,” Neural Networks , vol. 5, no. 1, pp. 117–127, 1992. View at Publisher · View at Google Scholar T. R. Hancock, On the Difficulty of Finding Small Consistent Decision Trees , 1989. Y. Saeys, I. Inza, and P. Larrañaga, “A review of feature selection techniques in bioinformatics,” Bioinformatics , vol. 23, no. 19, pp. 2507–2517, 2007. View at Publisher · View at Google Scholar · View at Scopus A. L. Blum and P. Langley, “Selection of relevant features and examples in machine learning,” Artificial Intelligence , vol. 97, no. 1-2, pp. 245–271, 1997. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus S. Das, “Filters, wrappers and a boosting-based hybrid for feature selection,” in Proceedings of the 18th International Conference on Machine Learning (ICML '01) , pp. 74–81, Morgan Kaufmann Publishers, San Francisco, Calif, USA, 2001. E. P. Xing, M. I. Jordan, and R. M. Karp, “Feature selection for high-dimensional genomic microarray data,” in Proceedings of the 18th International Conference on Machine Learning , pp. 601–608, Morgan Kaufmann, 2001. T. Bø and I. Jonassen, “New feature subset selection procedures for classification of expression profiles,” Genome biology , vol. 3, no. 4, 2002. View at Google Scholar · View at Scopus K. Yeung and R. Bumgarner, “Correction: multiclass classification of microarray data with repeated measurements: application to cancer,” Genome Biology , vol. 6, no. 13, p. 405, 2005. View at Google Scholar C. Ding and H. Peng, “Minimum redundancy feature selection from microarray gene expression data,” in Proceedings of the IEEE Bioinformatics Conference (CSB '03) , pp. 523–528, IEEE Computer Society, Washington, DC, USA, August 2003. View at Publisher · View at Google Scholar X. Liu, A. Krishnan, and A. Mondry, “An entropy-based gene selection method for cancer classification using microarray data,” BMC Bioinformatics , vol. 6, article 76, 2005. View at Publisher · View at Google Scholar · View at Scopus M. A. Hall, “Correlation-based feature selection for discrete and nu- meric class machine learning,” in Proceedings of the 17th International Conference on Machine Learning (ICML '00) , pp. 359–366, Morgan Kaufmann, San Francisco, Calif, USA, 2000. Y. Wang, I. V. Tetko, M. A. Hall et al., “Gene selection from microarray data for cancer classification—a machine learning approach,” Computational Biology and Chemistry , vol. 29, no. 1, pp. 37–46, 2005. View at Publisher · View at Google Scholar · View at Scopus M. A. Hall and L. A. Smith, “Practical feature subset selection for machine learning,” in Proceedings of the 21st Australasian Computer Science Conference (ACSC '98) , February 1998. G. Mercier, N. Berthault, J. Mary et al., “Biological detection of low radiation doses by combining results of two microarray analysis methods,” Nucleic Acids Research , vol. 32, no. 1, article e12, 2004. View at Publisher · View at Google Scholar · View at Scopus Y. Wang and F. Makedon, “Application of relief-F feature filtering algorithm to selecting informative genes for cancer classification using microarray data,” in Proceedings of IEEE Computational Systems Bioinformatics Conference (CSB '04) , pp. 497–498, IEEE Computer Society, August 2004. View at Scopus G. Weber, S. Vinterbo, and L. Ohno-Machado, “Multivariate selection of genetic markers in diagnostic classification,” Artificial Intelligence in Medicine , vol. 31, no. 2, pp. 155–167, 2004. View at Publisher · View at Google Scholar · View at Scopus P. Pudil, J. Novovičová, and J. Kittler, “Floating search methods in feature selection,” Pattern Recognition Letters , vol. 15, no. 11, pp. 1119–1125, 1994. View at Publisher · View at Google Scholar · View at Scopus A. Osareh and B. Shadgar, “Machine learning techniques to diagnose breast cancer,” in Proceedings of the 5th International Symposium on Health Informatics and Bioinformatics (HIBIT '10) , pp. 114–120, April 2010. View at Publisher · View at Google Scholar · View at Scopus O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee, “Choosing multiple parameters for support vector machines,” Machine Learning , vol. 46, no. 1–3, pp. 131–159, 2002. View at Publisher · View at Google Scholar · View at Scopus Q. Liu, A. H. Sung, Z. Chen, J. Liu, X. Huang, and Y. Deng, “Feature selection and classification of MAQC-II breast cancer and multiple myeloma microarray gene expression data,” PLoS ONE , vol. 4, no. 12, Article ID e8250, 2009. View at Google Scholar · View at Scopus E. K. Tang, P. N. Suganthan, and X. Yao, “Gene selection algorithms for microarray data based on least squares support vector machine,” BMC Bioinformatics , vol. 7, article 95, 2006. View at Publisher · View at Google Scholar · View at Scopus X.-L. Xia, H. Xing, and X. Liu, “Analyzing kernel matrices for the identification of differentially expressed genes,” PLoS ONE , vol. 8, no. 12, Article ID e81683, 2013. View at Publisher · View at Google Scholar · View at Scopus C. Ambroise and G. J. McLachlan, “Selection bias in gene extraction on the basis of microarray gene-expression data,” Proceedings of the National Academy of Sciences of the United States of America , vol. 99, no. 10, pp. 6562–6566, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus I. Guyon, J. Weston, S. Barnhill, and V. Vapnik, “Gene selection for cancer classification using support vector machines,” Machine Learning , vol. 46, no. 1–3, pp. 389–422, 2002. View at Publisher · View at Google Scholar · View at Scopus Q. Liu, A. H. Sung, Z. Chen et al., “Gene selection and classification for cancer microarray data based on machine learning and similarity measures,” BMC Genomics , vol. 12, supplement 5, article S1, 2011. View at Publisher · View at Google Scholar · View at Scopus M. Gütlein, E. Frank, M. Hall, and A. Karwath, “Large-scale attribute selection using wrappers,” in Proceedings of the IEEE Symposium on Computational Intelligence and Data Mining (CIDM '09) , pp. 332–339, April 2009. View at Publisher · View at Google Scholar · View at Scopus T. Jirapech-Umpai and S. Aitken, “Feature selection and classification for microarray data analysis: evolutionary methods for identifying predictive genes,” BMC Bioinformatics , vol. 6, article 148, 2005. View at Publisher · View at Google Scholar · View at Scopus C. Bartenhagen, H.-U. Klein, C. Ruckert, X. Jiang, and M. Dugas, “Comparative study of unsupervised dimension reduction techniques for the visualization of microarray gene expression data,” BMC Bioinformatics , vol. 11, no. 1, article 567, 2010. View at Publisher · View at Google Scholar · View at Scopus R. Ruiz, J. C. Riquelme, and J. S. Aguilar-Ruiz, “Incremental wrapper-based gene selection from microarray data for cancer classification,” Pattern Recognition , vol. 39, no. 12, pp. 2383–2392, 2006. View at Publisher · View at Google Scholar · View at Scopus E. B. Huerta, B. Duval, and J.-K. Hao, “Gene selection for microarray data by a LDA-based genetic algorithm,” in Pattern Recognition in Bioinformatics: Proceedings of the 3rd IAPR International Conference, PRIB 2008, Melbourne, Australia, October 15–17, 2008 , M. Chetty, A. Ngom, and S. Ahmad, Eds., vol. 5265 of Lecture Notes in Computer Science , pp. 250–261, Springer, Berlin, Germany, 2008. View at Publisher · View at Google Scholar M. Perez and T. Marwala, “Microarray data feature selection using hybrid genetic algorithm simulated annealing,” in Proceedings of the IEEE 27th Convention of Electrical and Electronics Engineers in Israel (IEEEI '12) , pp. 1–5, November 2012. View at Publisher · View at Google Scholar · View at Scopus N. Revathy and R. Balasubramanian, “GA-SVM wrapper approach for gene ranking and classification using expressions of very few genes,” Journal of Theoretical and Applied Information Technology , vol. 40, no. 2, pp. 113–119, 2012. View at Google Scholar · View at Scopus J. C. Dunn, “A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters,” Journal of Cybernetics , vol. 3, no. 3, pp. 32–57, 1973. View at Google Scholar · View at MathSciNet J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms , Kluwer Academic Publishers, Norwell, Mass, USA, 1981. View at MathSciNet R. Díaz-Uriarte and S. Alvarez de Andrés, “Gene selection and classification of microarray data using random forest,” BMC Bioinformatics , vol. 7, article 3, 2006. View at Publisher · View at Google Scholar · View at Scopus L. Sheng, R. Pique-Regi, S. Asgharzadeh, and A. Ortega, “Microarray classification using block diagonal linear discriminant analysis with embedded feature selection,” in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '09) , pp. 1757–1760, April 2009. View at Publisher · View at Google Scholar · View at Scopus S. Maldonado, R. Weber, and J. Basak, “Simultaneous feature selection and classification using kernel-penalized support vector machines,” Information Sciences , vol. 181, no. 1, pp. 115–128, 2011. View at Publisher · View at Google Scholar · View at Scopus E. K. Tang, P. N. Suganthan, and X. Yao, “Feature selection for microarray data using least squares SVM and particle swarm optimization,” in Proceedings of the IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB '05) , pp. 9–16, IEEE, November 2005. View at Scopus Y. Tang, Y.-Q. Zhang, and Z. Huang, “Development of two-stage SVM-RFE gene selection strategy for microarray expression data analysis,” IEEE/ACM Transactions on Computational Biology and Bioinformatics , vol. 4, no. 3, pp. 365–381, 2007. View at Publisher · View at Google Scholar · View at Scopus X. Zhang, X. Lu, Q. Shi et al., “Recursive SVM feature selection and sample classification for mass-spectrometry and microarray data,” BMC Bioinformatics , vol. 7, article 197, 2006. View at Publisher · View at Google Scholar · View at Scopus M. B. Eisen, P. T. Spellman, P. O. Brown, and D. Botstein, “Cluster analysis and display of genome-wide expression patterns,” Proceedings of the National Academy of Sciences of the United States of America , vol. 95, no. 25, pp. 14863–14868, 1998. View at Publisher · View at Google Scholar · View at Scopus A. Prelić, S. Bleuler, P. Zimmermann et al., “A systematic comparison and evaluation of biclustering methods for gene expression data,” Bioinformatics , vol. 22, no. 9, pp. 1122–1129, 2006. View at Publisher · View at Google Scholar · View at Scopus P. Jafari and F. Azuaje, “An assessment of recently published gene expression data analyses: reporting experimental design and statistical factors,” BMC Medical Informatics and Decision Making , vol. 6, no. 1, article 27, 2006. View at Publisher · View at Google Scholar · View at Scopus M. A. Hall, “Correlation-based feature selection for machine learning,” Tech. Rep., 1998. View at Google Scholar J. Hruschka, R. Estevam, E. R. Hruschka, and N. F. F. Ebecken, “Feature selection by bayesian networks,” in Advances in Artificial Intelligence , A. Y. Tawfik and S. D. Goodwin, Eds., vol. 3060 of Lecture Notes in Computer Science , pp. 370–379, Springer, Berlin, Germany, 2004. View at Google Scholar A. Rau, F. Jaffrézic, J.-L. Foulley, and R. W. Doerge, “An empirical bayesian method for estimating biological networks from temporal microarray data,” Statistical Applications in Genetics and Molecular Biology , vol. 9, article 9, 2010. View at Publisher · View at Google Scholar · View at Scopus P. Yang, B. B. Zhou, Z. Zhang, and A. Y. Zomaya, “A multi-filter enhanced genetic ensemble system for gene selection and sample classification of microarray data,” BMC Bioinformatics , vol. 11, supplement 1, article S5, 2010. View at Publisher · View at Google Scholar · View at Scopus C. H. Ooi and P. Tan, “Genetic algorithms applied to multi-class prediction for the analysis of gene expression data,” Bioinformatics , vol. 19, no. 1, pp. 37–44, 2003. View at Publisher · View at Google Scholar · View at Scopus H. Glass and L. Cooper, “Sequential search: a method for solving constrained optimization problems,” Journal of the ACM , vol. 12, no. 1, pp. 71–82, 1965. View at Publisher · View at Google Scholar H. Jiang, Y. Deng, H.-S. Chen et al., “Joint analysis of two microarray gene-expression data sets to select lung adenocarcinoma marker genes,” BMC Bioinformatics , vol. 5, article 81, 2004. View at Publisher · View at Google Scholar · View at Scopus S. Ma, X. Song, and J. Huang, “Supervised group Lasso with applications to microarray data analysis,” BMC Bioinformatics , vol. 8, article 60, 2007. View at Publisher · View at Google Scholar · View at Scopus P. F. Evangelista, P. Bonissone, M. J. Embrechts, and B. K. Szymanski, “Unsupervised fuzzy ensembles and their use in intrusion detection,” in Proceedings of the European Symposium on Artificial Neural Networks , pp. 345–350, April 2005. View at Scopus S. Jonnalagadda and R. Srinivasan, “Principal components analysis based methodology to identify differentially expressed genes in time-course microarray data,” BMC Bioinformatics , vol. 9, article 267, 2008. View at Publisher · View at Google Scholar · View at Scopus J. Landgrebe, W. Wurst, and G. Welzl, “Permutation-validated principal components analysis of microarray data,” Genome Biology , vol. 3, no. 4, 2002. View at Google Scholar · View at Scopus J. Misra, W. Schmitt, D. Hwang et al., “Interactive exploration of microarray gene expression patterns in a reduced dimensional space,” Genome Research , vol. 12, no. 7, pp. 1112–1120, 2002. View at Publisher · View at Google Scholar · View at Scopus V. Nikulin and G. J. McLachlan, “Penalized principal component analysis of microarray data,” in Computational Intelligence Methods for Bioinformatics and Biostatistics , F. Masulli, L. E. Peterson, and R. Tagliaferri, Eds., vol. 6160 of Lecture Notes in Computer Science , pp. 82–96, Springer, Berlin, Germany, 2009. View at Google Scholar S. Raychaudhuri, J. M. Stuart, R. B. Altman, and R. B. Altman, “Principal components analysis to summarize microarray experiments: application to sporulation time series,” in Proceedings of the Pacific Symposium on Biocomputing , pp. 452–463, 2000. A. Wang and E. A. Gehan, “Gene selection for microarray data analysis using principal component analysis,” Statistics in Medicine , vol. 24, no. 13, pp. 2069–2087, 2005. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus E. Bair, T. Hastie, D. Paul, and R. Tibshirani, “Prediction by supervised principal components,” Journal of the American Statistical Association , vol. 101, no. 473, pp. 119–137, 2006. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus E. Bair and R. Tibshirani, “Semi-supervised methods to predict patient survival from gene expression data,” PLoS Biology , vol. 2, pp. 511–522, 2004. View at Publisher · View at Google Scholar T. Hastie, R. Tibshirani, M. B. Eisen et al., “‘Gene shaving’ as a method for identifying distinct sets of genes with similar expression patterns,” Genome Biology , vol. 1, no. 2, pp. 1–21, 2000. View at Google Scholar · View at Scopus I. Borg and P. J. Groenen, Modern Multidimensional Scaling: Theory and Applications , Springer Series in Statistics, Springer, 2nd edition, 2005. View at MathSciNet J. Tzeng, H. Lu, and W.-H. Li, “Multidimensional scaling for large genomic data sets,” BMC Bioinformatics , vol. 9, article 179, 2008. View at Publisher · View at Google Scholar · View at Scopus J. A. Hartigan and M. A. Wong, “Algorithm AS 136: a K -means clustering algorithm,” Journal of the Royal Statistical Society Series C: Applied Statistics , vol. 28, no. 1, pp. 100–108, 1979. View at Google Scholar J. B. Tenenbaum, V. de Silva, and J. C. Langford, “A global geometric framework for nonlinear dimensionality reduction,” Science , vol. 290, no. 5500, pp. 2319–2323, 2000. View at Publisher · View at Google Scholar · View at Scopus M. Balasubramanian and E. L. Schwartz, “The isomap algorithm and topological stability,” Science , vol. 295, no. 5552, p. 7, 2002. View at Publisher · View at Google Scholar · View at Scopus C. Orsenigo and C. Vercellis, “An effective double-bounded tree-connected Isomap algorithm for microarray data classification,” Pattern Recognition Letters , vol. 33, no. 1, pp. 9–16, 2012. View at Publisher · View at Google Scholar · View at Scopus K. Dawson, R. L. Rodriguez, and W. Malyj, “Sample phenotype clusters in high-density oligonucleotide microarray data sets are revealed using Isomap, a nonlinear algorithm,” BMC Bioinformatics , vol. 6, article 195, 2005. View at Publisher · View at Google Scholar · View at Scopus C. Shi and L. Chen, “Feature dimension reduction for microarray data analysis using locally linear embedding,” in Proceedings of the 3rd Asia-Pacific Bioinformatics Conference (APBC '05) , pp. 211–217, January 2005. View at Scopus M. Ehler, V. N. Rajapakse, B. R. Zeeberg et al., “Nonlinear gene cluster analysis with labeling for microarray gene expression data in organ development,” BMC Proceedings , vol. 5, no. 2, article S3, 2011. View at Publisher · View at Google Scholar · View at Scopus M. Kotani, A. Sugiyama, and S. Ozawa, “Analysis of DNA microarray data using self-organizing map and kernel based clustering,” in Proceedings of the 9th International Conference on Neural Information Processing (ICONIP '02) , vol. 2, pp. 755–759, Singapore, November 2002. View at Publisher · View at Google Scholar Z. Liu, D. Chen, and H. Bensmail, “Gene expression data classification with kernel principal component analysis,” Journal of Biomedicine and Biotechnology , vol. 2005, no. 2, pp. 155–159, 2005. View at Publisher · View at Google Scholar · View at Scopus F. Reverter, E. Vegas, and J. M. Oller, “Kernel-PCA data integration with enhanced interpretability,” BMC Systems Biology , vol. 8, supplement 2, p. S6, 2014. View at Publisher · View at Google Scholar X. Liu and C. Yang, “Greedy kernel PCA for training data reduction and nonlinear feature extraction in classification,” in MIPPR 2009: Automatic Target Recognition and Image Analysis , vol. 7495 of Proceedings of SPIE , Yichang, China, October 2009. View at Publisher · View at Google Scholar T. Kohonen, “Self-organized formation of topologically correct feature maps,” in Neurocomputing: Foundations of Research , pp. 509–521, MIT Press, Cambridge, Mass, USA, 1988. View at Google Scholar R. Fakoor, F. Ladhak, A. Nazi, and M. Huber, “Using deep learning to enhance cancer diagnosis and classification,” in Proceedings of the ICML Workshop on the Role of Machine Learning in Transforming Healthcare (WHEALTH '13) , ICML, 2013. S. Kaski, J. Nikkil, P. Trnen, E. Castrn, and G. Wong, “Analysis and visualization of gene expression data using self-organizing maps,” in Proceedings of the IEEE-EURASIP Workshop on Nonlinear Signal and Image Processing (NSIP '01) , p. 24, 2001. J. M. Engreitz, B. J. Daigle Jr., J. J. Marshall, and R. B. Altman, “Independent component analysis: mining microarray data for fundamental human gene expression modules,” Journal of Biomedical Informatics , vol. 43, no. 6, pp. 932–944, 2010. View at Publisher · View at Google Scholar · View at Scopus S.-I. Lee and S. Batzoglou, “Application of independent component analysis to microarrays,” Genome Biology , vol. 4, no. 11, article R76, 2003. View at Publisher · View at Google Scholar · View at Scopus L. J. Cao, K. S. Chua, W. K. Chong, H. P. Lee, and Q. M. Gu, “A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine,” Neurocomputing , vol. 55, no. 1-2, pp. 321–336, 2003. View at Publisher · View at Google Scholar · View at Scopus E. Segal, D. Koller, N. Friedman, and T. Jaakkola, “Learning module networks,” Journal of Machine Learning Research , vol. 27, pp. 525–534, 2005. View at Google Scholar Y. Chen and D. Xu, “Global protein function annotation through mining genome-scale data in yeast Saccharomyces cerevisiae ,” Nucleic Acids Research , vol. 32, no. 21, pp. 6414–6424, 2004. View at Publisher · View at Google Scholar · View at Scopus R. Kustra and A. Zagdanski, “Data-fusion in clustering microarray data: balancing discovery and interpretability,” IEEE/ACM Transactions on Computational Biology and Bioinformatics , vol. 7, no. 1, pp. 50–63, 2010. View at Publisher · View at Google Scholar · View at Scopus D. Lin, “An information-theoretic definition of similarity,” in Proceedings of the 15th International Conference on Machine Learning (ICML '98) , Madison, Wis, USA, 1998. J. Cheng, M. Cline, J. Martin et al., “A knowledge-based clustering algorithm driven by gene ontology,” Journal of Biopharmaceutical Statistics , vol. 14, no. 3, pp. 687–700, 2004. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus X. Chen and L. Wang, “Integrating biological knowledge with gene expression profiles for survival prediction of cancer,” Journal of Computational Biology , vol. 16, no. 2, pp. 265–278, 2009. View at Publisher · View at Google Scholar · View at Scopus D. Huang and W. Pan, “Incorporating biological knowledge into distance-based clustering analysis of microarray gene expression data,” Bioinformatics , vol. 22, no. 10, pp. 1259–1268, 2006. View at Publisher · View at Google Scholar · View at Scopus W. Pan, “Incorporating gene functions as priors in model-based clustering of microarray gene expression data,” Bioinformatics , vol. 22, no. 7, pp. 795–801, 2006. View at Publisher · View at Google Scholar · View at Scopus H.-Y. Chuang, E. Lee, Y.-T. Liu, D. Lee, and T. Ideker, “Network-based classification of breast cancer metastasis,” Molecular Systems Biology , vol. 3, no. 1, article 140, 2007. View at Publisher · View at Google Scholar · View at Scopus A. Tanay, R. Sharan, and R. Shamir, “Discovering statistically significant biclusters in gene expression data,” in Proceedings of the 10th International Conference on Intelligent Systems for Molecular Biology (ISMB '02) , pp. 136–144, Edmonton, Canada, July 2002. C. Li and H. Li, “Network-constrained regularization and variable selection for analysis of genomic data,” Bioinformatics , vol. 24, no. 9, pp. 1175–1182, 2008. View at Publisher · View at Google Scholar · View at Scopus F. Rapaport, A. Zinovyev, M. Dutreix, E. Barillot, and J.-P. Vert, “Classification of microarray data using gene networks,” BMC Bioinformatics , vol. 8, article 35, 2007. View at Publisher · View at Google Scholar · View at Scopus N. Bandyopadhyay, T. Kahveci, S. Goodison, Y. Sun, and S. Ranka, “Pathway-basedfeature selection algorithm for cancer microarray data,” Advances in Bioinformatics , vol. 2009, Article ID 532989, 16 pages, 2009. View at Publisher · View at Google Scholar (function (i, s, o, g, r, a, m) { i['GoogleAnalyticsObject'] = r; i[r] = i[r] || function () { (i[r].q = i[r].q || []).push(arguments) }, i[r].l = 1 * new Date(); a = s.createElement(o), m = s.getElementsByTagName(o)[0]; a.async = 1; a.src = g; m.parentNode.insertBefore(a, m) })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga'); ga('create', 'UA-8578054-2', 'auto'); ga('send', 'pageview');
Journal
Advances in Bioinformatics – Hindawi Publishing Corporation
Published: Jun 11, 2015