FeatGeNN: Improving Model Performance for Tabular Data with Correlation-Based Feature Extraction | Springer Nature Link (formerly SpringerLink) Skip to main content Advertisement Log in Menu Find a journal Publish with us Track your research Search Cart Home Intelligent Systems Conference paper FeatGeNN: Improving Model Performance for Tabular Data with Correlation-Based Feature Extraction Conference paper First Online: 12 October 2023 pp 259–273 Cite this conference paper Access provided by University of Notre Dame Hesburgh Library Download book PDF Download book EPUB Intelligent Systems (BRACIS 2023) FeatGeNN: Improving Model Performance for Tabular Data with Correlation-Based Feature Extraction Download book PDF Download book EPUB Sammuel Ramos Silva  ORCID: orcid.org/0000-0002-2274-13909,10 & Rodrigo Silva  ORCID: orcid.org/0000-0003-2547-38359  Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14195)) Included in the following conference series: Brazilian Conference on Intelligent Systems 576 Accesses 1 Citation Abstract Automated Feature Engineering (AutoFE) has become an important task for any machine learning project, as it can help improve model performance and gain more information for statistical analysis. However, most current approaches for AutoFE rely on manual feature creation or use methods that can generate a large number of features, which can be computationally intensive and lead to overfitting. To address these challenges, we propose a novel convolutional method called FeatGeNN that extracts and creates new features using correlation as a pooling function. Unlike traditional pooling functions like max-pooling, correlation-based pooling considers the linear relationship between the features in the data matrix, making it more suitable for tabular data. We evaluate our method on various benchmark datasets and demonstrate that FeatGeNN outperforms existing AutoFE approaches regarding model performance. Our results suggest that correlation-based pooling can be a promising alternative to max-pooling for AutoFE in tabular data applications. The author would like to acknowledge FAPEMIG (Fundação de Amparo à Pesquisa do Estado de Minas Gerais), CAPES (Coordenação de Aperfeiçoamento de Pessoal de Nível Superior), UFOP (Universidade Federal de Ouro Preto) and Cloudwalk, Inc, for the financial support which has been instrumental in the successful execution of our research endeavors. Access provided by University of Notre Dame Hesburgh Library. Download conference paper PDF Similar content being viewed by others Attribute Selection Based on Correlation Analysis Chapter © 2018 Iterative feature exclusion ranking for deep tabular learning Article 16 December 2025 Towards Automatic Complex Feature Engineering Chapter © 2018 Explore related subjects Discover the latest articles, books and news in related subjects, suggested using machine learning. Categorization Data Mining Machine Learning Quantitative trait Skills Statistical Learning 1 Introduction Creating effective features is a crucial aspect of machine-learning projects. Essentially, it involves deriving new features from existing data to train a model or extract more information for statistical analysis. Discovering novel features from raw datasets is often the key to improving model performance [1]. Traditionally, feature creation is a manual process that heavily relies on an analyst’s domain knowledge and programming skills. However, this approach can be limiting, as an analyst’s intuition and expertise often influence the features created. To overcome these limitations, researchers have been exploring the field of Automated Feature Engineering (AutoFE). AutoFE aims to automate the feature creation process, enabling the discovery of more complex and effective features without relying solely on human input. Automated feature engineering methods involve applying transformations to raw data to create new features. One commonly used technique is the expansion-reduction method [4], which generates a large number of features and then applies a feature selection algorithm to reduce their dimensionality. During the expansion phase, various transformations, such as logarithmic, max/min, or sum, are applied to the raw data. In the reduction phase, a feature selection method is utilized to identify the most effective set of features, which can significantly enhance a model’s performance. The possible number of transformation operations that can be performed on already-transformed features is practically infinite, which leads to an exponential increase in the feature space. This issue can cause a problem in reducing the number of feature evaluations required. To address this issue, researchers have proposed adaptive methods for AutoFE. For instance, Khurana et al. [5] introduced a Q-learning agent capable of performing feature transformation search, achieving higher performance but still generating a large number of features. In another study [6], a Multi-Layer Perceptron (MLP) was trained to suggest the best transformations for each raw feature, resolving the problem of excessive feature generation. More recently, DIFER [7], a gradient-based method for differentiable AutoFE, has demonstrated superior performance and computational efficiency compared to other approaches, although it still requires significant computation In recent years, the use of deep neural networks (DNNs) has become increasingly widespread across a range of fields, such as computer vision and natural language processing [14, 15]. Typically, these models extract new features by feeding input features into the hidden layers of a DNN. While this approach is effective in capturing complex interactions between implicit and explicit features, it may not always generate useful new features due to a lack of relevant interactions in the dataset [9]. Moreover, most existing works use max-pooling in the pooling layer, which may not be optimal for tabular data because it does not preserve the order and context of features in the data matrix. Additionally, max-pooling is intended to identify the most significant features within an image, which may not always be relevant or effective for tabular data. To address the limitations of existing AutoFE methods, we propose FeatGeNN, a convolutional approach that leverages correlation as a pooling function to extract and generate new features. FeatGeNN first applies convolutional filters to the raw data to extract high-level representations. Then, instead of using traditional pooling functions like max or average pooling, it computes the correlation between the extracted features, which helps to identify the most informative features. The selected features are then passed through a multi-layer perceptron (MLP) to create the final set of new features. Preliminary results indicate that FeatGeNN outperforms existing AutoFE methods in both the number of generated features and model performance, demonstrating its potential as a potent tool for creating features in machine learning. 2 Related Work The main goal of feature engineering is to transform raw data into new features that can better express the problem to be solved. Training a model with the generated features can increase the performance of the model. However, the process of feature engineering can be limited by the expertise, programming skills, and intuition of the person working with the data. For this reason, AutoFE approaches have recently gained attention. The authors of [7] propose a differentiable AutoML model that efficiently extracts low and high-order features. The model includes three steps: Initialization, Optimizer Training, and Feature Evaluation. In initialization, features are constructed randomly and evaluated using a machine-learning model in the validation set. In training the optimizer, a tree-like structure is created with an encoder, a predictor, and a decoder, called a parse tree. The encoder maps the post-order traversal string to a continuous space, the predictor is a 5-layer MLP that maps the representation to the score computed by a machine learning model, and the decoder maps the embedding to the discrete feature space. In the final step of feature evolution, the best n features are selected and optimized using a gradient-based approach. In [4], the authors present an algorithm that uses mathematical functions to generate new features for relational databases. The algorithm begins by identifying the entities that make up the database and defines a set of mathematical functions that are applied at both the entity level and the relational level. The proposed approach first enumerates all possible transformations on all features and then directly selects features based on their impact on model performance. However, due to the potentially large number of features generated, it is necessary to perform feature selection and dimensionality reduction to avoid overfitting and improve the interpretability of the model. In [6], the authors propose a novel model for feature engineering in classification tasks that can generalize the effects of different feature transformations across multiple datasets. The model uses an MLP for each transformation to predict whether it can produce more useful features than the original set. The Quantile Sketch Array (QSA) achieves a fixed-size representation of feature values to handle features and data of different lengths. The QSA uses Quantile Data Sketch to represent feature values associated with a class label. The authors of [11] have proposed an RNN-based approach to address the feature explosion problem in feature engineering and support higher-order transformations. Their architecture uses an RNN to generate transformation rules with a maximum order for each raw feature within a fixed time limit. For datasets with multiple raw features, the authors use multiple RNNs as controllers to generate transformation rules for each feature. The transformed features are evaluated using a machine learning algorithm and the controller is trained using policy gradients. The model includes two special unary transformations: “delete” and “terminate”, which remove a feature and terminate the current transformation, respectively, to determine the most appropriate transformation order. In [5] they propose a heuristic model for automating feature engineering in supervised learning problems. Their model is based on a tree structure, where the raw dataset is the root, each node is a transformed dataset, and the edges represent the transformation functions. The goal is to find the node with the highest score, reducing the feature construction problem to a search problem. The authors present three exploration strategies to traverse the tree. The first is “depth-first traversal”, in which a random transformation is applied to the root and the algorithm then explores a branch until there is no further improvement. Then it chooses another node with the highest score and starts the process again. The second is the “Global Traversal”, where a global search is performed to find the most promising node out of all the nodes explored so far. The third is “Balanced Traversal”, in which the algorithm chooses either an exploration or exploitation strategy at each step based on a time or node budget. To handle the explosive growth of columns, feature selection is required as they grow. Cognito allows the selection of features after each transformation to clean up the dataset and ensure a manageable size. In addition, at the end of the model execution, the algorithm performs another feature selection for all columns in the dataset, including the newly created columns. AutoFeat is a method presented in [10] that generates and selects non-linear input features from raw inputs. The method applies a series of transformations to the raw input and combines pairs of features in an alternating multi-step process to generate new features. However, this leads to an exponential increase in the size of the feature space, so a subsampling procedure is performed before computing new features. The authors have shown that two or three steps of the feature technique are usually sufficient to generate new features. After feature engineering, the new dataset has a higher number of features than the original dataset. To reduce the dimensionality, the authors developed a feature selection procedure. First, they remove new features that are highly correlated with the original or simpler features. Then they apply a wrapper method with L1-regular linear models to select the most informative and non-redundant features from the dataset. In the end, only a few dozen features are retained and used after the feature creation and selection process. In [17], autolearn is proposed, a learning model based on regression between pairs of features and aimed at discovering patterns and their variations in the data. The method selects a small number of new features to achieve the desired performance. The proposed method consists of four phases: Pre-processing to reduce dimensionality, where the authors perform feature selection based on information gain (IG); Mining of correlated features to define and search for pairwise correlated features, where the distance correlation [8] is calculated to determine if there is an interesting predictive relationship between a pair of features; Feature generation, where regularized regression algorithms are used to search for associations between features and generate new features; and Feature selection, where features that do not add new information to the dataset are discarded. The authors of [3] have proposed a novel model that achieves both memorization and generalization by simultaneously training a linear model component and a neural network component. The model consists of two components: The Wide component, which is a generalized linear model of the form \(yW^txb\), where y denotes prediction, x denotes features, w denotes model parameters and b denotes bias. The input features can be either raw or transformed, the most important transformation being the cross-product transformation; and the Deep component, which is a feed-forward neural network. For categorical features, an embedding is created, which is then added to the dataset and fed into the network. The authors of [2] have proposed a model for predicting CTR that can handle interactions between low and high-order features by introducing a factorization-machine (FM) based neural network. The model consists of two parts: the FM component, which generates low-order features and can generate interactions between 1st and 2nd-order features with low computational cost, and the deep component, a feed-forward neural network that learns interactions between higher-order features. The input to the network is a high-dimensional vector of sparse data containing categorical and continuous variables as well as grouped fields. The FGCNN is another approach proposed in CTR for prediction [9]. This model consists of two components, namely the Feature Generation and the Deep Classifier. The Feature Generation component uses the mechanisms inherent in the Convolutional Neural Network (CNN) and the Multilayer Perceptron (MLP) to identify relevant local and global patterns in the data and generate new features. The Deep Classifier component then uses the extended feature space to learn and make predictions. Our work introduces a CNN-based model with correlation-pooling for extracting high-order features and improving model performance. Unlike traditional pooling functions such as max-pooling, which focus on selecting the maximum value within a pooling region, correlation-pooling considers the linear relationships between features in the data matrix. It measures the correlation coefficient between the features and aggregates them based on their correlation values to capture the interdependencies and patterns in the data. By incorporating correlation-based pooling into the feature extraction process, FeatGeNN can effectively extract high-order features that reflect the underlying relationships among input variables. Our proposed method achieves competitive results on a range of problems, suggesting that correlation-based pooling is a promising technique for working with tabular data in neural networks. 3 Proposed Approach In this section, we describe the proposed Feature Generation with Evolutionary Convolutional Neural Networks (FeatGeNN) model in detail. 3.1 Problem Formulation Given an dataset \(D = \left\langle F, tg \right\rangle \), where \(F = \left\{ f_1, f_2, ..., f_n \right\} \) are the raw features and tg the target vector. We denote as \(L_{E}^{M}(D,tg)\) the performance of the machine learning model M that is learned from D and measured by the evaluation metric E (e.g. accuracy). In addition, we transform a raw set of features D into \(D_{new}\) by applying a set of transformation functions \(T = \left\{ t_1, t_2, ..., t_n \right\} \). Formally, the goal of the AutoFE is to search the optimal transformed feature set \(D^{*}\) where \(L_{E}^{M}(D^{*},tg)\) is maximized. 3.2 FeatGeNN Model Fig. 1. The FeatGeNN process. Full size image In this study, we use a convolutional neural network to extract features that can improve the performance of a machine learning model (i.e., Random Forest). As explained earlier, using an MLP alone to generate new features would not result in a good set of new features. The reason for this is the relationship between the number of informative interactions between features and the total number of features in the feature space. Also, using a CNN alone might not lead to good performance because a CNN only considers local interactions and does not consider many important global interactions between features [9]. To overcome this problem, we use an architecture that combines the MLP with the CNN. The FeatGeNN model includes two main blocks, namely local feature extraction and global feature generation (Fig. 1). The first block attempts to identify the most informative interactions between local features, while the second block generates new features from the features extracted by the local feature extraction block and combines them globally. The Local Feature Extraction block includes two main operations, namely Pooling and Convolution. Among these operations, the pooling operation plays a crucial role in reducing dimensionality and preserving the most informative features for subsequent layers. In previous work on feature generation for tabular data with CNN, max-pooling was mainly used. However, we found that using max-pooling for tabular data may not give the desired result because the model may not compare closely related features, thus affecting the features generated by the model. Therefore, we propose the use of correlation-pooling to address this issue. In correlation pooling (Fig. 2), the variant of pooling used in our Local Feature Extraction block, uses Pearson correlation [19] to group features that are highly correlated. By grouping these features, correlation-pooling can preserve the relationship between closely related features and thus improve the quality of the features extracted by the CNN model. This is in contrast to max-pooling, which preserves only the most dominant feature in a group and may ignore other relevant features that are closely related. Therefore, by incorporating Pearson correlation in the pooling operation, correlation-pooling can effectively circumvent the limitation of max-pooling and help generate more informative features for subsequent layers in the CNN model. The Pearson correlation coefficient can be formulated as follows for our problem: $$\begin{aligned} r = \frac{n\sum xy - (\sum x)(\sum y)}{\sqrt{[n\sum x^{2}-(\sum x)^{2}][n\sum y^{2}-(\sum y)^{2}]}} \end{aligned}$$ (1) where x and y represent the values of the features X and Y respectively, and \(X,Y \in F\), where F is the set of all features. The variable n denotes the number of samples in the dataset D. To avoid having to run the Pearson algorithm twice, we have introduced an iterative calculation of the Pearson coefficient. This means that at the current stage of model development, we compute the Pearson coefficient r to perform the pooling operation for the subsequent evolutionary generation of the model. To reduce the computations required, we also added a threshold to limit the number of data sent to the correlation calculation, i.e., a model can only use 70% of the data to calculate the correlation value for the features. Fig. 2. Correlation-Pooling process. Full size image While the Pearson correlation is a statistical measure that describes the linear relationship between two variables, it is not suitable for analyzing relationships between more than two characteristics. To overcome this limitation, we use the multivariate correlation matrix, which consists of pairwise Pearson correlation coefficients between all pairs of variables. This matrix allows us to analyze relationships between multiple variables and identify the most highly correlated variables. The overall correlation value for the feature f can be formulated as follows: $$\begin{aligned} CS_f = \frac{\sum _{k}^{N}r_{fk}}{N} \end{aligned}$$ (2) where \(CS_f\) is the correlation score for the feature f, \(r_{fk}\) represent the person correlation score for the feature tuple (f,k) and N the total number of feature in the dataset. In the Global Feature Generation block, an MLP is utilized to merge the features extracted from the Local Feature Extraction block and generate novel features. These novel features are then appended to the original dataset and used in the machine-learning model. 3.3 Evolution Process In this work, we adopt an evolution process for conducting AutoFE, as depicted in Fig. 3. This process involves three distinct steps: (1) Feature Selection, (2) Population Initialization, and (3) Feature Evolution. Fig. 3. Feature Evolution process. Full size image The first step of our proposed approach is to reduce the combination of uncorrelated and redundant features using a feature selection method. We used the Maximum Relevance-Minimum Redundancy (MRMR) [12] method for this purpose. By minimizing the combination of such features, we aim to reduce the introduction of noise into the model and improve the quality of the features generated by the CNN model. During the population initialization step, we generate a population of the CNN model POP that is evolved in the Feature Evolution step. To evaluate this initial population, we use a machine learning model on the dataset resulting from step (1) Specifically, we take the set of features F* from the Feature Selection step and input them into the CNN model p (where \(p \in POP\)) to generate n new features f. These newly created features are concatenated with the original dataset D to create a new dataset \(D* \left\{ F \cup f \right\} \), which is then evaluated by the machine learning model \(L^m\) to obtain a score \(S_p\). In the trait evolution step, a genetic algorithm [13] is used to evolve the population and identify the most effective traits to improve the performance score obtained by \(L^m\). During each epoch of the genetic algorithm, for each model p that is not part of the elite group E (where \(E is \in POP\)), a crossover is performed between its weights and those of a second model \(p'\), which is selected using a round-robin tournament [18]. Following the crossover process, the offspring generated by this operation can be subjected to mutation. The features produced by the offspring are then evaluated, as described in the initialization of the population initialization step. If the score obtained by \(L^m\) is better than the current score for p or if depreciation is allowed, the offspring replaces the current model p and the score is updated. 4 Results In this section, we aim to answer the following research questions: RQ1: How effective is correlation-pooling compared to Max-Pooling? RQ2: Study of the impact of the number of data on the correlation pooling computation? RQ3: How effective is the proposed FeatGeNN approach? (Comparison with literature) 4.1 Experimental Setup To evaluate the performance of the FeatGeNN model, on classification problems, 6 classification datasets from the UCI repository, which were used in the state-of-the-art methods [7, 11], were selected. The description of each dataset in terms of the Number of Features and Number of Samples is presented in Table 1. Table 1. Statistics of the benchmarks used to perform the evaluation of the FeatGeNN features.Full size table In our experiments, we use the f1-score as the evaluation measure, which is also commonly used in the related works [11] and [7]. The threshold for questions RQ1 and RQ2 was set at 80% of the available data in the dataset. To ensure robustness and reliability, we use 5-fold cross-validation, in which the dataset is divided into five subsets or folds and the evaluation is performed five times, with each fold serving once as a test set. This approach helps mitigate the effects of data variability and provides a more comprehensive assessment of the model’s performance. As for the chosen algorithm, we use Random Forest as the base method in all our experiments. Random Forest is a popular and widely used ensemble learning method known for its robustness and ability to handle different types of data. 4.2 Effectiveness of Correlation-Pooling vs. Max-Pooling (RQ1) In this subsection, this experiment aims to answer: Can our FeatGeNN with Correlation-Pooling achieve competitive results compared to the version with Max-Pooling? Table 2 shows the comparison results in terms of F1 score. The results show that the FeatGeNN with correlation-pooling outperforms the version with max-pooling in most datasets. The only exceptions are the Megawatt1 and Credit_Default datasets, where the results are very similar. This result can be attributed to the fact that correlation-pooling takes into account the relationships between features when generating new features, which contributes to its relatively better performance. Table 2. Comparing FeatGeNN performance with Correlation-Pooling and Max-Pooling. The * denotes the version of the FeatGeNN that was executed with Correlation-Pooling. The results are the average score, and the standard deviation, after 30 runsFull size table 4.3 Impact of the Number of Data on the Correlation Pooling Computation (RQ2) In this subsection, our experiment aims to answer the question: What is the influence of the number of available data on the Correlation-Pooling computation?. Figure 4 shows the performance of three versions of FeatGeNN: FeatGeNN (using all available data), FeatGeNN (using 60% of the data), and FeatGeNN* (using 30% of the data). The results show that, as expected, the performance of the model varies with the amount of data used to compute the correlation-pooling. On average, the version with access to the entire dataset achieves a performance improvement of 0.76% and 1.38% compared to the FeatGeNN and FeatGeNN* versions, respectively. Compared to the version that used 80% of the available data, the result after 30 epochs is very similar, although the version with more data performs better in fewer epochs. These results indicate that the performance of FeatGeNN is still competitive with the original version, even though the performance decreases slightly with less available data. Fig. 4. The performance of the different versions of FeatGeNN is compared in terms of the amount of data used for computation. In the image, the symbol represents the version that used 60% of the available data, the * symbol represents the version that used 30% of the data, and the symbol \(^{\circ }\) represents the version that used 100% of the data. The FeatGeNN without symbol stands for the version that used 80% of the available data. Full size image 4.4 Effectiveness of FeatGeNN (RQ3) In this subsection, this experiment aims to answer: Can our FeatGeNN with Correlation-Pooling achieve competitive results when compared to the state-of-the-art models?. We compare FeatGeNN on 6 datasets with state-of-the-art methods, including (a) Base: Raw dataset without any transformation; (b) Random: randomly apply a transformation to each raw feature; (c) DFS [4]; (d) AutoFeat [10]; (e) LFE [6]; (f) NFS [11]; and (g) DIFER [7]. Table 3. Comparison between FeatGeNN with other methods from the literature, reported on [7]. * reports the average and standard deviation across 30 runs, while the FeatGeNN column reports the maximum value across the same runs.Full size table Table 3 shows the comparative results of FeatGeNN relative to existing methods (results reported in [7]). From Table 3 we can observe that in the classification tasks, the comparison shows that FeatGeNN, performs the best for the SpamBase, Credit_Default, German Credit, and SpectF benchmarks, the second best for the Ionosphere benchmark and achieves the same result as the DIFER method for the Megawatt1 benchmark. Although DIFER achieves the best performance in the Ionosphere benchmark, they only achieve 0.58% more than the best result obtained by our proposed method. Regarding the number of features, Table 4 shows that FeatGeNN excels in producing fewer features for the Megawatt1, SpectF, and Credit_Default datasets compared to other methods. For the remaining datasets, FeatGeNN achieves comparable results with the same number of features. Compared to the performances of Base and Random, FeatGeNN achieved an average improvement of 5.89% considering all datasets, which demonstrates the potential of the features generated by our proposed model. Table 4. Comparison between FeatGeNN, DIFER, AutoFeat, and Random (\(*\) the results reported on [7]).Full size table 5 Conclusion In this study, we presented a novel approach for generating new features in tabular data that combines feature selection and feature generation to improve the performance of predictive models. Our proposed method uses a CNN architecture to effectively capture local features during convolution operations (Local Feature Extraction), thereby reducing the number of combinations required in the MLP phase (Global Feature Generation). In addition, we integrated a correlation-pooling operation as a dimensionality reduction step. Our approach demonstrates efficient feature learning and achieves competitive results compared to the architecture used by Max-Pooling and state-of-the-art methods. As a direction for future research, we intend to explore information theory methods as possible alternatives for pooling operations. This could further increase the effectiveness of our approach to learning new features. References Domingos, P.M.: A few useful things to know about machine learning. Commun. ACM 55, 78–87 (2012) Article  Google Scholar  Guo, H., Tang, R., Ye, Y., Li, Z., He, X.: DeepFM: a factorization-machine based neural network for CTR prediction. arXiv (2017). https://doi.org/10.48550/arXiv.1703.04247 Cheng, H., et al.: Wide & deep learning for recommender systems. arXiv (2016). https://doi.org/10.48550/arXiv.1606.07792 Kanter, J.M., Veeramachaneni, K.: Deep feature synthesis: towards automating data science endeavors. In: 2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA), pp. 1–10 (2015) Google Scholar  Khurana, U., Turaga, D., Samulowitz, H., Parthasrathy, S.: Cognito: automated feature engineering for supervised learning (2016) Google Scholar  Nargesian, F., Samulowitz, H., Khurana, U., Khalil, E.B., Turaga, D.S.: Learning feature engineering for classification. In: IJCAI (2017) Google Scholar  Zhu, G., Xu, Z., Guo, X., Yuan, C., Huang, Y.: DIFER: differentiable automated feature engineering. ArXiv abs/2010.08784 (2020) Google Scholar  Székely, G.J., Rizzo, M.L., Bakirov, N.K.: Measuring and testing dependence by correlation of distances. Ann. Statist. 35(6), 2769–2794 (2007). https://doi.org/10.1214/009053607000000505 Article  MathSciNet  MATH  Google Scholar  Liu, B., Tang, R., Chen, Y., Yu, J., Guo, H., Zhang, Y.: Feature generation by convolutional neural network for click-through rate prediction. In: The World Wide Web Conference (2019) Google Scholar  Horn, F., Pack, R.T., Rieger, M.: The autofeat python library for automatic feature engineering and selection. ArXiv abs/1901.07329 (2019) Google Scholar  Chen, X., et al.: Neural feature search: a neural architecture for automated feature engineering. In: 2019 IEEE International Conference on Data Mining (ICDM), pp. 71–80 (2019) Google Scholar  Peng, H., Long, F., Ding, C.: Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell. 27, 1226–1238 (2005) Article  Google Scholar  Katoch, S., Chauhan, S.S., Kumar, V.: A review on genetic algorithm: past, present, and future. Multimed. Tools Appl. 80, 8091–8126 (2021) Article  Google Scholar  Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. CoRR abs/1409.0473 (2015) Google Scholar  Iandola, F.N., Moskewicz, M.W., Ashraf, K., Han, S., Dally, W.J., Keutzer, K.: SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and \(<\)1MB model size. ArXiv abs/1602.07360 (2016) Google Scholar  Cheng, H.-T., et al.: Wide & deep learning for recommender systems. In: Proceedings of the 1st Workshop on Deep Learning for Recommender Systems (2016) Google Scholar  Kaul, A., Maheshwary, S., Pudi, V.: AutoLearn - automated feature generation and selection. In: 2017 IEEE International Conference on Data Mining (ICDM), pp. 217–226 (2017). https://doi.org/10.1109/ICDM.2017.31 Goldberg, D.E., Deb, K.: A comparative analysis of selection schemes used in genetic algorithms. In: Rawlins, G.J.E. (ed.) Foundations of Genetic Algorithms, pp. 69–93. Morgan Kaufmann Publishers Inc., San Francisco (1991) Google Scholar  Pearson, K.: Note on regression and inheritance in the case of two parents. Proc. R. Soc. Lond. 58, 240–242 (1895) Article  Google Scholar  Download references Author information Authors and Affiliations Universidade Federal de Ouro Preto, Ouro Preto, 35402-163, Brazil Sammuel Ramos Silva & Rodrigo Silva Cloudwalk, Inc., São Paulo, São Paulo, 05425-070, Brazil Sammuel Ramos Silva Authors Sammuel Ramos SilvaView author publications Search author on:PubMed Google Scholar Rodrigo SilvaView author publications Search author on:PubMed Google Scholar Corresponding author Correspondence to Sammuel Ramos Silva . Editor information Editors and Affiliations Federal University of São Carlos, São Carlos, Brazil Murilo C. Naldi Centro Universitario da FEI, São Bernardo do Campo, Brazil Reinaldo A. C. Bianchi Rights and permissions Reprints and permissions Copyright information © 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG About this paper Cite this paper Silva, S.R., Silva, R. (2023). FeatGeNN: Improving Model Performance for Tabular Data with Correlation-Based Feature Extraction. In: Naldi, M.C., Bianchi, R.A.C. (eds) Intelligent Systems. BRACIS 2023. Lecture Notes in Computer Science(), vol 14195. Springer, Cham. https://doi.org/10.1007/978-3-031-45368-7_17 Download citation .RIS .ENW .BIB DOI: https://doi.org/10.1007/978-3-031-45368-7_17 Published: 12 October 2023 Publisher Name: Springer, Cham Print ISBN: 978-3-031-45367-0 Online ISBN: 978-3-031-45368-7 eBook Packages: Computer ScienceComputer Science (R0) Share this paper Anyone you share the following link with will be able to read this content: Get shareable linkSorry, a shareable link is not currently available for this article. Copy shareable link to clipboard Provided by the Springer Nature SharedIt content-sharing initiative Keywords Automated Feature Engineering feature creation correlation-based pooling tabular data machine learning Publish with us Policies and ethics Search Search by keyword or author Search Navigation Find a journal Publish with us Track your research Discover content Journals A-Z Books A-Z Publish with us Journal finder Publish your research Language editing Open access publishing Products and services Our products Librarians Societies Partners and advertisers Our brands Springer Nature Portfolio BMC Palgrave Macmillan Apress Discover Your privacy choices/Manage cookies Your US state privacy rights Accessibility statement Terms and conditions Privacy policy Help and support Legal notice Cancel contracts here 129.74.145.123 Hesburgh Library ER Unit (3005732405) - NorthEast Research Libraries (NERL) (8200828607) - NERL - TA Account (3006206169) - University of Notre Dame Hesburgh Library (3000184373) © 2025 Springer Nature