An efficient, parallelized algorithm for optimal conditional entropy-based feature selection
Autor
Afiliação Butantan
Afiliação externa
Tipo de documento
Article
Idioma
English
Direitos de acesso
Open access
Licença de uso
CC BY
Aparece nas Coleções:
Métricas
Resumo em inglês
In Machine Learning, feature selection is an important step in classifier design. It consists of finding a subset of features that is optimum for a given cost function. One possibility to solve feature selection is to organize all possible feature subsets into a Boolean lattice and to exploit the fact that the costs of chains in that lattice describe U-shaped curves. Minimization of such cost function is known as the U-curve problem. Recently, a study proposed U-Curve Search (UCS), an optimal algorithm for that problem, which was successfully used for feature selection. However, despite of the algorithm optimality, the UCS required time in computational assays was exponential on the number of features. Here, we report that such scalability issue arises due to the fact that the U-curve problem is NP-hard. In the sequence, we introduce the Parallel U-Curve Search (PUCS), a new algorithm for the U-curve problem. In PUCS, we present a novel way to partition the search space into smaller Boolean lattices, thus rendering the algorithm highly parallelizable. We also provide computational assays with both synthetic data and Machine Learning datasets, where the PUCS performance was assessed against UCS and other golden standard algorithms in feature selection
Referência
Estrela G, Gubitoso MD, Ferreira CE, Barrera J, Reis MS. An efficient, parallelized algorithm for optimal conditional entropy-based feature selection. Entropy. 2020 Apr;22(4):492. doi:10.3390/e22040492.
URL permanente para citação desta referência
https://repositorio.butantan.gov.br/handle/butantan/3069
URL
https://doi.org/10.3390/e22040492
Sobre o periódico
Palavra-chave
Agência de fomento
Data de publicação
2020
Arquivos neste item
Este item está licenciada sob uma Licença Creative Commons