Training Radial Basis Function Neural Networks for Classification via Class-Specific Clustering
In training radial basis function neural networks (RBFNNs), the locations of Gaussian neurons are commonly determined by clustering. Training inputs can be clustered on a fully unsupervised manner (input clustering), or some supervision can be introduced, for example, by concatenating the input vectors with weighted output vectors (input-output clustering). In this paper, we propose to apply clustering separately for each class (class-specific clustering). The idea has been used in some previous works, but without evaluating the benefits of the approach. We compare the class-specific, input, and input-output clustering approaches in terms of classification performance and computational efficiency when training RBFNNs. To accomplish this objective, we apply three different clustering algorithms and conduct experiments on 25 benchmark data sets. We show that the class-specific approach significantly reduces the overall complexity of the clustering, and our experimental results demonstrate that it can also lead to a significant gain in the classification performance, especially for the networks with a relatively few Gaussian neurons. Among other applied clustering algorithms, we combine, for the first time, a dynamic evolutionary optimization method, multidimensional particle swarm optimization, and the class-specific clustering to optimize the number of cluster centroids and their locations.
- Electrical Engineering [1689 items ]
Showing items related by title, author, creator and subject.
A systematic visual approach to molecular design via property clusters and group contribution methods Eljack, F.T.; Eden, Mario R. ( Elsevier Ltd , 2008 , Article)In this work, a new simple yet effective, systematic method to synthesize and design molecules is presented. Visualization of the problem is achieved by employing an annex to the recently developed property clustering ...
Al-Omary, Alauddin Yousif; Jamil, Mohammad Shahid ( Elsevier B.V. , 2005 , Article)Machine-learning research is to study and apply the computer modeling of learning processes in their multiple manifestations, which facilitate the development of intelligent system. In this paper, we have introduced a ...
Rabiller, P.; Boles, P.; Boashash, B. ( IEEE , 2010 , Conference Paper)We describe here new possibilities offered by a clustering method routinely used by many petroleum companies and which could be used in other applications where analysis of multichannel signals has a significant role ...