Improved algorithm for neural network classification of imbalanced training set

Rangachari Anand, Kishan G. Mehrotra, Chilukuri K Mohan, Sanjay Ranka

Research output: Contribution to journalArticle

99 Scopus citations


The backpropagation algorithm converges very slowly for two-class problems in which most of the exemplars belong to one dominant class. We analyze that this occurs because the computed net error gradient vector is dominated by the bigger class so much that the net error for the exemplars in the smaller class increases significantly in the initial iteration. The subsequent rate of convergence of the net error is very low. We present a modified technique for calculating a direction in weight-space which decreases the error for each class. Using this algorithm, we have been able to accelerate the rate of learning for two-class classification problems by an order of magnitude.

Original languageEnglish (US)
Pages (from-to)962-969
Number of pages8
JournalIEEE Transactions on Neural Networks
Issue number6
StatePublished - Nov 1993


ASJC Scopus subject areas

  • Artificial Intelligence
  • Computational Theory and Mathematics
  • Hardware and Architecture
  • Control and Systems Engineering
  • Electrical and Electronic Engineering
  • Theoretical Computer Science

Cite this