An Improved Algorithm for Neural Network Classification of Imbalanced Training Sets

Rangachari Anand, Kishan G. Mehrotra, Chilukuri K. Mohan, Sanjay Ranka

Research output: Contribution to journalArticle

104 Scopus citations

Abstract

The backpropagation algorithm converges very slowly for two class problems in which most of the exemplars belong to one dominant class. We analyze that this occurs because the computed net error gradient vector is dominated by the bigger class so much that the net error for the exemplars in the smaller class increases significantly in the initial iteration. The subsequent rate of convergence of the net error is very low. We present a modified technique for calculating a direction in weight space which decreases the error for each class. Using this algorithm, we have been able to accelerate the rate of learning for two class classification problems by an order of magnitude.

Original languageEnglish (US)
Pages (from-to)962-969
Number of pages8
JournalIEEE Transactions on Neural Networks
Volume4
Issue number6
DOIs
StatePublished - Nov 1993

ASJC Scopus subject areas

  • Software
  • Computer Science Applications
  • Computer Networks and Communications
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'An Improved Algorithm for Neural Network Classification of Imbalanced Training Sets'. Together they form a unique fingerprint.

  • Cite this