Incremental learning in terms of output attributes

Sheng Uei Guan*, Peng Li

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

11 Citations (Scopus)


This paper deals with the situation where output attributes are introduced to a neural network incrementally, Conventionally, when new outputs are introduced to a neural network, the old network would be discarded and a new network would be retrained to integrate the old knowledge with the new knowledge. However, this method is likely to be computationally inefficient, mainly due to the loss of learnt knowledge in the existing network. As such, our primary interest is to integrate both old and new knowledge to form a single network as the solution. In this paper, we present three Incremental Output Learning (IOL) algorithms for incremental output learning. When a new output attribute is introduced to the original problem, a new sub-network is trained under IOL to acquire the new knowledge and the output attributes from the new sub-network are integrated with the output attributes of the existing network. The experimental results from several benchmarking datasets show that our methods are more effective and more efficient than conventional retraining methods.

Original languageEnglish
Pages (from-to)95-122
Number of pages28
JournalJournal of Intelligent Systems
Issue number2
Publication statusPublished - 2004
Externally publishedYes


  • Incremental learning
  • Neural networks
  • Output attributes
  • Supervised learning


Dive into the research topics of 'Incremental learning in terms of output attributes'. Together they form a unique fingerprint.

Cite this