Concerning the differentiability of the energy function in vector quantization algorithms

Dominique Lepetz, Max Némoz-Gaillard, Michaël Aupetit*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

The adaptation rule of Vector Quantization algorithms, and consequently the convergence of the generated sequence, depends on the existence and properties of a function called the energy function, defined on a topological manifold. Our aim is to investigate the conditions of existence of such a function for a class of algorithms including the well-known 'K-means' and 'Self-Organizing Map' algorithms. The results presented here extend several previous studies and show that the energy function is not always a potential but at least the uniform limit of a series of potential functions which we call a pseudo-potential. It also shows that a large number of existing vector quantization algorithms developed by the Artificial Neural Networks community fall into this class. The framework we define opens the way to studying the convergence of all the corresponding adaptation rules at once, and a theorem gives promising insights in that direction.

Original languageEnglish
Pages (from-to)621-630
Number of pages10
JournalNeural Networks
Volume20
Issue number5
DOIs
Publication statusPublished - Jul 2007
Externally publishedYes

Keywords

  • Energy function
  • K-means
  • Neural-gas
  • Potential function
  • Pseudo-potential
  • Self-organizing maps
  • Vector quantization

Fingerprint

Dive into the research topics of 'Concerning the differentiability of the energy function in vector quantization algorithms'. Together they form a unique fingerprint.

Cite this