By the same authors

From the same journal

From the same journal

A Bayesian interpretation for the exponential correlation associative memory

Research output: Contribution to journalArticle

Author(s)

Department/unit(s)

Publication details

JournalPattern Recognition Letters
DatePublished - 1 Feb 1998
Issue number2
Volume19
Number of pages11
Pages (from-to)149-159
Original languageEnglish

Abstract

The exponential correlation associative memory (ECAM) is a recurrent neural network model which has large storage capacity and is particularly suited for VLSI hardware implementation. Our aim in this paper is to show how the ECAM model can be entirely derived within a Bayesian framework, thereby providing more insight into the behaviour of this algorithm. The framework for our study is a novel relaxation method which involves direct probabilistic modelling of the pattern corruption mechanism. The parameter of this model is the memoryless probability of error on nodes of the network. This bit-error probability is not only important for the interpretation of the ECAM model, but allows also us to understand some more general properties of Bayesian pattern reconstruction by relaxation. In addition, we demonstrate that both the Hopfield memory and the Boolean network model developed by Aleksander can be regarded as limits of the presented relaxation approach with precise physical meaning in terms of this parameter. To study the dynamical behaviour of our relaxation model, we use the Hamming distance picture of Kanerva which allows us to understand how the bit-error probability evolves during the relaxation process. We also derive a parameter-free expression for the storage capacity of the model which, like a previous result of Chiueh and Goodman, scales exponentially with the number of nodes in the network. (C) 1998 Elsevier Science B.V. All rights reserved.

    Research areas

  • associative memories, exponential correlation associative memory, Bayes treatment, Hopfield network, discrete relaxation, storage capacity, NEURAL NETWORKS, RELAXATION, DISTRIBUTIONS, CAPACITY

Discover related content

Find related publications, people, projects, datasets and more using interactive charts.

View graph of relations