Associative memory based on cellular neural networks with bipolar stepwise activation function | Prikladnaya Diskretnaya Matematika - Applied Discrete Mathematics. 2020. № 48. DOI: 10.17223/20710410/48/9

Cellular neural networks (CNN) with a bipolar stepwise activation function are considered as obtained by training on a given set of binary reference images. The trained CNN versions with the different cell neighborhood sizes were tested in solving the problem of filtering noisy reference images. It has been established that global training methods (the Hebb method and the projection method), traditionally used in Hopfield networks, generate high-level noise (tens of percent) at the output of cellular networks even in the absence of input noise. A local analogue of the projection method is proposed that provides the filtering of noisy images significantly better than the classical local perceptron learning algorithm. The local Hebb method works better than the above two methods only with minimal neighborhood and high noise levels (70% at least). The influence of the CNN weights quantization levels number on the CNN information capacity is investigated. It is shown that: 1) with the number of quantization levels greater than 8 and the number of neurons 16 x 16, the capacity of the CNN with quantized weights, trained according to the local Hebb rule, approximates the capacity of the CNN with continuous weights; 2) when using the local projection method, a similar result is achieved with a number of levels not less than 64.
Download file
Counter downloads: 147
  • Title Associative memory based on cellular neural networks with bipolar stepwise activation function
  • Headline Associative memory based on cellular neural networks with bipolar stepwise activation function
  • Publesher Tomask State UniversityTomsk State University
  • Issue Prikladnaya Diskretnaya Matematika - Applied Discrete Mathematics 48
  • Date:
  • DOI 10.17223/20710410/48/9
Keywords
клеточные нейронные сети, фильтрация шумов, алгоритм обучения персептрона, локальный метод проекций, окрестность клетки, информационная ёмкость клеточной нейронной сети, квантование весов, cellular neural networks, noise filtering, perceptron training algorithm, local projection method, cell neighborhood, informational capacity of cellular neural network, weight quantization
Authors
References
Осовский С. Нейронные сети для обработки информации. М.: Финансы и статистика, 2002.
Hopfield J. Neural networks and physical systems with emergent collective computational abilities // Proc. NAS USA. 1982. V. 79. P.2554-2558.
Personnaz L., Guyon I., and Dreyfus G. Collective computational properties of neural networks: new learning mechanisms // Phys. Rev. Ser. A. 1986. V. 34. No. 5. P.4217-4228.
Michel A. N. and Liu D. Qualitative Analysis and Synthesis of Recurrent Neural Networks. N.Y.: Marcel Dekker Inc., 2002.
Tarkov M. S. Synapses reduction in autoassociative Hopfield network // Proc. Int. IEEE Conf. SIBIRCON-2017. Novosibirsk, Sept. 18-22, 2017. P.158-160. https://ieeexplore.ieee. org/xpl/conhome/8099466/proceeding.
Chua L. O. and Yang L. Cellular neural networks: theory and application // IEEE Trans. Circuits and Systems. 1988. V. CAS-35. P. 1257-1290.
Pudov S. G. Learning of cellular neural networks // Future Generation Computer Systems. 2001. V. 17. P.689-697.
Park J., Kim H.-Y., Park Y., and Leed S.-W. A synthesis procedure for associative memories based on space-varying cellular neural networks // Neural Networks. 2001. V. 14. P. 107-113.
Li H., Liao X., Li C., et al. Edge detection of noisy images based on cellular neural networks // Commun. Nonlinear Sci. Numer. Simulat. 2011. V. 16. P.3746-3759.
Duan S., Hu X., Dong Z., et al. Memristor-based cellular nonlinear/neural network: design, analysis, and applications // IEEE Trans. Neural Networks and Learning Systems. 2015. V. 26. No. 6. P.1202-1213.
Rosenblatt F. Principles of Neurodynamics. Washington: Spartan, 1959.
Chua L. Memristor - the missing circuit element // IEEE Trans. Circuit Theory. 1971. V. 18. P. 507-519.
Strukov D.B., Snider G.S., Stewart D.R., and Williams R.S. The missing memristor found // Nature. 2008. V.453. P.80-83.
He W., Sun H., Zhou Y., et al. Customized binary and multi-level HfO2-x-based memristors tuned by oxidation conditions // Scientific Reports. 2017. V. 7. Article number: 10070.
 Associative memory based on cellular neural networks with bipolar stepwise activation function | Prikladnaya Diskretnaya Matematika - Applied Discrete Mathematics. 2020. № 48. DOI: 10.17223/20710410/48/9
Associative memory based on cellular neural networks with bipolar stepwise activation function | Prikladnaya Diskretnaya Matematika - Applied Discrete Mathematics. 2020. № 48. DOI: 10.17223/20710410/48/9