用分維神經(jīng)網(wǎng)絡(luò)實(shí)現(xiàn)短期記憶
FRACTAL NEURAL NETWORKS FOR SHORT TERM MEMORY
-
摘要: 神經(jīng)網(wǎng)絡(luò)中的突觸連接矩陣儲(chǔ)存有限的信息。當(dāng)神經(jīng)網(wǎng)絡(luò)在線使用時(shí),基于Hebb規(guī)則的網(wǎng)絡(luò)模型將不再適用。本文提出用分維神經(jīng)網(wǎng)絡(luò)實(shí)現(xiàn)短期記憶,要求舊的模式隨時(shí)間而遺忘,最近存儲(chǔ)的模式可以可靠記憶。實(shí)驗(yàn)結(jié)果表明,該網(wǎng)絡(luò)模型適用于在線工作,且優(yōu)于對(duì)比方法。
-
關(guān)鍵詞:
- 分維神經(jīng)網(wǎng)絡(luò); 短期記憶; 突觸連接矩陣
Abstract: Synaptic connection matrix encodes limited information. It is well known that neural network memory with storage prescriptions based on Hebb s rule will collapse as more patterns are stored. By requiring that old patterns are automatically forgotten and the memory recalls only the most recent ones, a new short-term neural network memory based on Y.Baram s fractal neural network is proposed. Comparison is made with Morris and Wong's method and the experimental results are shown to be rather satisfactory and encouraging. -
Hopfield J J. Neural networks and physical systems with emergent computational abilities, Proc[J].Nat. Acad. Sci.1982, 79:2554-2558[2]Ho C Y, Sasase I, Mori S. On the capacity of the Hopfield associative memory, Proc. of IEEE/INNS IJCNN92, Baltimore: 1993, 196-201.[3]Morris Robert J T, Wong Wing Shing. A short-term neural network memory, SIAM J. Comput., 1988, 17(6): 1103-1118.[4]Baram Y. Associative memory in fractal neural networks, IEEE Trans. on SMC, 1989, SMC-19(5): 1133-1141.[5]Mezard M, Nadal J P, Toulouse G. Solvable models of working memories, J. Physique, 1996, 47(7): 1457-1462.[6]Li Xia, Wong Wing Shing. Fractal neural networks for short term memory, Proc. of 1994 ICNN of the IEEE WCCI, Orlando: 1995, 2454-2459. -
計(jì)量
- 文章訪問(wèn)數(shù): 1981
- HTML全文瀏覽量: 113
- PDF下載量: 604
- 被引次數(shù): 0