ABSTRACT

Unification-based approaches have come to play an important role in both

theoretical and applied modeling of cognitive processes, most notably natural

language. Attempts to model such processes using neural networks have met

with some success, but have faced serious hurdles caused by the limitations of

standard connectionist coding schemes. As a contribution to this effort, this

paper presents recent work in Infinite RAAM (IRAAM), a new connectionist

unification model. Based on a fusion of recurrent neural networks with fractal

geometry, IRAAM allows us to understand the behavior of these networks as

dynamical systems. Using a logical programming language as our modeling

domain, we show how this dynamical-systems approach solves many of the

problems faced by earlier connectionist models, supporting unification over

arbitrarily large sets of recursive expressions. We conclude that IRAAM can

provide a principled connectionist substrate for unification in a variety of

cognitive modeling domains

Language and Connectionism: Three Approaches

Language, to a cognitive scientist, can be held to include natural language and the

“language of thought” (Fodor 1975), as well as symbolic programming languages

developed to simulate these, like LISP and Prolog. Attempts to build connectionist

models of such systems have generally followed one of three approaches.