The early phase of the design process is a seemingly chaotic, complex process, involving many methods and representations. In supporting this process, a computer system that can follow the architect in his/her actions may be helpful. Such a system should assist architects in maintaining an overview of the development of their ideas over time, show the current state of the process, and support and stimulate the generation of new associations whenever required. This paper will discuss the rich information structure in the design process and cognitive processes handling this structure. Further there will be a discussion on the features of a system that can handle this rich information.