The paper presents a framework for the recognition of free-hand sketches based on spatial and temporal information that permits identification of strokes, grouping of strokes into graphic symbols and recognition of depictions of building elements in the graphic symbols. It proposes that the symbols involved in 2D projections are generally small and manageable despite the vagueness and multiple layering of sketches.