In this paper we present an architecture for multi-modal dialogue systems. It is illustrated from our development of a multi-modal information system for local bus timetable information. The system is based on a natural language interface for typed interaction that is enhanced to handle also multi-modal interaction. The multi-modal user interface was designed based on empirical investigations and some results from these investigations are presented. We also show how information specification forms can be utilised to handle requests typical for timetable information systems and how spatial and temporal information is integrated and used in the system.