We have developed a novel approach for summarizing video in the form of a multiscale image that is continuous across both time and scale: There are no hard borders between discrete moments in time, and a user can zoom smoothly into the image to reveal additional temporal details. We call these summaries tapestries because their continuous nature is inspired by medieval tapestries and other ancient narrative depictions. These can be constructed at high quality, or, by adjusting some optimization parameters, in real time. This makes them usable as an interactive interface for video navigation. Our video tapestries combine the best aspects of two common visualizations, providing the visual clarity of DVD chapter menus with the information density and multiple scales of a video editing timeline. In addition, they provide continuous transitions between zoom levels. In a user study, participants preferred both the aesthetics and efficiency of tapestries over other interfaces for visual browsing.