SmartVisio: Interactive Sketch Recognition with Natural Correction and Editing
- Jie Wu ,
- Changhu Wang ,
- Liqing Zhang ,
- Yong Rui
ACM Conference on Multimedia |
In this work, we introduce the SmartVisio system for in-
teractive hand-drawn shape/diagram recognition. Di er-
ent from existing work, SmartVisio is a real-time sketch
recognition system based on Visio, to recognize hand-drawn
owchart/diagram with
exible interactions. This system
enables a user to draw shapes or diagrams on the Visio in-
terface, and then the hand-drawn shapes are automatically
converted to formal shapes in real-time. To satisfy the inter-
action needs from common users, we propose an algorithm
to detect a user’s correction and editing during drawing,
and then recognize in real time. We also propose a novel
symbol recognition algorithm to better recognize or di er-
entiate some visually similar shapes. By enabling users’ nat-
ural correction/editing on various shapes, our system makes
owchart/diagram production much more natural and eas-
ier.
Smart Ink
Click to download video We systematically study how to incorporate users’ correction and editing into isolated and full sketch recognition. This is a natural and necessary interaction in real systems such as Visio where very similar shapes exist. First, a novel algorithm is proposed to mine the prior shape knowledge for three editing modes. Second, to differentiate visually similar shapes, a novel symbol recognition algorithm is introduced by leveraging the learnt shape knowledge. Then, a novel editing detection algorithm is proposed to facilitate symbol recognition. Furthermore, both of the symbol recognizer and the editing detector are systematically incorporated into the full sketch recognition. Finally, based on the proposed algorithms, a realtime sketch recognition system is built to recognize hand-drawn flowcharts and diagrams with flexible interactions.…