How2Sketch: Generating Easy-To-Follow Tutorials for Sketching 3D Objects

1University College London         2KAUST        3Adobe Research

Symposium on Interactive 3D Graphics and Games 2017

(a) We present How2Sketch, a system that automatically generates easy-to-follow tutorials for drawing 3D models. Each generated tutorial presents a list of steps for drawing scaffolding primitives that help the user draw the object in correct perspective. To help the user draw the scaffolding, the tutorial shows how to construct guidelines that anchor object parts relative to one another. User study feedback on the tutorials indicates that users feel they are able to create more accurate drawings~(b).


Accurately drawing 3D objects is difficult for untrained individuals, as it requires an understanding of perspective and its effects on geometry and proportions. Step-by-step tutorials break the complex task of sketching an entire object down into easy-to-follow steps that even a novice can follow. However, creating such tutorials requires expert knowledge and is time-consuming. As a result, the availability of tutorials for a given object or viewpoint is limited. How2Sketch (H2S) addresses this problem by automatically generating easy-to-follow tutorials for arbitrary 3D objects. Given a segmented 3D model and a camera viewpoint, H2S computes a sequence of steps for constructing a drawing scaffold comprised of geometric primitives, which helps the user draw the final contours in correct perspective and proportion. To make the drawing scaffold easy to construct, the algorithm solves for an ordering among the scaffolding primitives and explicitly makes small geometric modifications to the size and location of the object parts to simplify relative positioning. Technically, we formulate this scaffold construction as a single selection problem that simultaneously solves for the ordering and geometric changes of the primitives. We generate different tutorials on man-made objects using our method and evaluate how easily the tutorials can be followed with a user study.


  title   = {How2Sketch: Generating Easy-To-Follow Tutorials for Sketching 3D Objects},
  author  = {James W. Hennessey and Han Liu and Holger Winnemöller and Mira Dontcheva  and Niloy J. Mitra},
  year    = {2017},
  journal = {Symposium on Interactive 3D Graphics and Games}

We thank our reviewers for their invaluable comments and the user study participants for their time and feedback. We also thank Daichi Ito, Paul Guerrero, Moos Hueting, Carlo Innamorati, Aron Monszpart, Tuanfeng Yang Wang, Tom Kelly, Bongjin Koo and Martin Kilian for their help, comments and ideas. This work was partially funded by the ERC Starting Grant SmartGeometry (StG-2013-335373), EPSRC EngD Centre EP/G037159/1 and gifts from Adobe.


Paper (23.8MB)

Paper (12.8MB)

Tutorial Sequences (zip, 48.5MB)

Code (Github)

Two Minute Papers Feature