{"id":308303,"date":"2006-09-07T12:00:47","date_gmt":"2006-09-07T19:00:47","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?p=308303"},"modified":"2016-10-19T01:11:37","modified_gmt":"2016-10-19T08:11:37","slug":"cartoon-work-makes-graphics-researcher-smile","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/cartoon-work-makes-graphics-researcher-smile\/","title":{"rendered":"Cartoon Work Makes Graphics Researcher Smile"},"content":{"rendered":"

By Rob Knies, Managing Editor, Microsoft Research<\/em><\/p>\n

Kids of all ages love cartoons. They appeal because of their vivid colors, their fluid motion, their whimsical world view, their idealized parallel universe. In a cartoon, a coyote that falls off a cliff and gets flattened by an anvil only hurts for a little while. In a confusing, occasionally painful world, the cartoon\u2019s simple, forgiving existence provides comforting diversion. Who wouldn\u2019t want to be Bugs Bunny?<\/p>\n

Kun Zhou, a researcher and project lead for the Internet Graphics<\/a> group based in Microsoft Research\u2019s Asia lab<\/a>, knows as well as anyone the fascination that animation can engender. But in Zhou\u2019s case, that interest is leading to groundbreaking achievements in computer graphics.<\/p>\n

Zhou\u2019s Web site reveals an impressive list of publications and projects related to that field, among them a paper presented during SIGGRAPH 2005 entitled Large Mesh Deformation Using the Volumetric Graph Laplacian<\/em><\/a>, co-written by former Microsoft Research Asia intern Jin Huang, John Snyder of Microsoft Research\u2019s Redmond lab<\/a>, fellow Asia-lab researcher Xinguo Liu, Hujun Bao of Zhejiang University, and Baining Guo<\/a> and Harry Shum<\/a> of Microsoft Research Asia.<\/p>\n

In that paper, Zhou et al. describe the use of a technique called volumetric graph Laplacian to diminish unrealistic effects of 3D modeling present in previous work in this field.<\/p>\n

\u201cWe present a novel technique for large deformations on 3D meshes,\u201d Zhou says. In layman\u2019s terms, that means making the movements of three-dimensional animations appear more real and lifelike.<\/p>\n

\u201cMy research interests focus mainly on computer-graphics algorithms,\u201d Zhou explains. \u201cWe are inventing technologies to generate beautiful and realistic pictures in real time for the film and gaming industries.<\/p>\n

\u201cOne part of this research goal is realism, which takes a lot of manual work and computation time. The other part is automatic, real-time performance. The biggest challenge is how to balance these two objectives.\u201d<\/p>\n

Mesh deformation has been a valuable technique in cartoon modeling and animation. Many applications have been devised to help artists construct stylized body shapes and body movements. But there has been a lingering challenge with large deformations, such as those found with characters performing nonrigid, highly exaggerated movements.<\/p>\n

Nonrigid, highly exaggerated movements? Sounds like Bart Simpson skateboarding through Springfield.<\/p>\n

\u201cThe goal of our work,\u201d Zhou says, \u201cis to develop an interactive system to transfer the deformations of 2D cartoon characters to 3D objects. Previous deformation techniques often produce implausible results with unnatural volume changes and self-intersections. We need to remove these artifacts.\u201d<\/p>\n

Volumetric graph Laplacian, it appears, is a superior technique. But what does it mean?<\/p>\n

\u201cThe volumetric graph Laplacian of a point in a three-dimensional space,\u201d Zhou states, \u201cis defined as the relative position with respect to its neighboring points. Mathematically, it is computed as the difference between the point and the weighted average of its neighboring points.<\/p>\n

Determining how the 3D mesh model reacts to various movements is a key to creating lifelike movements. Techniques, such as Poisson mesh editing, the previous method employed by Zhou and associates, resulted in unnatural folds when an item\u2014say, a leg\u2014was bent, and an unrealistic loss of volume when an item was twisted.<\/p>\n

Earlier techniques relied on manipulating surfaces to produce realistic movements. But that required providing a mesh framework for the entire interior of a model, a notoriously difficult undertaking.<\/p>\n

\u201cWe realized,\u201d Zhou says, \u201cthat previous surface-detail preservation is not enough for such large deformations.\u201d<\/p>\n

By analyzing the direction of a limited set of points within the surface framework of the mesh, Zhou was able to produce dramatically superior 3D movements.<\/p>\n

\u201cTo use our system,\u201d he says, \u201cthe user simply takes a 3D object and a 2D cartoon image sequence. The user specifies one or more 3D control curves on the object, and for each curve, a series of 2D curves in the cartoon image. Our algorithm will automatically transfer the 2D cartoon deformations to the 3D object.\u201d<\/p>\n

A video makes the advances abundantly clear. Control curves are drawn along the spine and the legs of a 3D dinosaur skeleton. The model is rotated to define the projection plane for each control curve. Then a spinal curve and a leg curve are copied from a frame of a cartoon cat in the midst of an energetic kick. Those curves are applied to the dinosaur mesh, and voil\u00e0, the dinosaur begins to kick, in a fashion nearly identical to that of the animated feline.<\/p>\n

Such techniques can be applied any number of ways. Not much later in the video, the same dinosaur is dancing. A model cat is walking. A lioness glides at full speed. An armadillo throws a baseball. All these movements come from tracing a few curves from a cartoon image and transferring them to a mesh model. It\u2019s a classic example of computer-generated \u201clife\u201d imitating art, particularly so when you consider that Zhou and his collaborators got permission to use and reproduce some famous animation cels from Disney Feature Animation.<\/p>\n

\u201cWhen I showed that the motion of some classic 2D cartoon animations, such as the famous Goofy, was transferred to arbitrary complex 3D objects, such as the Stanford armadillo, with 170,000 vertices, in a few minutes,\u201d Zhou recalls, \u201cmy boss and colleagues were just shocked.\u201d<\/p>\n

To be clear, the project did not focus on deforming the 3D model into precisely the same pose as the cartoon\u2019s.<\/p>\n

\u201cThis is difficult,\u201d Zhou explains, \u201cbecause their shapes are so different and because cartoons are drawings that may not be reflective of the motion of 3D geometry. Instead, our goal is to transfer the quality of the cartoon\u2019s motion to the 3D model.<\/p>\n

\u201cAs the animations in the video show, we successfully obtain motions that are remarkably similar to the cartoon\u2019s.\u201d<\/p>\n

Next up: refining the concept.<\/p>\n

\u201cCurrently,\u201d he says, \u201cit\u2019s still tedious for the user to specify corresponding curves between 2D cartoon characters and 3D objects. A more intuitive user interaction is point-based: Specifying corresponding points between 2D cartoon characters and 3D objects is much easier.\u201d<\/p>\n

In fact, Zhou and many of the same colleagues presented a paper entitled Subspace Gradient Domain Mesh Deformation<\/em><\/a> during the SIGGRAPH 2006 conference.<\/p>\n

But make no mistake about it: Zhou considers his hours of idling in front of televised cartoons to be time well spent.<\/p>\n

\u201cI am proud,\u201d he says, \u201cthat we achieved these high-quality deformation-retargeting results for the first time in computer graphics.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"

By Rob Knies, Managing Editor, Microsoft Research Kids of all ages love cartoons. They appeal because of their vivid colors, their fluid motion, their whimsical world view, their idealized parallel universe. In a cartoon, a coyote that falls off a cliff and gets flattened by an anvil only hurts for a little while. In a […]<\/p>\n","protected":false},"author":39507,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"footnotes":""},"categories":[194480],"tags":[194526,214961,215711,201049,215708,215714],"research-area":[13551],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-308303","post","type-post","status-publish","format-standard","hentry","category-graphics-and-multimedia","tag-3d-modeling","tag-animation","tag-cartoons","tag-computer-graphics","tag-poisson-mesh-editing","tag-volumetric-graph-laplacian","msr-research-area-graphics-and-multimedia","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[199565,199560],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[144710],"related-projects":[],"related-events":[],"related-researchers":[],"msr_type":"Post","byline":"","formattedDate":"September 7, 2006","formattedExcerpt":"By Rob Knies, Managing Editor, Microsoft Research Kids of all ages love cartoons. They appeal because of their vivid colors, their fluid motion, their whimsical world view, their idealized parallel universe. In a cartoon, a coyote that falls off a cliff and gets flattened by…","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/308303"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/39507"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=308303"}],"version-history":[{"count":2,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/308303\/revisions"}],"predecessor-version":[{"id":308723,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/308303\/revisions\/308723"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=308303"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=308303"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=308303"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=308303"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=308303"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=308303"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=308303"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=308303"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=308303"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=308303"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=308303"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}