Publications

2024

• DiffCSG: Differentiable CSG via Rasterization

  Haocheng Yuan, Adrien Bousseau, Hao Pan, Chengquan Zhang, Niloy J. Mitra, Changjian Li

  Siggraph Asia 2024

  (Conditionally Accepted)
  

  [webpage]

  [paper]

  creativeAI

  structure-aware geometry processing

• Diffusion Models for Visual Content Generation

  Niloy J. Mitra, Duygu Ceylan, Or Patashnik, Daniel Cohen-Or, Paul Guerrero, Chun-Hao Huang, Minhyuk Sung

  Courses at Siggraph 2024

  [webpage]

  creativeAI

• Towards Computationally Efficient, Photorealistic, and Scalable 3D Generative Modelling

  Animesh Karnewar

  PhD thesis 2024

  [pdf]

  creativeAI

• Temporal Residual Jacobians for Rig-free Motion Transfer

  Sanjeev Muralikrishnan, Niladri Shekhar Dutt, Siddhartha Chaudhuri, Noam Aigerman, Vladimir Kim, Matthew Fisher, Niloy J. Mitra

  ECCV 2024

  [webpage]

  creativeAI

• GOEmbed: Representation Agnostic 3D Feature Learning

  Animesh Karnewar, Andrea Vedaldi, Roman Shapovalov, Tom Monnier, Niloy J. Mitra, David Novotny

  ECCV 2024

  [webpage]

  [paper]

  creativeAI

• SuperGaussian: Repurposing Video Models for 3D Super Resolution

  Yuan Shen, Duygu Ceylan, Paul Guerrero, Zexiang Xu, Niloy J. Mitra, Shenlong Wang, Anna Frühstück

  ECCV 2024

  [paper]

  [webpage]

  creativeAI

• LooseControl: Lifting ControlNet for Generalized Depth Conditioning

  Shariq Farooq Bhat, Niloy J. Mitra, Peter Wonka

  Siggraph 2024

  [paper]

  [webpage]

  [code]

  creativeAI

• Diffusion 3D Features (Diff3F): Decorating Untextured Shapes with Distilled Semantic Features

  Niladri Shekhar Dutt, Sanjeev Muralikrishnan, Niloy J. Mitra

  CVPR 2024

  [paper]

  [webpage]

  creativeAI

• Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3D

  Karran Pandey, Paul Guerrero, Matheus Gadelha, Yannick Hold-Geoffroy, Karan Singh, Niloy J. Mitra

  CVPR 2024

  Selected as Highlight

  [paper]

  [webpage]

  creativeAI

• CADTalk: An Algorithm and Benchmark for Semantic Commenting of CAD Programs

  Haocheng Yuan, Jing Xu, Hao Pan, Adrien Bousseau, Niloy J. Mitra, Changjian Li

  CVPR 2024

  Selected as Highlight

  [paper]

  [webpage]

  creativeAI

• ProteusNeRF: Fast Lightweight NeRF Editing using 3D-Aware Image Context

  Binglun Wang, Niladri Shekhar Dutt, Niloy J. Mitra

  I3D 2024

  [paper]

  [webpage]

  creativeAI

• Diffusion Models for Visual Computing

  Niloy J. Mitra, Danny CohenOr, Minhyuk Sung, Duygu Ceylan, Chun-Hao Huang, Paul Guerrero

  Eurographics 2024

  Eurographics 2024 Tutorial

  [webpage]

  creativeAI

2023

• HoloFusion: Towards Photorealistic 3D Generative Modeling

  Animesh Karnewar, Niloy J. Mitra, Andrea Vedaldi, David Novotny

  ICCV 2023

  [webpage]

  [paper]

  [code]

  creativeAI

• Pix2Video: Video Editing using Image Diffusion

  Duygu Ceylan, Chun-Hao Huang, Niloy J. Mitra

  ICCV 2023

  [webpage]

  [paper]

  [code]

  creativeAI

• Factored Neural Representation for Scene Understanding

  Yu-Shiang Wong, Niloy J. Mitra

  SGP 2023

  [webpage]

  [code]

  creativeAI

• Dynamic Scene Reconstruction and Understanding

  Yu-Shiang Wong

  PhD thesis 2023

  [pdf]

  creativeAI

  shape acquisition and abstraction

• ShapeCoder: Discovering Abstractions for Visual Programs from Unstructured Primitives

  Kenny Jones, Paul Guerrero, Niloy J. Mitra, Daniel Ritchie

  SIGGRAPH 2023

  [webpage]

  shape analysis

  creativeAI

• COFS: COntrollable Furniture layout Synthesis

  Wamiq Para, Paul Guerrero, Niloy J. Mitra, Peter Wonka

  SIGGRAPH 2023

  [webpage]

  creativeAI

• HoloDiffusion: Training a 3D Diffusion Model using 2D Images

  Animesh Karnewar, Andrea Vedaldi, David Novotny, Niloy J. Mitra

  CVPR 2023

  [webpage]

  [paper]

  [code]

  creativeAI

• RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation

  Titas Anciukevičius, Zexiang Xu, Matthew Fisher, Paul Henderson, Hakan Bilen, Niloy J. Mitra, Paul Guerrero

  CVPR 2023

  [paper]

  [webpage]

  creativeAI

• Blowing in the Wind: CycleNet for Human Cinemagraphs from Still Images

  Hugo Bertiche, Niloy J. Mitra, Kuldeep Kulkarni, Chun-Hao Paul Huang, Tuanfeng Y. Wang, Meysam Madadi, Sergio Escalera, Duygu Ceylan

  CVPR 2023

  [paper]

  [webpage]

  creativeAI

• Neurosymbolic Models for Computer Graphics

  Daniel Ritchie, Paul Guerrero, Kenny Jones, Niloy J. Mitra, Adriana Schulz, Karl D. D. Willis, Jiajun Wu

  Eurographics 2023

  [paper]

  creativeAI

  structure-aware geometry processing

2022

• Search for Concepts: Discovering Visual Concepts Using Direct Optimization

  Pradyumna Reddy, Paul Guerrero, Niloy J. Mitra

  BMVC 2022

  [paper]

  [webpage]

  [code]

  creativeAI

  shape acquisition and abstraction

• NeuForm: Adaptive Overfitting for Neural Shape Editing

  Connor Z. Lin, Niloy J. Mitra, Gordon Wetzstein, Leonidas Guibas, Paul Guerrero

  NeurIPS 2022

  Selected for Oral presentation
  

  [paper]

  creativeAI

• Motion Guided Deep Dynamic 3D Garments

  Meng Zhang, Duygu Ceylan, Niloy J. Mitra

  Siggraph Asia 2022

  [webpage]

  [code]

  [paper]

  creativeAI

• CAD2Sketch: Generating Concept Sketches from CAD Sequences

  Felix Hähnlein, Changjian Li, Niloy J. Mitra, Adrien Bousseau

  Siggraph Asia 2022

  [webpage]

  shape analysis

  creativeAI

  shape acquisition and abstraction

• 3inGAN: Learning a 3D Generative Model from Images of a Self-similar Scene

  Animesh Karnewar, Tobias Ritschel, Oliver Wang, Niloy J. Mitra

  3DV 2022

  [webpage]

  creativeAI

  shape acquisition and abstraction

• ReLU Fields: The Little Non-linearity That Could

  Animesh Karnewar, Tobias Ritschel, Oliver Wang, Niloy J. Mitra

  SIGGRAPH 2022

  [webpage]

  [code]

  [paper]

  creativeAI

• Free2CAD: Parsing Freehand Drawings Into CAD Commands

  Changjian Li, Hao Pan, Adrien Bousseau, Niloy J. Mitra

  SIGGRAPH 2022

  Honorable Mention Best Paper Award

  [webpage]

  [paper]

  [code]

  [video]

  shape analysis

  creativeAI

  shape acquisition and abstraction

  structure-aware geometry processing

• MatFormer: A Generative Model for Procedural Materials

  Paul Guerrero, Miloš Hašan, Kalyan Sunkavalli, Radomír Měch, Tamy Boubekeur, Niloy J. Mitra

  SIGGRAPH 2022

  [webpage]

  [paper]

  creativeAI

• CLIP2StyleGAN: Unsupervised Extraction of StyleGAN Edit Directions

  Rameen Abdal, Peihao Zhu, John Femiani, Niloy J. Mitra, Peter Wonka

  SIGGRAPH 2022

  Selected for lab demo

  [webpage]

  [code]

  [paper]

  creativeAI

• GLASS: Geometric Latent Augmentation for Shape Spaces

  Sanjeev Muralikrishnan, Siddhartha Chaudhuri, Noam Aigerman, Vladimir Kim, Matthew Fisher, Niloy J. Mitra

  CVPR 2022

  [webpage]

  [code]

  [paper]

  creativeAI

• InsetGAN for Full-Body Image Generation

  Anna Frühstück, Krishna Kumar Singh, Eli Shechtman, Niloy J. Mitra, Peter Wonka, and Jingwan (Cynthia) Lu

  CVPR 2022

  [webpage]

  creativeAI

• ShapeFormer: Transformer-based Shape Completion via Sparse Representation

  Xingguang Yan, Liqiang Lin, Niloy J. Mitra, Dani Lischinski, Danny Cohen-Or, Hui Huang

  CVPR 2022

  [paper]

  [code]

  [webpage]

  shape analysis

  creativeAI

• MoCo-Flow: Neural Motion Consensus Flow for Dynamic Humans in Stationary Monocular Cameras

  Xuelin Chen, Weiyu Li, Daniel Cohen-Or, Niloy J. Mitra, Baoquan Chen

  Eurographics 2022

  [paper]

  [webpage]

  creativeAI

• Z2P: Instant Rendering of Point Clouds

  Gal Metzer, Rana Hanocka, Raja Giryes, Niloy J. Mitra, Daniel Cohen-Or

  Eurographics 2022

  [paper]

  shape analysis

  creativeAI

2021

• Dance In the Wild: Monocular Human Animation with Neural Dynamic Appearance Synthesis

  Tuanfeng Y. Wang, Duygu Ceylan, Krishna Kumar Singh, Niloy J. Mitra

  International Conference on 3D Vision 2021

  Selected for Oral presentation main conference
  

  [paper]

  [webpage]

  creativeAI

• Softmesh: Learning Probabilistic Mesh Connectivity via Image Supervision

  Eric-Tuan Lê, Niloy J. Mitra, Iasonas Kokkinos

  International Conference on 3D Vision 2021

  [paper]

  creativeAI

• Dynamic Neural Garments

  Meng Zhang, Tuanfeng Wang, Duygu Ceylan, Niloy J. Mitra

  Siggraph Asia 2021

  [webpage]

  creativeAI

• Generative Modelling of BRDF Textures from Flash Images

  Philipp Henzler, Valentin Deschaintre, Niloy J. Mitra, Tobias Ritschel

  Siggraph Asia 2021

  [paper]

  [webpage]

  [code]

  creativeAI

• CPFN: Cascaded Primitive Fitting Networks for High-Resolution Point Clouds

  Eric-Tuan Le, Minhyuk Sung, Duygu Ceylan, Radomir Mech, Tamy Boubekeur, Niloy J. Mitra

  ICCV 2021

  [webpage]

  creativeAI

• Labels4Free: Unsupervised Segmentation using StyleGAN

  Rameen Abdal, Peihao Zhu, Niloy J. Mitra, Peter Wonka

  ICCV 2021

  [paper]

  [webpage]

  creativeAI

• Inverse Graphics via Simulation-driven Learning

  Carlo Innamorati

  PhD thesis 2021

  [pdf]

  creativeAI

• Im2Vec: Synthesizing Vector Graphics without Vector Supervision

  Pradyumna Reddy, Michael Gharbi, Michal Lukac, Niloy J. Mitra

  CVPR 2021

  Selected for Oral presentation main conference
  Selected for Oral presentation SketchDL workshop
  

  [paper]

  [webpage]

  [code]

  creativeAI

• Seeing Behind Objects for 3D Multi-Object Tracking in RGB-D Sequences

  Norman Müller, Yu-Shiang Wong, Niloy J. Mitra, Angela Dai, Matthias Nießner

  CVPR 2021

  [paper]

  [webpage]

  creativeAI

• Learning Delaunay Surface Elements for Mesh Reconstruction

  Marie-Julie Rakotosaona, Paul Guerrero, Noam Aigerman, Niloy J. Mitra , Maks Ovsjanikov

  CVPR 2021

  Selected for Oral presentation

  [paper]

  creativeAI

• Point2Skeleton: Learning Skeletal Representations from Point Clouds

  Cheng Lin, Changjian Li, Yuan Liu, Nenglun Chen, Yi-King Choi, Wenping Wang

  CVPR 2021

  Selected for Oral presentation
  Best Paper Candidate
  

  [paper]

  [webpage]

  [code]

  creativeAI

• StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flows

  Rameen Abdal, Peihao Zhu, Niloy J. Mitra, Peter Wonka

  ACM TOG 2021

  [paper]

  [webpage]

  [video]

  [code]

  creativeAI

• Deep Detail Enhancement for Any Garment

  Meng Zhang, Tuanfeng Wang, Duygu Ceylan, Niloy J. Mitra

  Eurographics 2021

  Honorable Mention Best Paper Award

  [paper]

  [webpage]

  [video]

  creativeAI

• Neural Graphics Pipeline for Controllable Image Generation

  Xuelin Chen, Daniel Cohen-Or, Baoquan Chen, Niloy J. Mitra

  Eurographics 2021

  [paper]

  [webpage]

  creativeAI

• Walk2Map: Extracting Floor Plans from Indoor Walk Trajectories

  Claudio Mura, Renato Pajarola, Konrad Schindler, Niloy J. Mitra

  Eurographics 2021

  [paper]

  creativeAI

2020

• Crafting Chaos: Computational Design of Contraptions with Complex Behaviour

  Robin Roussel

  PhD thesis 2020

  [pdf]

  creativeAI

• BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Images

  Thu Nguyen-Phuoc, Christian Richardt, Long Mai, Yong-Liang Yang, Niloy Mitra

  NeurIPS 2020

  [paper]

  [webpage]

  [video]

  creativeAI

• Discovering Pattern Structure Using Differentiable Compositing

  Pradyumna Reddy, Paul Guerrero, Matt Fisher, Wilmot Li, Niloy J. Mitra

  Siggraph Asia 2020

  [paper]

  [webpage]

  [video]

  [code]

  creativeAI

• Sketch2CAD: Sequential CAD Modeling by Sketching in Context

  Changjian Li, Hao Pan, Adrien Bousseau, Niloy J. Mitra

  Siggraph Asia 2020

  [paper]

  [webpage]

  [video]

  [code]

  creativeAI

• ShapeAssembly: Learning to Generate Programs for 3D Shape Structure Synthesis

  R. Kenny Jones, Kai Wang, Theresa Barton, Xianghao Xu, Ellen Jiang, Paul Guerrero, Niloy Mitra, Daniel Ritchie

  Siggraph Asia 2020

  [paper]

  [webpage]

  creativeAI

• DeformSyncNet: Deformation Transfer via Synchronized Shape Deformation Spaces

  Minhyuk Sung, Zhenyu Jiang, Panos Achlioptas, Niloy J. Mitra, Leonidas Guibas

  Siggraph Asia 2020

  [paper]

  [webpage]

  creativeAI

• How does Lipschitz Regularization Influence GAN Training?

  Yipeng Qin, Niloy J. Mitra, Peter Wonka

  ECCV 2020

  [paper]

  [webpage]

  creativeAI

• StructEdit: Learning Structural Shape Variations

  Kaichun Mo*, Paul Guerrero*, Li Yi, Hao Su, Peter Wonka, Niloy J. Mitra, Leonidas Guibas

  CVPR 2020

  [paper]

  [webpage]

  [code]

  creativeAI

• Learning a Neural 3D Texture Space from 2D Exemplars

  Philipp Henzler, Niloy J. Mitra, Tobias Ritschel

  CVPR 2020

  [paper]

  [webpage]

  [code]

  [trained_models]

  creativeAI

• Going Deeper with Point Networks

  Eric-Tuan Le, Iasonas Kokkinos, Niloy J. Mitra

  CVPR 2020

  [paper]

  [webpage]

  [code]

  creativeAI

• Unpaired Point Cloud Completion on Real Scans using Adversarial Training

  Xuelin Chen, Baoquan Chen, Niloy J. Mitra

  ICLR 2020

  [paper]

  [code]

  creativeAI

2019

• StructureNet: Hierarchical Graph Networks for 3D Shape Generation

  Kaichun Mo*, Paul Guerrero*, Li Yi, Hao Su, Peter Wonka, Niloy J. Mitra, Leonidas Guibas

  SIGGRAPH Asia 2019

  [paper]

  [webpage]

  [code]

  creativeAI

• Learning an intrinsic garment space for interactive authoring of garment animation

  Tuanfeng Y. Wang, Tianjia Shao, Kai Fu, Niloy J. Mitra

  SIGGRAPH Asia 2019

  [paper]

  [webpage]

  [code]

  creativeAI

• Neural Re-Simulation for Generating Bounces in Single Images

  Carlo Innamorati, Bryan Russell, Danny Kaufman, Niloy J. Mitra

  ICCV 2019

  [paper]

  [webpage]

  creativeAI

• Escaping Plato's Cave: 3D Shape From Adversarial Rendering

  Philipp Henzler, Niloy J. Mitra, Tobias Ritschel

  ICCV 2019

  [paper]

  [webpage]

  [code]

  [poster]

  creativeAI

• Learning on the Edge: Investigating Boundary Filters in CNNs

  Carlo Innamorati, Tobias Ritschel, Tim Weyrich, Niloy J. Mitra

  IJCV 2019

  [paper]

  [webpage]

  creativeAI

• CreativeAI: Deep Learning for Computer Graphics

  Niloy Mitra, Iasonas Kokkinos, Paul Guerrero, Nils Thuerey, Vladimir Kim, Leonidas Guibas

  Course at SIGGRAPH 2019

  [webpage]

  [code]

  creativeAI

• iMapper: Interaction-guided Scene Mapping from Monocular Videos

  Aron Monszpart, Paul Guerrero, Duygu Ceylan, Ersin Yumer, Niloy J. Mitra

  SIGGRAPH 2019

  [webpage]

  [paper]

  [code]

  [video]

  [slides]

  [data]

  creativeAI

• Designing Chain Reaction Contraptions from Causal Graphs

  Robin Roussel, Marie-Paule Cani, Jean-Claude Léon, Niloy J. Mitra

  SIGGRAPH 2019

  Invited to VIS 2019 for Oral presentation

  [webpage]

  [paper]

  [video]

  [code]

  [slides]

  creativeAI

• PointCleanNet: Learning to Denoise and Remove Outliersfrom Dense Point Clouds

  Marie-Julie Rakotosaona*, Vittorio La Barbera*, Paul Guerrero, Niloy J. Mitra, Maks Ovsjanikov

  Computer Graphics Forum 2019

  [webpage]

  [paper]

  [code]

  creativeAI

  shape acquisition and abstraction

• CreativeAI: Deep Learning for Computer Graphics

  Michael Bronstein, Leonidas Guibas, Iasonas Kokkinos, Or Litany, Niloy Mitra, Federico Monti, Emanuele Rodolà

  Tutorial at Eurographics 2019

  [webpage]

  [code]

  creativeAI

• String-Based Synthesis of Structured Shapes

  Javor Kalojanov, Isaak Lim, Niloy J. Mitra, Leif Kobbelt

  EUROGRAPHICS 2019

  [webpage]

  creativeAI

2018

• Generating High-quality 3D Assetsfrom Easy-to-access 2D content

  Tuanfeng Y. Wang

  PhD Thesis 2018

  [pdf]

  creativeAI

• CreativeAI: Deep Learning for Computer Graphics

  Niloy J. Mitra, Iasonas Kokkinos, Paul Guerrero, Nils Thuerey, Tobias Ritschel

  Course at SIGGRAPH Asia 2018

  [webpage]

  [code]

  creativeAI

• FrankenGAN: Guided Detail Synthesis for Building Mass Models Using Style-Synchonized GANs

  Tom Kelly*, Paul Guerrero*, Anthony Steed, Peter Wonka^, Niloy J. Mitra^

  SIGGRAPH Asia 2018

  [webpage]

  [paper]

  [video]

  [code]

  creativeAI

• Learning a Shared Shape Space for Multimodal Garment Design

  Tuanfeng Wang, Duygu Ceylan, Jovan Popovic, Niloy J. Mitra

  SIGGRAPH Asia 2018

  [webpage]

  [paper]

  [video]

  creativeAI

• Learning on the Edge: Explicit Boundary Handling in CNNs

  Carlo Innamorati, Tobias Ritschel, Tim Weyrich, Niloy J. Mitra

  BMVC 2018

  Selected for Oral presentation
  Best Paper Award Honorable Mention
  

  [webpage]

  [paper]

  [slides]

  [supplementary]

  [code]

  creativeAI

• Joint Material and Illumination Estimation from Photo Sets in the Wild

  Tuanfeng Y. Wang, Tobias Ritschel, Niloy J. Mitra

  3DV 2018

  Selected for Oral presentation

  [webpage]

  [paper]

  [supplementary]

  [slides]

  [video]

  [data]

  [code]

  shape analysis

  creativeAI

• Exploratory Design of Mechanical Devices with Motion Constraints

  Robin Roussel, Marie-Paule Cani, Jean-Claude Léon, Niloy J. Mitra

  Computer & Graphics 2018

  [webpage]

  [paper]

  creativeAI

• Assistive Visual Content Creation Tools Via Multimodal Correlation Analysis

  James W. Hennessey

  EngD Thesis 2018

  [pdf]

  creativeAI

• DepthCut: Improved Depth Edge Estimation Using Multiple Unreliable Channels

  Paul Guerrero, Holger Winnemöller, Wilmot Li, Niloy J. Mitra

  CGI 2018

  [webpage]

  [paper]

  [supplementary]

  creativeAI

2017

• Transferring Image-based Edits for Multi-Channel Compositing

  James W. Hennessey, Wilmot Li, Bryan Russell, Eli Shechtman, Niloy J. Mitra

  SIGGRAPH Asia 2017

  [webpage]

  [paper]

  [video]

  [code]

  [supplementary]

  [slides]

  creativeAI

• Computational Design of Wind-up Toys

  Peng Song, Xiaofei Wang, Xiao Tang, Chi-Wing Fu, Hongfei Xu, Ligang Liu, Niloy J. Mitra

  SIGGRAPH Asia 2017

  Featured ACM SIGGRAPH Press Release

  [webpage]

  [press release]

  [paper]

  [video]

  [code]

  [slides]

  creativeAI

• Towards Zero-Waste Furniture Design

  Bongjin Koo*, Jean Hergel*, Sylvain Lefebvre, Niloy J. Mitra

  TVCG 2017

  [webpage]

  [paper]

  [video]

  creativeAI

• Decomposing Single Images for Layered Photo Retouching

  Carlo Innamorati, Tobias Ritschel, Tim Weyrich, Niloy J. Mitra

  Eurographics Symposium on Rendering 2017

  [webpage]

  [paper]

  [video]

  [code]

  [supplementary]

  [slides]

  creativeAI

• SPIROU: Constrained Exploration for Mechanical Motion Design

  Robin Roussel, Marie-Paule Cani, Jean-Claude Léon, Niloy J. Mitra

  Symposium on Computational Fabrication 2017

  [webpage]

  [paper]

  [video]

  [supplementary]

  [slides]

  [code]

  creativeAI

• On Realism of Architectural Procedural Models

  Jan Beneš, Tom Kelly, Filip Děchtěrenko, Jaroslav Křivánek, Pascal Müller

  Eurographics 2017

  [webpage]

  [paper]

  [video]

  creativeAI

• How2Sketch: Generating Easy-To-Follow Tutorials for Sketching 3D Objects

  James W. Hennessey, Han Liu, Holger Winnemöller, Mira Dontcheva, Niloy J. Mitra

  i3D 2017

  [webpage]

  [paper]

  [video]

  [code]

  [tutorials]

  [two minute papers feature]

  creativeAI

  structure-aware geometry processing

2016

• Computational Fabrication Guided by Function and Material Usage

  Bongjin Koo

  Ph.D. thesis 2016

  [pdf]

  creativeAI

  structure-aware geometry processing

• Unsupervised Texture Transfer from Images to Model Collections

  Tuanfeng Wang, Hao Su, Qixing Huang, Jingwei Huang, Leonidas Guibas, Niloy J. Mitra

  SIGGRAPH Asia 2016

  [webpage]

  [paper]

  [additional material]

  [code]

  [slides (soon)]

  creativeAI

• Relationship Templates for Creating Scene Variations

  Xi Zhao, Ruizhen Hu, Paul Guerrero, Niloy J. Mitra, Taku Komura

  SIGGRAPH Asia 2016

  [webpage]

  [paper]

  [additional material]

  [data (soon)]

  [slides (soon)]

  creativeAI

  structure-aware geometry processing

• Learning Semantic Deformation Flows with 3D Convolutional Networks

  M. Ersin Yumer, Niloy J. Mitra

  ECCV 2016

  [webpage]

  [paper]

  [additional material]

  creativeAI

• PATEX: Exploring Pattern Variations

  Paul Guerrero, Gilbert Bernstein, Wilmot Li, Niloy J. Mitra

  SIGGRAPH 2016

  [webpage]

  [paper]

  [video]

  [code]

  [data]

  [additional material]

  [slides]

  shape analysis

  creativeAI

• Computational Network Design from Functional Specifications

  Chi-han Peng, Yongliang Yang, Fan Bao, Daniel Fink, Dongming Yan, Peter Wonka, Niloy J. Mitra

  SIGGRAPH 2016

  [webpage]

  [paper]

  [slides]

  creativeAI

  structure-aware geometry processing

• Spectral Style Transfer for Human Motion between Independent Actions

  M. Ersin Yumer, Niloy J. Mitra

  SIGGRAPH 2016

  [webpage]

  [paper]

  [video]

  [additional material]

  [slides]

  creativeAI

• SmartCanvas: Context-inferred Interpretation of Sketches for Preparatory Design Studies

  Youyi Zheng*, Han Liu*, Julie Dorsey, Niloy J. Mitra

  Eurographics 2016

  [webpage]

  [paper]

  [video]

  [demo / data]

  [code]

  creativeAI

• Interactive Videos: Plausible Video Editing using Sparse Structure Points

  Chai Sheng Chang, Hung-Kuo Chu, Niloy J. Mitra

  Eurographics 2016

  [webpage]

  [paper]

  [video]

  [code]

  [data]

  creativeAI

2015

• An Image Degradation Model for Depth-augmented Image Editing

  James W. Hennessey, Niloy J. Mitra

  Symposium on Geometry Processing 2015

  [webpage]

  [pdf]

  [slides]

  creativeAI

• SmartAnnotator: An Interactive Tool for Annotating Indoor RGBD Images

  Yu-Shiang Wong, Hung-Kuo Chu, Niloy J. Mitra

  Eurographics 2015

  [webpage]

  [pdf]

  [video]

  [code]

  [demo]

  creativeAI

2014

• Creating Works-Like Prototypes of Mechanical Objects

  Bongjin Koo, Wilmot Li, JiaXian Yao, Maneesh Agrawala, Niloy J. Mitra

  Siggraph Asia 2014

  [webpage]

  [pdf]

  [video]

  [slides]

  creativeAI

  structure-aware geometry processing

• A Study of Image Colourfulness

  Cristina Amati, Niloy J. Mitra, Tim Weyrich

  Expressive 2014

  [webpage]

  [pdf]

  creativeAI

• The Revealing Flashlight: Interactive spatial augmented reality for detail exploration of cultural heritage artifacts

  Brett Ridel, Patrick Reuter, Jeremy Laviole, Nicolas Mellado, Xavier Granier, Nadine Couture

  ACM Journal on Computing and Cultural Heritage, Interacting with the past 2014

  [pdf]

  [webpage]

  creativeAI

• ImageSpirit: Verbal Guided Image Parsing

  Ming-Ming Cheng, Shuai Zheng, Wen-Yan Lin, Vibhav Vineet, Paul Sturgess, Nigel Crook, Niloy J. Mitra, Philip Torr

  ACM TOG (to be presented at SIGGRAPH 2015) 2014

  [webpage]

  [pdf]

  [code/demo]

  creativeAI

2013

• Halftone QR Codes

  Hung-Kuo Chu, Chia-Sheng Chang, Ruen-Rone Lee, Niloy J. Mitra

  Siggraph Asia 2013

  [make your own QR]

  [webpage]

  [QR demo]

  [video]

  [pdf]

  creativeAI

• Designing and Fabricating Mechanical Automata from Mocap Sequences

  Duygu Ceylan, Wilmot Li, Niloy J. Mitra, Maneesh Agrawala, Mark Pauly

  Siggraph Asia 2013

  [webpage]

  [pdf]

  [code/demo]

  [video]

  creativeAI

• Surface Perception of Planar Abstractions

  James McCrae, Niloy J. Mitra, Karan Singh

  ACM TAP 2013

  [webpage]

  [pdf]

  [code/demo]

  [video]

  creativeAI

• Sketch-to-Design: Context-based Part Assembly

  Xiaohua Xie, Kai Xu, Niloy J. Mitra, Daniel Cohen-Or, Qi Su, Wenyong Gong, Baoquan Chen

  Computer Graphics Forum 2013

  [webpage]

  [pdf]

  [code/demo]

  [video]

  creativeAI

• Generating and Exploring Good Building Layouts

  Fan Bao, Dongming Yan, Niloy J. Mitra, Peter Wonka

  SIGGRAPH 2013

  [webpage]

  [pdf]

  [code/demo]

  [video]

  creativeAI

2012

• Intuitive Design Exploration of Constrained Meshes

  Xin Zhao, Cheng-Cheng Tang, Yong-Liang Yang, Helmut Pottmann, Niloy J. Mitra

  AAG 2012

  [slides]

  [pdf]

  shape analysis

  creativeAI

• Interactive Images: Cuboid Proxies for Smart Image Manipulation

  Youyi Zheng, Xiang Chen, Ming-Ming Cheng, Kun Zhou, Shi-Min Hu, Niloy J. Mitra

  SIGGRAPH 2012

  [webpage]

  [demo(win)]

  [video]

  [pdf]

  [user study]

  [slides © Youyi]

  [code(win)]

  creativeAI

2011

• Animated Construction of Line Drawings

  Hongbo Fu, Shizhe Zhou, Ligang Liu, Niloy J. Mitra

  SIGGRAPH Asia 2011

  [webpage]

  [pdf]

  [supp. materials]

  [slides]

  creativeAI

2010

• Exploded View Diagrams of Mathematical Surfaces

  Olga Karpenko, Wilmot Li, Niloy J. Mitra, Maneesh Agrawala

  IEEE Vis 2010

  [webpage]

  [pdf]

  shape analysis

  creativeAI

• Illustrating How Mechanical Assemblies Work

  Niloy J. Mitra, Yong-Liang Yang, Dong-Ming Yan, Wilmot Li, Maneesh Agrawala

  SIGGRAPH 2010

  [slides]

  [pdf]

  [webpage]

  shape analysis

  creativeAI

• Camouflage Images

  Hung-Kuo Chu, Wei-Hsin Hsu, Niloy J. Mitra, Daniel Cohen-Or, Tien-Tsin Wong, Tong-Yee Lee

  SIGGRAPH 2010

  [slides]

  [pdf]

  [webpage]

  creativeAI

• RepFinder: Finding Approximately Repeated Scene Elements for Image Editing

  Ming-Ming Cheng, Fang-Lue Zhang, Niloy J. Mitra, Xiaolei Huang, Shi-Min Hu

  SIGGRAPH 2010

  [slides]

  [pdf]

  [webpage]

  creativeAI

  structure-aware geometry processing

2009

• Shadow Art

  Niloy J. Mitra, Mark Pauly

  SIGGRAPH Asia 2009

  [webpage]

  [pdf]

  [demo]

  shape analysis

  creativeAI

• Emerging Images

  Niloy J. Mitra, Hung-Kuo Chu, Tong-Yee Lee, Lior Wolf, Hezy Yeshurun, Daniel Cohen-Or

  SIGGRAPH Asia 2009

  [webpage]

  [slides]

  [code]

  [pdf]

  creativeAI

• iWIRES: An Analyze-and-Edit Approach to Shape Manipulation

  Ran Gal, Olga Sorkine, Niloy J. Mitra, Daniel Cohen-Or

  SIGGRAPH Asia 2009

  [webpage]

  [pdf]

  creativeAI

2008

• Color Harmonization for Videos

  Nikhil Sawant, Niloy J. Mitra

  ICVGIP 2008

  [webpage]

  [pdf]

  [video]

  creativeAI

2003

• A Two-stage Color Palettization Algorithm for Error Diffusion

  Niloy J. Mitra, Maya Gupta

  SPIE Electronic Imaging Conference 2002

  [webpage]

  [pdf]

  creativeAI