Creative AI
Shengfeng He
Singapore Management University
[Link]
Prof. HE Shengfeng
• Ph.D. 2015 at City University of Hong Kong
• Website: [Link]
• Research interests: computer vision, computer
graphics, generative models, image processing
Pipeline of Automatic Content Creation
Facial Editing Image Composition 3D Special Effects
Preprocessing -- Content Understanding
Downstream Applications – Content Creation
Shengfeng He | Associate Professor @ SMU | [Link] 3
Generative Understanding
Alpha Matting
Shengfeng He | Associate Professor @ SMU | [Link] 5
Shengfeng He | Associate Professor @ SMU | [Link] 6
Foreground Matting with Flash/No-flash Image Pairs
Shengfeng He | Associate Professor @ SMU | [Link] 7
Glass Walls Depth Estimation with XPeng (Smart EV company)
Shengfeng He | Associate Professor @ SMU | [Link] 9
Monocular Depth Estimation for Glass Walls with Context: A New Dataset
and Method [TPAMI23]
Shengfeng He | Associate Professor @ SMU | [Link] 10
Universal Restoration of Composite Degradation (ECCV24)
Learning to Remove Any Obstructions Across Distributions (ICML25)
Generative Creativity
Pixel Art
Game
Avatar
LEGO
Shengfeng He | Associate Professor @ SMU | [Link] 17
Shengfeng He | Associate Professor @ SMU | [Link] 20
Video Snapshot: Single Image Motion Expansion via Invertible Motion Embedding
[IEEE TPAMI21]
Video Preview:
1. One thumbnail
2. One short video
Youtube
Our Solution:
1. One thumbnail
Tencent Video
Shengfeng He | Associate Professor @ SMU | [Link] 21
Video Snapshot: Single Image Motion Expansion via Invertible Motion Embedding
[IEEE TPAMI21]
Shengfeng He | Associate Professor @ SMU | [Link] 22
Invertible Generative Prior [CVPR22]
16x16 1024x1024
Shengfeng He | Associate Professor @ SMU | [Link] 24
Invertible NeRF (IEEE TPAMI 2024)
Shengfeng He | Associate Professor @ SMU | [Link] 25
Single-View View Synthesis with Self-Rectified Pseudo-Stereo [IJCV23]
Shengfeng He | Associate Professor @ SMU | [Link] 26
Wide-Angle 3D Photography [ICCV23]
Shengfeng He | Associate Professor @ SMU | [Link] 27
3D-aware Animatable Artforms (IEEE TVCG 2024)
Shengfeng He | Associate Professor @ SMU | [Link] 29
Few-shot NeRF (CVPR 2024)
Shengfeng He | Associate Professor @ SMU | [Link] 30
RIGID: Recurrent GAN Inversion and Editing of Real Face Videos [ICCV23]
Shengfeng He | Associate Professor @ SMU | [Link] 31
Generative Prior for Face Swapping [CVPR22]
Shengfeng He | Associate Professor @ SMU | [Link] 32
Generative Prior for Face Swapping [CVPR22]
Shengfeng He | Associate Professor @ SMU | [Link] 33
Parsing-Conditioned Anime Translation: A New Dataset and Method [ACM TOG23]
Shengfeng He | Associate Professor @ SMU | [Link] 34
Style-Identity Disentangled Anime Characters (IEEE TVCG 2024)
Shengfeng He | Associate Professor @ SMU | [Link] 35
Shengfeng He | Associate Professor @ SMU | [Link] 36
Reference-based Sketch Extraction (TVCG25 & ICCV25)
Universal Virtual Try-On (ICCV25)
Identity-preserved Customization (AAAI25 & IJCV25)
Shengfeng He | Associate Professor @ SMU | [Link] 39
Safeguarding Artistic and Personal Visual Data from Generative AI
Shengfeng He | Associate Professor @ SMU | [Link] 40
Safeguarding Artistic and Personal Visual Data from Generative AI
Original Guarded Mimicked
Shengfeng He | Associate Professor @ SMU | [Link] 41
Deepshield
IPGov
Shengfeng He | Associate Professor @ SMU | [Link] 44