Chen-Hsuan Lin
I am a 4th-year Ph.D. student in the Robotics Institute at Carnegie Mellon University, working with Prof. Simon Lucey on computer vision & artificial intelligence research. Before that, I received my M.S. in Robotics from CMU and B.S. in Electrical Engineering from National Taiwan University.
I am interested in solving 3D reconstruction problems using self-supervised learning techniques. My long-term research goal is to automate geometric factorization and reconstruction of the 3D world from image/video data, in turn to improve learning efficiency in visual recognition systems. My research has been supported by the NVIDIA Graduate Fellowship.
I have been fortunate to collaborate during internships with Kaiming He, Georgia Gkioxari, and Justin Johnson at Facebook AI Research, as well as Oliver Wang, Eli Shechtman, Bryan Russell, Vladimir Kim, Matthew Fisher, and Ersin Yumer at Adobe Research.

Research

SDF-SRN: Learning Signed Distance 3D Object Reconstruction from Static Images
Advances in Neural Information Processing Systems (NeurIPS), 2020

title={SDF-SRN: Learning Signed Distance 3D Object Reconstruction from Static Images},
author={Lin, Chen-Hsuan and Wang, Chaoyang and Lucey, Simon},
booktitle={Advances in Neural Information Processing Systems ({NeurIPS})},
year={2020}
}



Deep NRSfM++: Towards Unsupervised 2D-3D Lifting in the Wild
IEEE International Conference on 3D Vision (3DV), 2020 (oral presentation)

title={Deep NRSfM++: Towards Unsupervised 2D-3D Lifting in the Wild},
author={Wang, Chaoyang and Lin, Chen-Hsuan and Lucey, Simon},
booktitle={IEEE International Conference on 3D Vision ({3DV})},
year={2020}
}



Photometric Mesh Optimization for Video-Aligned 3D Object Reconstruction
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019

title={Photometric Mesh Optimization for Video-Aligned 3D Object Reconstruction},
author={Lin, Chen-Hsuan and Wang, Oliver and Russell, Bryan C and Shechtman, Eli and Kim, Vladimir G and Fisher, Matthew and Lucey, Simon},
booktitle={IEEE Conference on Computer Vision and Pattern Recognition ({CVPR})},
year={2019}
}



ST-GAN: Spatial Transformer Generative Adversarial Networks for Image Compositing
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018

title={ST-GAN: Spatial Transformer Generative Adversarial Networks for Image Compositing},
author={Lin, Chen-Hsuan and Yumer, Ersin and Wang, Oliver and Shechtman, Eli and Lucey, Simon},
booktitle={IEEE Conference on Computer Vision and Pattern Recognition ({CVPR})},
year={2018}
}



Deep-LK for Efficient Adaptive Object Tracking
IEEE International Conference on Robotics and Automation (ICRA), 2018

title={Deep-LK for Efficient Adaptive Object Tracking},
author={Wang, Chaoyang and Galoogahi, Hamed Kiani and Lin, Chen-Hsuan and Lucey, Simon},
booktitle={IEEE International Conference on Robotics and Automation ({ICRA})},
year={2018}
}



Learning Efficient Point Cloud Generation for Dense 3D Object Reconstruction
AAAI Conference on Artificial Intelligence (AAAI), 2018 (oral presentation)

title={Learning Efficient Point Cloud Generation for Dense 3D Object Reconstruction},
author={Lin, Chen-Hsuan and Kong, Chen and Lucey, Simon},
booktitle={AAAI Conference on Artificial Intelligence ({AAAI})},
year={2018}
}



Object-Centric Photometric Bundle Adjustment with Deep Shape Prior
IEEE Winter Conference on Applications of Computer Vision (WACV), 2018

title={Object-Centric Photometric Bundle Adjustment with Deep Shape Prior},
author={Zhu, Rui and Wang, Chaoyang and Lin, Chen-Hsuan and Wang, Ziyan and Lucey, Simon},
booktitle={IEEE Winter Conference on Applications of Computer Vision ({WACV})},
year={2018}
}



Inverse Compositional Spatial Transformer Networks
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017 (oral presentation)

title={Inverse Compositional Spatial Transformer Networks},
author={Lin, Chen-Hsuan and Lucey, Simon},
booktitle={IEEE Conference on Computer Vision and Pattern Recognition ({CVPR})},
year={2017}
}



Using Locally Corresponding CAD Models for Dense 3D Reconstructions from a Single Image
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017

title={Using Locally Corresponding CAD Models for Dense 3D Reconstructions from a Single Image},
author={Kong, Chen and Lin, Chen-Hsuan and Lucey, Simon},
booktitle={IEEE Conference on Computer Vision and Pattern Recognition ({CVPR})},
year={2017}
}



The Conditional Lucas & Kanade Algorithm
European Conference on Computer Vision (ECCV), 2016

title={The Conditional Lucas \& Kanade Algorithm},
author={Lin, Chen-Hsuan and Zhu, Rui and Lucey, Simon},
booktitle={European Conference on Computer Vision (ECCV)},
pages={793--808},
year={2016},
organization={Springer International Publishing}
}


Teaching

Teaching Assistant / Graduate Student Instructor (with Prof. Abhinav Gupta)
(Lectures: 3D Vision & 3D Reasoning and Semantic Segmentation & Pixel Labeling)

Head Teaching Assistant (with Prof. Srinivasa Narasimhan, Prof. Simon Lucey, Prof. Yaser Sheikh)

Academic Projects
Towards a More Curious Agent
CMU 10-703 Deep Reinforcement Learning & Control


Disentangler Networks with Absolute and Relative Attributes
CMU 16-824 Visual Learning & Recognition


3D Facial Model Fitting from 2D Videos
CMU CI2CV Lab



Video Summarization via Convolutional Neural Networks
CMU 10-701 Machine Learning



Perceptual Rate-Distortion Optimization of Motion Estimation
NTU Multimedia Processing & Communications Lab


Virtual Piano Keyboard System
NTU Digital Circuit Design Lab



©
designed by Chen-Hsuan Lin.