Tianyu Yang

I am a Research Scientist at Alibaba DAMO Academy. Prior to that, I worked at IDEA and Tencent AI Lab. I received my PhD from City University of Hong Kong, advised by Prof. Antoni B. Chan. My research interests span multiple areas, including generative models, multimodal learning, self-supervised learning, and video understanding. Lately, my primary focus has been on generative AI, particularly in the areas of video and 3D content generation and manipulation.

Email  /  Google Scholar /  Github

profile photo
Research
Compressed3D: a Compressed Latent Space for 3D Generation from a Single Image
Bowen Zhang, Tianyu Yang, Yu Li, Lei Zhang, Xi Zhao
European Conference on Computer Vision (ECCV), 2024
arXiv  /  project
OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Models
Zhe Kong, Yong Zhang, Tianyu Yang, Tao Wang, Kaihao Zhang, Bizhu Wu, Guanying Chen, Wei Liu, Wenhan Luo
European Conference on Computer Vision (ECCV), 2024
arXiv  /  project
AddMe: Zero-shot Group-photo Synthesis by Inserting People into Scenes
Dongxu Yue, Maomao Li, Yunfei Liu, Ailing Zeng, Tianyu Yang, Qin Guo, Yu Li
European Conference on Computer Vision (ECCV), 2024
arXiv  /  project
A Video is Worth 256 bases: Spatial-Temporal Expectation-Maximization Inversion for Zero-Shot Video Editing
Maomao Li, Yu Li, Tianyu Yang, Yunfei Liu, Dongxu Yue, Zhihui Lin, Dong Xu,
Conference on Computer Vision and Pattern Recognition (CVPR), 2024
arXiv  /  project
Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts
Xinhua Cheng, Tianyu Yang, Jianan Wang, Yu Li, Lei Zhang, Jian Zhang, Li Yuan
International Conference on Learning Representations (ICLR), 2024
arXiv  /  project
Symbol as Points: Panoptic Symbol Spotting via Point-based Representation
Wenlong Liu, Tianyu Yang, Yuhan Wang, Qizhi Yu, Lei Zhang
International Conference on Learning Representations (ICLR), 2024
arXiv  /  code
GPAvatar: Generalizable and Precise Head Avatar from Image(s)
Xuangeng Chu, Yu Li, Ailing Zeng, Tianyu Yang, Lijian Lin, Yunfei Liu, Tatsuya Harada
International Conference on Learning Representations (ICLR), 2024
arXiv  /  code
TOSS: High-quality Text-guided Novel View Synthesis from a Single Image
Yukai Shi, Jianan Wang, He Cao, Boshi Tang, Xianbiao Qi, Tianyu Yang, Yukun Huang, Shilong Liu, Lei Zhang, Heung-Yeung Shum
International Conference on Learning Representations (ICLR), 2024
arXiv  /  project
Consistent123: Improve Consistency for One Image to 3D Object Synthesis
Haohan Weng, Tianyu Yang, Jianan Wang, Yu Li, Tong Zhang, C.L.Philip Chen, Lei Zhang
arXiv, 2023
arXiv  /  project
Latent Video Diffusion Models for High-Fidelity Long Video Generation
Yingqing He, Tianyu Yang, Yong Zhang, Ying Shan, Qifeng Chen
arXiv, 2023
arXiv  /  project
Scalable Video Object Segmentation with Simplified Framework
Qiangqiang Wu, Tianyu Yang, Wei Wu, Antoni B. Chan
International Conference on Computer Vision (ICCV), 2023
arXiv  /  code
DropMAE: Masked Autoencoders with Spatial-Attention Dropout for Tracking Tasks
Qiangqiang Wu, Tianyu Yang, Ziquan Liu, Baoyuan Wu, Ying Shan, Antoni B. Chan
Conference on Computer Vision and Pattern Recognition (CVPR), 2023
arXiv  /  code
LocVTP: Video-Text Pre-training for Temporal Localization
Meng Cao, Tianyu Yang, Junwu Weng, Can Zhang, Jue Wang and Yuexian Zou
European Conference on Computer Vision (ECCV), 2022
arXiv  /  code  /  supp
Unsupervised Pre-training for Temporal Action Localization Tasks
Can Zhang, Tianyu Yang, Junwu Weng, Meng Cao, Jue Wang and Yuexian Zou
Conference on Computer Vision and Pattern Recognition (CVPR), 2022
arXiv  /  code  /  supp
Exploring Denoised Cross-video Contrast for Weakly-supervised Temporal Action Localization
Jingjing Li, Tianyu Yang, Wei Ji, Jue Wang and Li Cheng
Conference on Computer Vision and Pattern Recognition (CVPR), 2022
arXiv  /  code
SWEM: Towards Real-Time Video Object Segmentation with Sequential Weighted Expectation-Maximization
Zhihui Lin, Tianyu Yang, Maomao Li, Ziyu Wang, Chun Yuan, Wenhao Jiang, Wei Liu
Conference on Computer Vision and Pattern Recognition (CVPR), 2022
arXiv  /  code  /  supp
Motion-aware Contrastive Video Representation Learning via Foreground-background Merging
Shuangrui Ding, Maomao Li, Tianyu Yang, Rui Qian, Haohang Xu, Qingyi Chen, Jue Wang and Hongkai Xiong
Conference on Computer Vision and Pattern Recognition (CVPR), 2022
arXiv  /  code  /  supp
VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examples
Tian Pan, Yibing Song, Tianyu Yang, Wenhao Jiang, and Wei Liu
Conference on Computer Vision and Pattern Recognition (CVPR), 2021
arXiv  /  code
ROAM: Recurrently Optimizing Tracking Model
Tianyu Yang, Pengfei Xu, Runbo Hu, Hua Chai, and Antoni B. Chan
Conference on Computer Vision and Pattern Recognition (CVPR), 2020
code  /  otb100-results  /  lasot-results
Visual Tracking via Dynamic Memory Networks
Tianyu Yang, Antoni B. Chan
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2019
code  /  otb100-results  /  vot2015-results  /  vot2016-results  /  vot2017-results
Learning Dynamic Memory Networks for Object Tracking
Tianyu Yang, Antoni B. Chan
European Conference on Computer Vision (ECCV), 2018
code  /  otb100-results  /  vot2016-results
Density-Preserving Hierarchical EM Algorithm: Simplifying Gaussian Mixture Models for Approximate Inference
Lei Yu, Tianyu Yang, Antoni B. Chan
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2018
Recurrent Filter Learning for Visual Tracking
Tianyu Yang, Antoni B. Chan
Workshop on Visual Object Tracking (VOT) Chanllenge, ICCV, 2017
code  /  otb100-results  /  vot2016-results
Approximate Inference for Generic Likelihoods via Density-Preserving GMM Simplification
Lei Yu, Tianyu Yang, Antoni B. Chan
Workshop on Advances in Approximate Bayesian Inference, NeurIPS, 2016
Robust Object Tracking With Reacquisition Ability Using Online Learned Detector
Tianyu Yang, Baopu Li, Max Q.-H. Meng
IEEE transactions on Cybernetics , 2014
Adaptive Visual Tracking with Reacquisition Ability for Arbitrary Objects
Tianyu Yang, Baopu Li, Chao Hu, Max Q.-H. Meng
International Conference on Robotics and Automation (ICRA) , 2013
Service

Senior Program Committee Member for AAAI 2022


Conference Reviewer for CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, AAAI


Journal Reviewer for TPAMI, IJCV, TIP


Template borrowed from Jon Barron