LI Yikang's Homepage

Research Scientist, Shanghai AI Lab & Deputy Director of R&D, Sensetime Group.
Room 3719, Level 37, 701 Yunjin Road, Xuhui District, Shanghai, China
liyikang [at] pjlab.org.cn, liyikang [at] senseauto.com
Google scholar | Github || Weibo | Wechat | LinkedIn || Resume | 中文简历

I’m currently a research scientist & PI at Shanghai AI Laboratory and Deputy Director of R&D at Sensetime Technology Ltd.. I am leading a research team containg over 20 talented researchers & interns at Shanghai AI Lab, aiming at designing an automated data pipeline to enhance the data-driven Autonomous Driving development. Additionally, I also lead a R&D team containing over 30 talented engineers at Sensetime, developing the RoboX Autonomous Products.

I obtained my Ph.D. from The Chinese University of Hong Kong in May, 2020 supervised by Prof. Xiaogang Wang and Prof. Xiaoou Tang. I got my bachelor’s degrees of Electronic Engineering and Economics in Tsinghua University in 2016. I worked as an research intern at Microsoft Research Asia (MSRA) and Facebook Reality Labs (Now Meta Reality Labs) during my Ph.D. years.

Research interest: 3D Scene Reconstruction, 3D Scene Perception, Behavior & Scene Simulation, any Autonomous-Driving-related topic.

***Important*** Our team is searching for highly self-motivated interns / full-time employees / post-docs . If you are interested in solving the industrial problem in an academic way, do not hesitate to contact me.

News

May 27, 2022	Our Calibration Toolbox for Autonomous Driving, OpenCalib (Code and Paper), is now released. NEW!
Mar 22, 2022	The group standard for RoboBus led by us is released. 《自动驾驶小型客车总体技术要求》
Mar 2, 2022	Two papers are accepted by CVPR-2022, poster * 1 and oral * 1.
Feb 6, 2022	Our survey paper on multi-modal sensor fusion for autonomous driving perception is now on Arxiv.
Jan 29, 2022	An all-in-one and ready-to-use LiDAR-inertial odometry system for Livox LiDAR is released. [Code]
Jan 29, 2022	Beta Testing for Data Compliance Guide (《数据合规自查表》/ 《数据合规指南》) is now open to [apply].

Selected publications

Conferences

CVPR
Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation

Yuenan Hou, Xinge Zhu, Yuexin Ma, Chen Change Loy, and Yikang Li^#

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022

arXiv Bib PDF Code
@inproceedings{li2022lidarsegkd, title = {Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation}, author = {Hou, Yuenan and Zhu, Xinge and Ma, Yuexin and Loy, Chen Change and Li, Yikang}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, year = {2022}, bibtex_show = {true}, abbr = {CVPR}, selected = {true}, corr = {true}, arxiv = {https://arxiv.org/abs/2206.02099}, pdf = {https://arxiv.org/pdf/2206.02099}, code = {https://github.com/cardwing/Codes-for-PVKD} }
NeurIPS
Pastegan: A Semi-parametric Method to Generate Image from Scene Graph

Yikang Li , Tao Ma, Yeqi Bai, Nan Duan, Sining Wei, and Xiaogang Wang

Advances in Neural Information Processing Systems (NeurIPS) 2019

arXiv Bib PDF Code Poster
@inproceedings{li2019pastegan, title = {Pastegan: A Semi-parametric Method to Generate Image from Scene Graph}, author = {Li, Yikang and Ma, Tao and Bai, Yeqi and Duan, Nan and Wei, Sining and Wang, Xiaogang}, booktitle = {Advances in Neural Information Processing Systems (NeurIPS)}, volume = {32}, year = {2019}, bibtex_show = {true}, abbr = {NeurIPS}, arxiv = {https://arxiv.org/abs/1709.07192}, pdf = {https://proceedings.neurips.cc/paper/2019/file/12b1e42dc0746f22cf361267de07073f-Paper.pdf}, poster = {assets/files/publications/nips19_pastegan_poster.pdf}, code = {https://github.com/yikang-li/PasteGAN}, selected = {true} }
ECCV
Factorizable Net: an Efficient Subgraph-based Framework for Scene Graph Generation

Yikang Li , Wanli Ouyang, Bolei Zhou, Jianping Shi, Chao Zhang, and Xiaogang Wang

Proceedings of the European Conference on Computer Vision (ECCV) 2018

arXiv Bib PDF Code Poster
@inproceedings{li2018fnet, title = {Factorizable Net: an Efficient Subgraph-based Framework for Scene Graph Generation}, author = {Li, Yikang and Ouyang, Wanli and Zhou, Bolei and Shi, Jianping and Zhang, Chao and Wang, Xiaogang}, booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)}, pages = {335--351}, year = {2018}, bibtex_show = {true}, abbr = {ECCV}, arxiv = {https://arxiv.org/abs/1806.11538}, pdf = {assets/files/publications/eccv18_fnet.pdf}, poster = {assets/files/publications/eccv18_fnet_poster.pdf}, code = {https://github.com/yikang-li/FactorizableNet}, selected = {true} }
CVPR
Visual Question Generation as Dual Task of Visual Question Answering

Yikang Li , Nan Duan, Bolei Zhou, Xiao Chu, Wanli Ouyang, Xiaogang Wang, and Ming Zhou

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2018

arXiv Bib PDF Code Poster
@inproceedings{li2018iqan, title = {Visual Question Generation as Dual Task of Visual Question Answering}, author = {Li, Yikang and Duan, Nan and Zhou, Bolei and Chu, Xiao and Ouyang, Wanli and Wang, Xiaogang and Zhou, Ming}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, pages = {6116--6124}, year = {2018}, bibtex_show = {true}, abbr = {CVPR}, arxiv = {https://arxiv.org/abs/1709.07192}, pdf = {assets/files/publications/cvpr18_iqan.pdf}, poster = {assets/files/publications/cvpr18_iqan_poster.pdf}, code = {https://github.com/yikang-li/iQAN}, selected = {true} }
ICCV
Scene Graph Generation from Objects, Phrases and Region Captions

Yikang Li , Wanli Ouyang, Bolei Zhou, Kun Wang, and Xiaogang Wang

Proceedings of the IEEE International Conference on Computer Vision (ICCV) 2017

arXiv Bib PDF Code Poster
@inproceedings{li2017scene, title = {Scene Graph Generation from Objects, Phrases and Region Captions}, author = {Li, Yikang and Ouyang, Wanli and Zhou, Bolei and Wang, Kun and Wang, Xiaogang}, booktitle = {Proceedings of the IEEE International Conference on Computer Vision (ICCV)}, pages = {1261--1270}, year = {2017}, bibtex_show = {true}, abbr = {ICCV}, arxiv = {https://arxiv.org/abs/1707.09700}, pdf = {assets/files/publications/iccv17_msdn.pdf}, poster = {assets/files/publications/iccv17_msdn_poster.pdf}, code = {https://github.com/yikang-li/MSDN}, selected = {true} }

CVPR

ViP-CNN: Visual Phrase Guided Convolutional Neural Network

Yikang Li , Wanli Ouyang, and Xiaogang Wang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2017

arXiv Bib PDF Poster

@inproceedings{li2017vip,
  title = {ViP-CNN: Visual Phrase Guided Convolutional Neural Network},
  author = {Li, Yikang and Ouyang, Wanli and Wang, Xiaogang},
  booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  pages = {1347--1356},
  year = {2017},
  bibtex_show = {true},
  abbr = {CVPR},
  arxiv = {https://arxiv.org/abs/1702.07191},
  pdf = {assets/files/publications/cvpr17_vip_cnn.pdf},
  poster = {assets/files/publications/cvpr17_vip_cnn_poster.pdf},
  selected = {true}
}

Preprints

Arxiv
OpenCalib: A Multi-sensor Calibration Toolbox for Autonomous Driving

Guohang Yan, Zhuochun Liu, Chengjie Wang, Chunlei Shi, Pengjin Wei, Xinyu Cai, Tao Ma, Zhizheng Liu, Zebin Zhong, Yuqian Liu, Ming Zhao, Zheng Ma, and Yikang Li^#

arXiv preprint arXiv:2205.14087 2022

arXiv Bib PDF Code
@article{opencalib, title = {OpenCalib: A Multi-sensor Calibration Toolbox for Autonomous Driving}, author = {Yan, Guohang and Liu, Zhuochun and Wang, Chengjie and Shi, Chunlei and Wei, Pengjin and Cai, Xinyu and Ma, Tao and Liu, Zhizheng and Zhong, Zebin and Liu, Yuqian and Zhao, Ming and Ma, Zheng and Li, Yikang}, journal = {arXiv preprint arXiv:2205.14087}, year = {2022}, abbr = {Arxiv}, arxiv = {https://arxiv.org/abs/2205.14087}, pdf = {https://arxiv.org/pdf/2205.14087}, bibtex_show = {true}, corr = {true}, selected = {true}, code = {https://github.com/PJLab-ADG/SensorsCalibration} }
Arxiv
Joint Camera Intrinsic and LiDAR-Camera Extrinsic Calibration

Guohang Yan, Feiyu He, Chunlei Shi, Xinyu Cai, and Yikang Li^#

arXiv preprint arXiv:2202.13708 2022

arXiv Bib PDF Code
@article{yan2022joint, title = {Joint Camera Intrinsic and LiDAR-Camera Extrinsic Calibration}, author = {Yan, Guohang and He, Feiyu and Shi, Chunlei and Cai, Xinyu and Li, Yikang}, journal = {arXiv preprint arXiv:2202.13708}, year = {2022}, abbr = {Arxiv}, arxiv = {https://arxiv.org/abs/2202.13708}, pdf = {https://arxiv.org/pdf/2202.13708}, bibtex_show = {true}, corr = {true}, selected = {true}, code = {https://github.com/OpenCalib/JointCalib} }
Arxiv
Multi-modal Sensor Fusion for Auto Driving Perception: A Survey

Keli Huang, Botian Shi, Xiang Li, Xin Li, Siyuan Huang, and Yikang Li^#

arXiv preprint arXiv:2202.02703 2022

arXiv Bib PDF
@article{huang2022multi, title = {Multi-modal Sensor Fusion for Auto Driving Perception: A Survey}, author = {Huang, Keli and Shi, Botian and Li, Xiang and Li, Xin and Huang, Siyuan and Li, Yikang}, journal = {arXiv preprint arXiv:2202.02703}, year = {2022}, abbr = {Arxiv}, arxiv = {https://arxiv.org/abs/2202.02703}, pdf = {https://arxiv.org/pdf/2202.02703}, bibtex_show = {true}, corr = {true}, selected = {true} }
Arxiv
Perception Entropy: A Metric for Multiple Sensors Configuration Evaluation and Design

Tao Ma, Zhizheng Liu, and Yikang Li^#

arXiv preprint arXiv:2104.06615 2021

arXiv Bib PDF
@article{ma2021pe, title = {Perception Entropy: A Metric for Multiple Sensors Configuration Evaluation and Design}, author = {Ma, Tao and Liu, Zhizheng and Li, Yikang}, journal = {arXiv preprint arXiv:2104.06615}, year = {2021}, abbr = {Arxiv}, arxiv = {https://arxiv.org/abs/2104.06615}, pdf = {https://arxiv.org/pdf/2104.06615}, bibtex_show = {true}, corr = {true}, selected = {true} }
Arxiv
CRLF: Automatic Calibration and Refinement based on Line Feature for LiDAR and Camera in Road Scenes

Tao Ma, Zhizheng Liu, Guohang Yan, and Yikang Li^#

arXiv preprint arXiv:2103.04558 2021

arXiv Bib PDF Code
@article{ma2021crlf, title = {CRLF: Automatic Calibration and Refinement based on Line Feature for LiDAR and Camera in Road Scenes}, author = {Ma, Tao and Liu, Zhizheng and Yan, Guohang and Li, Yikang}, journal = {arXiv preprint arXiv:2103.04558}, year = {2021}, abbr = {Arxiv}, arxiv = {https://arxiv.org/abs/2103.04558}, pdf = {https://arxiv.org/pdf/2103.04558}, code = {https://github.com/PJLab-ADG/SensorsCalibration}, bibtex_show = {true}, corr = {true}, selected = {true} }