[FullCV.pdf]

 

Professional Activities

Projects

Principle Investigator:
Joint Research on Computer Vision and Perception for Autonomous Driving with Zongmu. Deep Learning and Traditional Computer Vision Based Algorithms for ADAS: including Semantic Segmentation, Multi-task Detection, Underground SLAM, Panoramic Image Stiching and etc.

 

Teaching

2018 Computer Vision (ANU, ENGN4528,ENGN6528)
2018 Advanced Research Project (ANU, COMP8800)
2018 Individual Project (ANU, ENGN4200)
2017 Robotics (ANU, ENGN4627)
2017 Data Analysis (ANU, ENG8735)
2017 Advanced Research Project (ANU, COMP8800)
2017 Individual Project (ANU, ENGN4200)
2016 Robotics (ANU, ENGN4627)
2016 Document Analysis (ANU, COMP4650)
2016 Individual Project (ANU, ENGN4200)

 

Supervising

Ph.D. students:
   Kaiyue Lu, ANU (primary supervisor)
   Jing Zhang, ANU (primary supervisor)
   Peipei Song, ANU (primary supervisor)
   Junxuan Li, ANU (primary supervisor)
   Changkun Ye, ANU (primary supervisor, pengding visa)
   Hao Zhu, ANU (visiting, with A/Prof. Hongdong Li)
   Ryota Yoshihashi, U Tokyo (with A/Prof. Takeshi Naemura)
   Lu Liu, NUS (with Asst. Prof. Robby T. Tan)
   Xiang Wang, Tsinghua (co-supervising with A/Prof. Huimin Ma )
   Yidong Wang, Tsinghua  (with A/Prof. Huimin Ma)
   
Research Master:
   Ziang Cheng, ANU
   Kenta Moriwaki, U Tokyo (with Asst. Prof. Rei Kawakami)

- Honour
   Yicong Hong, ANU
   Yuxuan Long, ANU
   Oliver Johnson, ANU
  

- Alumni
   David Feng, PhD, ANU (now at Seeing Machine)
   Xiudong Wang, ANU (visiting, with A/Prof. Hongdong Li)
   Kaiyue Lu, Master, ANU (continue as PhD)
   Junxuan Li, ANU (continue as PhD)
   Chenyao Qian, Master, ANU (now at Meitu)
   Tu Tuan Trinh, Master, U Tokyo
   Zhichen Zhao, Master, Tsinghua
   Xinyi Liu, ANU
   Weixuan Sun, Bachelor with Honor, ANU
   Kunming Li, Bachelor with Honor, ANU
   Zhipeng Bao, ANU (Visiting student from Tsinghua)
   Riku Shigematsu, ANU (Visiting student from U Tokyo)
   Seiichirou Fukuta, Master, U Tokyo

 

Organizing

2018 DICTA General China

2018 ACCV Worshop Chair

2017 ICCV Joint Workshop: Physics Based Vision meets Deep Learning, Venice, Italy. PBDL2017

2016 - present, IEEE Computer Society, ACT Section, Australia.

2014 International Conference on 3D Vision (3DV2014). Tokyo, Japan.

 

Reviewing

IEEE Transaction on Pattern Recognition and Machine Intelligence (TPAMI)
International Journal on Computer Vision (IJCV)
IEEE Transaction on Image Processing (TIP)
ACM SIGGRAPH
Computer Vision and Pattern Recognition (CVPR)
International Computer on Computer Vision (ICCV)
European Conference on Computer Vision (ECCV)

 

Invited Talks

Physic Based Vision meets Deep Learning, International Workshop on Machine Vision Application, Xi’an, June. 2018

Physic Based Vision meets Deep Learning, Nanjing University, Apr. 2018

Physic Based Vision meets Deep Learning, ShanghaiTech University, Apr. 2018

Physic Based Vision meets Deep Learning, Jiangsu University, Apr. 2018

Physic Based Vision meets Deep Learning, Tsinghua University Shenzhen Research Campus, Apr. 2018

Physic Based Vision meets Deep Learning, Harbin Institute of Technology Shenzhen Research Campus, Apr. 2018

Smart Computational Imaging, Nanjing University, Apr. 2017

Smart Computational Imaging, Jiangnan University, Apr. 2017

A Multi-view Light Field Camera from a Single Lens, Microsoft Research Asia, Sep, 2016

Vision in Bad Weather, Peking University, Sep, 2016

Vision in Bad Weather, Nankai University, Sep, 2016

Prosthetic Vision and Artificial Vision, Microsoft Research Asia, Aug, 2016

Vision in Bad Weather, Microsoft Research Asia, Aug, 2016

Vision in Bad Weather, Tsinghua University, Aug, 2016

Vision in Bad Weather, Jiangnan University, Aug. 2016

Adherent Raindrop Detection and Removal in Video. Meeting on Image Recognition and Understanding (MIRU 2013), Japan.

 

 


Experience

2018.1-present

Senior Research Scientist, Data61, CSIRO, Australia (previously known as NICTA)
- Computer vision research group
- Projects: Prosthetic Vision, Digital Archiving, Non-rigid Reconstruction

 

2018.2-present

Senior Adjunct Lecturer, Australian National University
- Teaching in School of Engineering and Computer Science
- Supervising 9 Ph.D. students, 5 master students.

 

2015.9-2018.1

Research Scientist, Data61, CSIRO, Australia (previously known as NICTA)
- Computer vision research group
- Projects: Prosthetic Vision, Digital Archiving, Non-rigid Reconstruction

 

2015.10-2018.1

Adjunct Lecturer, Australian National University
- Teaching in School of Engineering and Computer Science
- Supervising 9 Ph.D. students, 5 master students.

 

2016.1-2017.12

 

Chair of Computer Society, IEEE ACT Section, Australia.

2015.10-present

Adjunct Lecturer, College of Engineering and Computer Science, Australian National University.
- Supervising 5 Ph.D. students, 6 master students.
- Teaching

 

2014.4-2014.10

Internship at Microsoft Development, Shinagawa, Tokyo.
- Topic: Multiview rectification rectification of folded document
- Paper submitted, mobile app prototyped
- Coworkers: Dr. Yasuyuki Matsushita, Dr. Sudipta Sinha.

 

2013.2-2013.3

Visiting Multimedia and Geometry Group, Utrecht University, The Netherlands
- Video enhancement

 

2008.1-2010.3

3D Image System Simulation Lab, Tsinghua University
- Advisor: Assoc. Prof. Huimin Ma
- Topics: 3D object modeling and recognition, manifold learning

 

Education

 

2012.10-2015.9

PhD of Engineering, Computer Vision Lab. The University of Tokyo, Japan.
- Full Scholarship (Mext)
- Overall GPA: 4/4
.
- Advisors: Prof. Katsushi Ikeuchi ,
Assoc. Prof. Takeshi Oishi
- Mentors: Asst. Prof. Robby T. Tan,
Asst. Prof. Rei Kawakami
- Topics: robust outdoor vision, rainy scenes, computational photometry, 3D shape modeling

 

2010.4-2012.9

Master of Engineering, Computer Vision Lab. The University of Tokyo, Japan
- Full Scholarship (Panasonic)
- Overall GPA: 3.93/4

 

2005.8-2009.7

Bachelor of Engineering, Department of Electrical Engineering, Tsinghua University
- Advanced Courses in Math and Physics (sub major)
- Recommend for direct admission (free of entrance exam)
- Overall GPA: 88.4/100 (3.71/4)

 

2002.8-2005.7

Experimental High School Attached to Beijing Normal University
- National Science Class directed by The Ministry of Education of China
- Eligible for enter any university in China without exam

 


Publications

 

2018

Kaiyue Lu, Shaodi You and Nick Barnes, Deep Image Smoothing based on Texture and Structure Guidance. European Conference on Computer Vision 2018, ECCV2018.

 

2018

Xiaofeng Han, Chuong Nyugen, Shaodi You and Jianfei Lu, Single Image Water Hazard Detection using FCN with Reflection Attention Units. European Conference on Computer Vision 2018, ECCV2018.

 

2018

Xiang Wang, Shaodi You, Huimin Ma and Xi Li, Weakly-Supervised Semantic Segmentation by Iteratively Mining Common Object Features, IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2018.

 

2018

Zhixiang Hao, Yu Li, Shaodi You and Feng Lu, Detail Preserving Depth Estimation from a Single Image using Attention Guided Networks. 3D Vision, 2018 (3DV2018).

 

2018

Xiaofeng Han, Jianfeng Lu, Chunxia Zhao, Shaodi You and Hongdong Li, Semi-supervised and Weakly-supervised Road Detection based on Generative Adversarial Networks, IEEE Signal Processing Letters. Volume: 25, Issue:4, pp: 551-555. 2018. Impact factor: 2.5. [pdf]

 

2018

Junxuan Li, Shaodi You, and Antonio Robles-Kelly. A Frequency Domain Neural Network for Fast Image Super-resolution, International Joint Conference on Neural Networks. IJCNN 2018, Oral. [pdf]

 

2018

Hongru Liang, Haozheng Wang, Shaodi You, Jin-Mao Wei, and Zhenglu Yang. JTAV: Jointly Learning Social Media Content Representation by Fusing Textual, Acoustic, and Visual Features. The 27th International Conference on Computational Linguistics (COLING 2018).

 

2017

Yu Li, Shaodi You, Michael Brown and Robby T. Tan, Visibility Enhancement in Scattering Media Survey and Benchmark, Computer Vision and Image Understanding (CVIU), 2017. [pdf]

 

2017

Xiang Wang, Huimin Ma, Shaodi You and Xiaozhi Chen, Edge Preserving and Multi-Scale Contextual Neural Network for Salient Object Detection, IEEE Trans. on Image Processing (TIP). [pdf]

 

2017

Zhichen Zhao, Huimin Ma, Shaodi You, Single Image Action Recognition via Sermantic Part Actions, International Conference on Computer Vision, ICCV 2017. [pdf]

 

2017

Shijie Zhang, Lizhen Qu, Shaodi You, Zhenglu Yang and Jiawan Zhang, Automatic Generation of Grounded Visual Questions, International Joint Conference on Artificial Intelligence, IJCAI 2017. [pdf]

 

2017

Feng Lu, Lei He, Shaodi You, Zhixiang Hao, Identifying Surface BRDF from a Single 4D Light Field Image via Deep Neural Network, IEEE Journal on Selected Topics in Singal Processing, Accepted. [pdf]

 

2017

Diming Zhamg, Fei Xue, Hao Huang and Shaodi You, VBMq: Pursuit Baremetal Perf ormance by Embracing Block I/O Parallelism in Virtualization, Frontier of Computer Science.  Accepted.

 

2017

Kaiyue Lu, Shaodi You, Nick Barnes, Double-Guided Filtering: Image Smoothing with Structure and Texture Guidance, The International Conference on Digital Image Computing: Techniques and Applications, DICTA 2017. Oral [pdf]

 

2017

David Feng, Shaodi You, Nick Barnes, HOSO: Histogram Of Surface Orientation for RGB-D Salient Object Detection. The International Conference on Digital Image Computing: Techniques and Applications, DICTA 2017. Best Paper. [pdf]

 

2017

Junxuan Li, Shaodi You, Antonio Robles-Kelly, Stereo Super-resolution via a Deep Convolutional Network. The International Conference on Digital Image Computing: Techniques and Applications, DICTA 2017. Oral [pdf]

 

2017

Bin Yue, Min Gui, Jiahui Guo, Zhenglu Yang, Jin-Mao Wei and Shaodi You, An Effective Framework for Question Answering over Freebase via Reconstructing Natural Sequences. WWW 2017.

 

2017

Kunming Li, Yu Li, Shaodi You and Nick Barnes, Photo-Realistic Simulation of Road Scene for Data-Driven Methods in Bad Weather, ICCV Workshop on Physics Based Vision meets Deep Learning, 2017. [pdf]

 

2017

Riku Shigematsu, David Feng, Shaodi You and Nick Barnes, Learning RGB-D Salient Object Detection using background enclosure, depth contrast, and top-down features, ICCV Workshop on Mutual Benefit of Cognitive and Computer Vision, 2017. [pdf]

 

2017

David Feng, Shaodi You and Nick Barnes, DSD: Depth Surface Descriptor for Structural Edge Detection, ICCV Workshop on Assistive Computer Vision and Robotics, 2017. [pdf]

 

2017

Changkun Ye, Huimin Ma, Xiaoqin Zhang, Kai Zhang and Shaodi You, Survival-Oriented Reinforcement Learning Model: An Effcient and Robust Deep Reinforcement Learning Algorithm for Autonomous Driving Problem, IAPR International Conference on Image and Graphics, ICIG2017.

 

2016

David Feng, Nick Barnes, Shaodi You and Chris McCarthy. Local Background Enclosure for RGB-D Salient Object Detection. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2016, Spotlight Presentation). [pdf] [webpage]

 

2016

Shaodi You, Think Locally, Fit Globally, Robust and Fast Surface Matching via Algebraic Surface Fitting, Neural Computing, Special Issue on Multimodal Vision, Elsevier 2016. Accepted, DOI 10.1016/j.neucom.2016.06.086. [pdf]

 

2015

Shaodi You, Robby T. Tan, Rei Kawakami, Yasuhiro Mukaigawa and Katsushi Ikeuchi, Adherent Raindrop Modeling, Detection and Removal in Video.
- Accepted for publication in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2015

- [pdf]
[webpage]

 

2015

Shaodi You, Detection and Removal of Raindrop Images in A Video Sequence and Their Applications to Computer Vision Algorithms
- Doctoral Thesis, The University of Tokyo, 2015.
- [pdf]

 

2014

Shaodi You, Robby T. Tan, Rei Kawakami, Yasuhiro Mukaigawa and Katsushi Ikeuchi, Raindrop Detection and Removal from Long Range Trajectory.
- 12th Asian Conference on Computer Vision (ACCV 2014 Oral), Nov. 3-5, 2014, Singapore
- [pdf]
[webpage]

 

2013

Shaodi You, Robby T. Tan, Rei Kawakami and Katsushi Ikeuchi, Adherent Raindrop Detection and Removal in Video.
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2013), June 25-27, 2013, ortland, Oregon, USA
- [pdf] [webpage]

 

2013

Shaodi You, Robby T. Tan, Rei Kawakami and Katsushi Ikeuchi, Robust and Fast Motion Estimation for Video Completion.
- IAPR Machine Vision Applications (MVA 2013 Oral), May 20-23, 2013, Kyoto, Japan
- [pdf]

 

2011

Shaodi You and Huimin Ma, Manifold Topological Multi-Resolution Analysis Method.
- Pattern Recognition, Volume 44, Issue 8, August 2011, Pages 1629¨C1648
- [pdf]

 

2009

Shaodi You and Huimin Ma, Manifold Topological Multi-Resolution Analysis Method based on Spectral Analysis and Local Linearity.
- Bachelor Thesis, Tsinghua University, 2009
- Excellent Thesis Award

 

2009

Xiao Yu, Huimin Ma, Shaodi You and Ze Yuan, A solution for efficient viewpoint space partition in 3D object recognition.
- International Conference on Image and Graphic 2009 (ICIG2009 Oral), Xi'an, China
- [pdf]

 

 

Patents

 

Chinese Patent No. 201710799023.7

Guoxing Ma, Yu Han, Jianing Sun, Yi Zhao, Fengyu Yang, Yueqin Gu and Shaodi You, “An Automatic Surveillance System for Bracket Safety Inspection in Construction Site.

 

Chinese Patent No. 201610279988.9

A System and A Method for Automatic Inspection of Protection Equipment and Operational Capability for Workers' Safety.

 

Chinese Patent No. 201610489505.8

An Automatic System and Methodology for Dust Pollution Monitoring in Construction Site using Image Captured by UAV.

 

 


Awards and Honors

 

2017.9

Digital, National Facilities & Collections Awards 2017
Science Excellence: Vision processing for the Bionic Eye.

 

2017.8

iAWARDS 2017, Research and Development Project of the Year, National Merit Recipient: Vision Processing for Bionic Eye. Australia.

 

2017.5

iAWARDS 2017, Research and Development Project of the Year: Vision Processing for Bionic Eye. Australian Capital Territory. Australian Information Industry Association

 

2017.5

iAWARDS 2017, Consumer Markets:: Vision Processing for Bionic Eye. Australian Capital Territory. Australian Information Industry Association

 

2013.4-2015.9

 

Japanese Government (Monbunkagakusho: MEXT) Scholarship
- University referenced (Rank 1 among applicants)
- Allowance 5,328,000 JPY
- Full tuition fee coverage
- Research funding 3,000,000 JPY

 

2013.4-2015.9

Global Creative Leader, The University of Tokyo
- Research funding 2,200,000 JPY
- Allowance 4,500,000 JPY Granted (3,000,000 JPY withdrawed due to maximum income limit)

 

2013.4-2016.3

SCAT Scholarship
- Allowance 3,600,000 JPY Granted.
- Withdrawed due to maximum income limit

 

2013.4-2014.3

SEUT Doctoral Student Special Incentives Program
- Allowance 1,800,000 JPY Granted.
- Withdrawed due to maximum income limit

 

2010.4-2013.3

 

Panasonic Scholarship
- Allowance 6,120,000 JPY Granted. (900,000 JPY withdrawed due to early graduation)
- Full tuition fee coverage

- Six grants in China per year

 

2009.7

Excellent Thesis Paper, Tsinghua University
- Rank 1 / 90

 

2008.10

Scholarship for Academic Excellence(Class III), Tsinghua University

 

2006.12

Scholarship for Academic Excellence(Class II), Tsinghua University

 

2005.6

Honorable mention in 2004/2005 "First Step to Nobel Prize in Physics", Polish Academy of Science

 

2004.9

First Prize, Chinese Physics Olympic Contest (province-wide)
- Eligibility for direct college addmission without national standard exam.

 

2004.9

Second Prize, Chinese Chemistry Olympic Contest (province -wide)
- Eligibility for direct college addmission without national standard exam.

 

2004.5

First Prize, Chinese Biology Olympic Contest (province-wide)
- Eligibility for direct college addmission without national standard exam.

 

2003.9

Second Prize, Chinese Mathematics Olympic Contest (province-wide)
- Eligibility for direct college addmission without national standard exam.

 


Skills

 

Languages

Chinese(native), English(proficient), Japanese(proficient), French(beginner)

 

Artwork

Comics creations

 

Music

Piano, Erhu(two-stringed Chinese violin)

 


Activities

 

2012.9

 

Volunteer for local rebuilidng after 2011 Japan Earthquake

2015.4-2015.9

Volunteer for disaster relief in Tokyo

 

2010.4-2015.9

Chinese Student and Scholoar Association, The University of Tokyo
- 2011-present Manager of Tennis Circle

 

2005.9-2008.9

Red Cross Society of Tsinghua University
- 2007-2008 Manager of Department of Publicity
- Excellent member award in 2007

 

2005.9-present

Art Society of Tsinghua University
- 2007-2008 Leader of Comic Team

 

 

Artworks