Jiayuan Gu

I am currently a fifth-year Ph.D. student in Computer Science & Engineering (CSE) at UC San Diego, advised by Prof. Hao Su. I have received my Bachelor degree at the Peking University, advised by Prof. Liwei Wang.

Email / Google Scholar / Github

News

^New [2023.1] Two papers are accepted to ICLR 2023.

[2022.8] ManiSkill 2022 Challenge is open!

[2022.6] I give a talk at the CVPR 2022 tutorial Building and Working in Environments for Embodied AI.

[2022.4] I co-organize the first VOLI workshop at ECCV 2022.

[2020.9] Two papers are accepted to NeurIPS 2020.

[2020.7] Two papers (spotlight) are accepted to ECCV 2020.

[2019.01.12] Codes for Multi-view PointNet for 3D Scene Understanding are released.

Research

An Open-source Recipe for Building Simulated Robot Manipulation Benchmarks

Jiayuan Gu, Linghao Chen, Zhiwei Jia, Fanbo Xiang, Hao Su

ICRA 2023 COMPARE workshop

pdf

ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skills

Jiayuan Gu, Fanbo Xiang, et.al.

ICLR 2023

Challenge website / code / paper

Multi-skill Mobile Manipulation for Object Rearrangement

Jiayuan Gu, Devendra Singh Chaplot, Hao Su, Jitendra Malik

ICLR 2023 (spotlight)

project website / code / arxiv

Rank 1st in Habitat Rearrangement Challenge 2022

Compositionally Generalizable 3D Structure Prediction

Songfang Han, Jiayuan Gu, Kaichun Mo, Li Yi, Siyu Hu, Xuejin Chen, Hao Su

Preprint

code / arXiv

Refactoring Policy for Compositional Generalizability using Self-Supervised Object Proposals

Tongzhou Mu*, Jiayuan Gu*, Zhiwei Jia, Hao Tang, Hao Su

NeurIPS 2020

project website / code / arXiv

Towards Scale-Invariant Graph-related Problem Solving by Iterative Homogeneous Graph Neural Networks

Hao Tang, Zhiao Huang, Jiayuan Gu, Bao-Liang Lu, Hao Su

NeurIPS 2020

code / arXiv

Weakly-supervised 3D Shape Completion in the Wild

Jiayuan Gu, Wei-Chiu Ma, Sivabalan Manivasagam, Wenyuan Zeng, Zihao Wang, Yuwen Xiong, Hao Su, Raquel Urtasun

ECCV 2020 (Spotlight)

arXiv

Deep Feedback Inverse Problem Solver

Wei-Chiu Ma, Shenlong Wang, Jiayuan Gu, Sivabalan Manivasagam, Antonio Torralba, Raquel Urtasun

ECCV 2020 (Spotlight)

arXiv

Multi-view PointNet for 3D Scene Understanding

Maximilian Jaritz, Jiayuan Gu, Hao Su

ICCVW 2019 (Geometry Meets Deep Learning Workshop)

code / arXiv

To What Extent Do Different Neural Networks Learn the Same Representation: A Neuron Activation Subspace Match Approach

Liwei Wang, Lunjia Hu, Jiayuan Gu, Zhiqiang Hu, Yue Wu, Kun He, John Hopcroft

NeurIPS 2019 (Spotlight)

code

Learning Region Features for Object Detection

Jiayuan Gu, Han Hu, Liwei Wang, Yichen Wei, and Jifeng Dai

ECCV 2018

arXiv

Relation Networks for Object Detection

Han Hu, Jiayuan Gu, Zheng Zhang, Jifeng Dai, and Yichen Wei

CVPR 2018 (Oral)

code / arXiv

Services

Conference reviewer: CVPR (2019-2023), ICCV (2019, 2021), ECCV (2020), NeurIPS (2020-2022), ICML (2021), ICLR (2022), AAAI (2021), ICRA (2022)

Journal reviewer: PAMI, IJCV