Yake Wei (卫雅珂)

I am a first year PhD student at Gaoling School of Artificial Intelligence, Renmin University of China. I am advised by Prof. Di Hu. Now my research interests focus on multi-modal learning.

I received my bachelor's degree in Computer Science and Technology from University of Electronic Science and Technology of China in 2021.

Email  /  Github

profile photo

[2022-08] We wrote an article about recent advances in audio-visual learning! [website]

[2022-05] Gave a talk @ 2022 BAAI Conference . Please find slides here!

[2022-03] Two papers accepted by CVPR 2022, thanks to all co-authors!

[2021-12] One paper accepted by TPAMI, thanks to all co-authors!

[2021-06] Graduate from University of Electronic Science and Technology of China!


Reviewer: CVPR 2022, ECCV 2022

clean-usnob Learning in Audio-visual Context: A Review, Analysis, and New Perspective

Yake Wei, Di Hu, Yapeng Tian, Xuelong Li

Under review
arXiv / website / awesome list

A systematical survey about the audio-visual learning field.

Publications(* equal contribution)
clean-usnob Balanced Multimodal Learning via On-the-fly Gradient Modulation

Xiaokang Peng*, Yake Wei*, Andong Deng, Dong Wang, Di Hu

CVPR, 2022   (Oral Presentation)
arXiv / code

Alleviate optimization imbalance in multi-modal learning via on-the-fly gradient modulation.

clean-usnob Learning to Answer Questions in Dynamic Audio-Visual Scenarios

Guangyao Li*, Yake Wei*, Yapeng Tian*, Chenliang Xu, Ji-Rong Wen, Di Hu

CVPR, 2022   (Oral Presentation)
arXiv / project page

Audio-Visual Question Answering and propose MUSIC-AVQA dataset.

clean-usnob Class-aware Sounding Objects Localization via Audiovisual Correspondence

Di Hu, Yake Wei, Rui Qian, Weiyao Lin, Ruihua Song, Ji-Rong Wen

arXiv / project page

Discriminative sounding objects localization.

Updated at August. 2022
Thanks Jon Barron for this amazing template.