Zhengxiao Du

Zhengxiao Du

PhD Student

Tsinghua University

Biography

I am a PhD student in the Department of Computer Science and Technology at Tsinghua University. I am also a member of the Knowledge Engineering Group, advised by Prof. Jie Tang.

My research interest lies in the application of machine learning algorithms to real-world systems, including information retrieval [ECML/PKDD'18,KDD'19,TKDE,SIGIR'19], knowledge graphs [TKDE], and pretrained language models[ACL'21,ACL'21]. Generally, I am also interested in the algorithms for machine learning and reinforcement learning.

In my spare time, I like to read science fiction novels and history books, especially the history of Ancient Rome and Three Kingdoms Period in China.

Interests
  • Data Mining
  • Recommender System
  • Knowledge Graph
Education

  • PhD in Computer Science, 2020 - Now

    Tsinghua University

  • B.E. in Computer Science, 2016 - 2020

    Tsinghua University

Recent News

[04/08/22] We release GLM-130B, an open bilingual (English & Chinese) bidirectional dense model with 130 billion parameters, pre-trained using the General Language Model (GLM) algorithm.

[24/02/22] Our paper GLM: General Language Model Pretraining with Autoregressive Blank Infilling is accepted at ACL 2022.

Publications

Aohan Zeng, Xiao Liu, Zhengxiao Du, Zihan Wang, Hanyu Lai, Ming Ding, Zhuoyi Yang, Yifan Xu, Wendi Zheng, Xiao Xia, Weng Lam Tam, Zixuan Ma, Yufei Xue, Jidong Zhai, Wenguang Chen, Peng Zhang, Yuxiao Dong, Jie Tang (2022). GLM-130B: An Open Bilingual Pre-Trained Model. Under review.

Code Preprint

Zhengxiao Du, Yujie Qian, Xiao Liu, Ming Ding, Jiezhong Qiu, Zhilin Yang, Jie Tang (2022). GLM: General Language Model Pretraining with Autoregressive Blank Infilling. ACL 2022.

Code Preprint Paper

Xiao Liu, Kaixuan Ji, Yicheng Fu, Weng Lam Tam, Zhengxiao Du, Zhilin Yang, Jie Tang (2022). P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks. ACL 2022.

Code Preprint Paper

Zhengxiao Du, Chang Zhou, Jiangchao Yao, Ming Ding, Hongxia Yang, Jie Tang (2021). CogKR: Cognitive Graph for Multi-hop Knowledge Reasoning. IEEE Transactions on Knowledge and Data Engineering, TKDE (accepted).

Code Preprint Paper

Himank Yadav, Zhengxiao Du, Thorsten Joachims (2021). Policy-Gradient Training of Fair and Unbiased Ranking Functions. 44th International ACM SIGIR Conference on Research and Development in Information RetrievalJuly 2021, SIGIR 2021.

Code Preprint Paper

See all publications

Experience

 
 
 
 
 
Research Intern
DAMO Academy, Alibaba Group
Jun 2020 – Present Beijing
Advised by Hongxia Yang
 
 
 
 
 
Research Intern
Cornell University
Jun 2019 – Oct 2019 Ithaca, NY
Advised by Professor Thorsten Joachims
 
 
 
 
 
Research Assistant
Knowledge Engineering Group, Tsinghua University
Jun 2017 – Jun 2019 Beijing
Advised by Professor Jie Tang

Honors

Tsinghua Excellent (Bachelor) Graduate
Tsinghua University Jun 2020
Top 2% of all the graduates
The Cai Xiong Scholarship
Tsinghua University Oct 2019
Top 1%, awarded for outstanding research experience
Elite Collegiate Award
China Computer Federation Oct 2019
73 winners nationwide, only 4 in Tsinghua University

Contact