I am a full-time Bachel-Phd Candidate (5th year) in School of Computer Science at Fudan University, advised by Prof. Xipeng Qiu and Prof. Xuanjing Huang. So far, my research has concentrated on representation learning for natural language processing, such as word, phrase, sentence representation.
Specifically, I favor the following research perspectives of representation learning for natural language.

  • Formulating text representation learning models as Interacting Systems
  • Incorporating inductive bias into neural network
  • Learning transferable, disentangled, interpretable representations
I'm on Twitter.

Nov. , 2017

[Collaboration] Currently, I am doing my internship at the Montreal Institute for Learning Algorithms ( MILA ), in Canada.

Mar. 20, 2018

[Award] I got Tencent AI Lab PhD Fellowship, which is award to 5 students around the world. I'm lucky to be the only awared-winner in Chinese University and share the honor with these awesome examples: Daniel Fried (UCB), Yuke Zhu (Stanford), Zhuoran Yang (Princeton), and Noam Brown (CMU).

Oct. 19, 2017

[Award] I got Microsoft Research Asia Fellow, which is award to 10 students in Asia Pacific.

Mar. 24, 2017

[Award] I got IBM PhD Fellowship, which is award to about 80 students around the world.

Dec. 22, 2016

[Award] I got Baidu Scholarship, which is award to 10 Chinese students around the world. Here is promotional VIDEO about me.

Oct. 8, 2018

[Travel & Talk] I gave a talk with the title "Frontiers in NLP 2018" in MILA.

April 23, 2018

[Travel & Talk] I gave a talk with the title "Multi-task Learning for Natural Lanugage Processing" in MILA.

May 18, 2017

[Travel & Talk] I gave a talk with the title "Neural Representation Learning in NLP". Here is the slide and video.

July 4, 2016

[Travel & Talk] I was invited to give a seminar on Convolutional Neural Network and Recursive Neural Network hosted by Chinese Information Processing Society of China, in Beijing. And I am honoured to be rated as one of the best-loved speakers by the audiences.

Publications [Google Scholar]

(*: equal contribution)

[NEW] Searching for Effective Neural Extractive Summarization: What Works and What’s Next,
Ming Zhong*, Pengfei Liu*, Danqing Wang, Xipeng Qiu, Xuanjing Huang
The annual meeting of the Association for Computational Linguistics(ACL 2019, Long). [ pdf, Proj. with code ]

[NEW] TIGS: An Inference Algorithm for Text Infilling with Gradient Search,
Dayiheng Liu, Jie Fu, Pengfei Liu, Jiancheng Lv
The annual meeting of the Association for Computational Linguistics(ACL 2019, Long). [ pdf ]

[NEW] Star Transformer,
Qipeng Guo, Xipeng Qiu, Pengfei Liu, Yunfan Shao, Xiangyang Xue, Zheng Zhang
The North American Chapter of the Association for Computational Linguistics (NAACL 2019). [ pdf ] [ code ]

[NEW] Contextualized non-local neural networks for sequence learning,
Pengfei Liu, Shuaicheng Chang, Jian Tang, Jackie Chi Kit Cheung
Proceedings of the 33th AAAI Conference on Artificial Intelligence (AAAI 2019). [ pdf ] [ story ]

[NEW] Learning multi-task communication with message passing,
Pengfei Liu, Jie Fu*, Yue Dong*, Xipeng Qiu, Jackie Chi Kit Cheung
Proceedings of the 33th AAAI Conference on Artificial Intelligence (AAAI 2019). [ pdf ] [ story ]

[NEW] Meta-Learning Multi-task Communication,
Pengfei Liu, Xuanjing Huang
arXiv Preprint 2018. [ pdf, blog ]

Meta Multi-Task Learning for Sequence Modeling,
Junkun Chen, Xipeng Qiu, Pengfei Liu, Xuanjing Huang
Proceedings of the 32th AAAI Conference on Artificial Intelligence (AAAI 2018). [ pdf ]

Idiom-Aware Compositional Distributed Semantics,
Pengfei Liu, kaiyu Qian, Xipeng Qiu and Xuanjing Huang
Conference on Empirical Methods in Natural Language Processing (EMNLP 2017, Long). [ pdf ]

Adversarial Multi-task Learning for Text Classification,
Pengfei Liu, Xipeng Qiu, and Xuanjing Huang
The annual meeting of the Association for Computational Linguistics(ACL 2017, Long). [ pdf, project with dataset and code, Slide ]

Dynamic Compositional Neural Networks over Tree Structure,
Pengfei Liu, Xipeng Qiu, Xuanjing Huang
Proceedings of International Joint Conference on Artificial Intelligence(IJCAI 2017). [ pdf, project with code ]

Adaptive Semantic Compositionality for Sentence Modelling,
Pengfei Liu, Xipeng Qiu, Xuanjing Huang
Proceedings of International Joint Conference on Artificial Intelligence (IJCAI 2017). [ pdf ]

Modelling Interaction of Sentence Pair with Coupled-LSTMs,
Pengfei Liu, Xipeng Qiu and Xuanjing Huang
Conference on Empirical Methods in Natural Language Processing (EMNLP 2016, Long). [ pdf ]

Deep Multi-Task Learning with Shared Memory,
Pengfei Liu, Xipeng Qiu and Xuanjing Huang
Conference on Empirical Methods in Natural Language Processing (EMNLP 2016, Long). [ pdf ]

Deep Fusion LSTMs for Text Semantic Matching,
Pengfei Liu, Xipeng Qiu, Jifan Chen, and Xuanjing Huang
The annual meeting of the Association for Computational Linguistics (ACL 2016, Long). [ pdf, code]

Implicit Discourse Relation Detection via a Deep Architecture with Gated Relevance Network,
Jifan Chen, Qi Zhang, Pengfei Liu,, Xipeng Qiu and Xuanjing Huang
The annual meeting of the Association for Computational Linguistics (ACL 2016, Long). [ pdf ]

Recurrent Neural Network for Text Classification with Multi-Task Learning,
Pengfei Liu,, Xipeng Qiu, Xuanjing Huang
Proceedings of International Joint Conference on Artificial Intelligence (IJCAI 2016). [ pdf, demo[Chinese], demo[English], poster, slide, code ]

Discourse Relations Detection via a Mixed Generative-Discriminative Framework,
Jifan Chen, Qi Zhang, Pengfei Liu,, Xuanjing Huang
Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI 2016). [ pdf ]

Syntax-based Attention Model for Natural Language Inference,
Pengfei Liu, Xipeng Qiu and Xuanjing Huang
arXiv Preprint 2016. [ pdf ]

Multi-Timescale Long Short-Term Memory Neural Network for Modelling Sentences and Documents,
Pengfei Liu,, Xipeng Qiu, Xinchi Chen, Shiyu Wu, Xuanjing Huang
Conference on Empirical Methods in Natural Language Processing (EMNLP 2015, Long). [ pdf, slide ]

Long Short-Term Memory Neural Networks for Chinese Word Segmentation,
Xinchi Chen, Xipeng Qiu, Chenxi Zhu, Pengfei Liu,, Xuanjing Huang
Conference on Empirical Methods in Natural Language Processing (EMNLP 2015, Long). [ pdf ]

Learning Context-Sensitive Word Embeddings with Neural Tensor Skip-Gram Model,
Pengfei Liu,, Xipeng Qiu, Xuanjing Huang
Proceedings of International Joint Conference on Artificial Intelligence (IJCAI 2015). [ pdf, poster, slide ]