Ze-Feng Gao / 高泽峰

I am Postdoctor at the Gaoling School of Artificial Intelligence at Renmin University of China. My Cooperative tutor is Prof. Ji-Rong Wen.

Currently, my primary research interests include model compression, data compression and pre training language model based on tensor network.

I have an Ph.D of Science in Department of Physics, Renmin University of China, advised by Prof. Zhong-Yi Lu.

Email: zfgao@ruc.edu.cn

GitHub  /  Google Scholar  /  DBLP  /  Zhihu

Education

Publications

2021

Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators

This paper presents a novel pre-trained language models (PLM) compression approach based on the matrix product operator (short as MPO) from quantum many-body physics.

2020

Compressing LSTM Networks by Matrix Product Operators

We propose an alternative LSTM model to reduce the number of parameters significantly by representing the weight parameters based on matrix product operators (MPO), which are used to characterize the local correlation in quantum states in physics.

A Model Compression Method With Matrix Product Operators for Speech Enhancement

In this paper, we propose a model compression method based on matrix product operators (MPO) to substantially reduce the number of parameters in DNN models for speech enhancement.

Compressing deep neural networks by matrix product operators

In this paper, we show that neural network can be effectively solved by representing linear transformations with matrix product operators (MPOs), which is a tensor network originally proposed in physics to characterize the short-range entanglement in one-dimensional quantum states.

Selected Awards and Honors