Jiaying Liu Ph.D. | 刘家瑛
Associate Professor
Institute of Computer Science & Technology, Peking University

Selected Publication

(* Corresponding author)

Journal

Jiaying Liu, Sijie Song, Chunhui Liu, Yanghao Li, Yueyu Hu. "A Benchmark Dataset and Comparison Study for Multi-Modal Human Action", Accepted by ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Sep. 2019.
Jiaying Liu, Yanghao Li, Sijie Song, Junliang Xing, Cuiling Lan, and Wenjun Zeng. "Multi-Modality Multi-Task Recurrent Neural Network for Online Action Detection", IEEE Trans. on Circuit System for Video Technology (TCSVT), Vol.29, No.9, pp.2667-2682, Sep. 2019.
Jiaying Liu, Sifeng Xia, Wenhan Yang, Mading Li, and Dong Liu. "One-for-All: Grouped Variation Network Based Fractional Interpolation in Video Coding", IEEE Trans. on Image Processing (TIP), Vol.28, No.5, pp.2140-2151, May 2019.
Jiaying Liu, Wenhan Yang, Shuai Yang, and Zongming Guo. "D3R-Net: Dynamic Routing Residue Recurrent Network for Video Rain Removal", IEEE Trans. on Image Processing (TIP), Vol.28, No.2, pp.699-712, Feb. 2019.
Jiaying Liu, Shuai Yang, Yuming Fang, Zongming Guo. "Structure-Guided Image Inpainting Using Homography Transformation", IEEE Trans. on Multimedia (TMM), Vol.20, No.12, Dec. 2018.
Jiaying Liu, Wenhan Yang, Xiaoyan Sun, and Wenjun Zeng. "Photo Stylistic Brush: Robust Style Transfer via Superpixel-Based Bipartite Graph", IEEE Trans. on Multimedia (TMM), Vol.20, No.7, pp.1724-1737, July 2018.
Jiaying Liu, Wenhan Yang, Xinfeng Zhang, and Zongming Guo. "Retrieval Compensated Group Structured Sparsity for Image Super-Resolution", IEEE Trans. on Multimedia (TMM), Vol.19, No.2, pp.302-216, Feb. 2017.
Jiaying Liu, Yongjin Cho, Zongming Guo and C.-C. Jay Kuo. "Bit Allocation for Spatial Scalability Coding of H.264/SVC With Dependent Rate-Distortion Analysis", IEEE Trans. on Circuit System for Video Technology (TCSVT), Vol.20, No.7, pp.967-981, 2010.
Chuanmin Jia, Shiqi Wang, Xinfeng Zhang, Shanshe Wang, Jiaying Liu, and Siwei Ma. "Content-Aware Convolutional Neural Network for In-loop Filtering in High Efficiency Video Coding", IEEE Trans. on Image Processing (TIP), Vol.28, No.7, pp.3343-3356, July 2019.
Wenhan Yang, Jiaying Liu*, Shuai Yang, and Zongming Guo. "Scale-Free Single Image Deraining via Visibility-Enhanced Recurrent Wavelet Learning", IEEE Trans. on Image Processing (TIP), Vol.28, No.6, pp.2948-2961, June 2019.
Mading Li, Jiaying Liu, Xiaoyan Sun, and Zhiwei Xiong. "Image/Video Restoration via Multiplanar Autoregressive Model and Low-Rank Optimization", Accepted by ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), June 2019.
Wenhan Yang, Sifeng Xia, Jiaying Liu*, Zongming Guo. "Reference-Guided Deep Super-Resolution via Manifold Localized External Compensation", IEEE Trans. on Circuit System for Video Technology (TCSVT), Vol.29, No.5, pp.1270-1283, May 2019.
Yueyu Hu, Wenhan Yang, Mading Li, and Jiaying Liu. "Progressive Spatial Recurrent Neural Network for Intra Prediction", Accepted by IEEE Transactions on Multimedia (TMM), May 2019.
Yuming Fang, Jiaying Liu*, Yabin Zhang, Weisi Lin, and Zongming Guo. "Reduced-Reference Quality Assessment of Image Super-resolution by Energy Change and Texture Variation", Journal of Visual Communication and Image Representation (JVCI), Vol.60, pp.140-148, April 2019.
Xinfeng Zhang, Weisi Lin, Shiqi Wang, Jiaying Liu, Siwei Ma, and Wen Gao. "Fine-Grained Quality Assessment for Compressed Images", IEEE Trans. on Image Processing (TIP), Vol.28, No.3, pp.1163-1175, March 2019.
Shuai Yang, Jiaying Liu*, Wenhan Yang, and Zongming Guo. "Context-Aware Text-Based Binary Image Stylization and Synthesis", IEEE Trans. on Image Processing (TIP), Vol.28, No.2, pp.952-964, Feb. 2019.
Wenhan Yang, Robby T. Tan, Jiashi Feng, Zongming Guo, Shuicheng Yan, and Jiaying Liu*. "Joint Rain Detection and Removal from a Single Image with Contextualized Deep Networks", Accepted by IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), Jan. 2019.
Shuai Yang, Jiaying Liu*, Zhouhui Lian, and Zongming Guo. "Text Effects Transfer via Distribution-Aware Texture Synthesis", Computer Vision and Image Understanding (CVIU), Vol.174, pp.43-56, Sep. 2018.
Yanghao Li, Naiyan Wang, Jianping Shi, Xiaodi Hou, and Jiaying Liu*. "Adaptive Batch Normalization for Practical Domain Adaptation", Pattern Recognition (PR), Vol.80, pp.109-117, Aug. 2018.
Sijie Song, Cuiling Lan, Junliang Xing, Wenjun Zeng and Jiaying Liu*. "Spatial-Temporal Attention Based LSTM Networks for 3D Action Recognition and Detection", IEEE Trans. on Image Processing (TIP), Vol.27, No.7, pp.3459-3471, July 2018.
Mading Li, Jiaying Liu*, Wenhan Yang, Xiaoyan Sun, and Zongming Guo. "Structure-Revealing Low-Light Image Enhancement via Robust Retinex Model", IEEE Trans. on Image Processing (TIP), Vol.27, No.6, pp.2828-2941, June 2018.
Wenhan Yang, Jiaying Liu*, Mading Li, and Zongming Guo. "Isophote-Constrained Autoregressive Model with Adaptive Window Extension for Image Interpolation", IEEE Trans. on Circuit System for Video Technology (TCSVT), Vol.28, No.5, pp.1071-1086, May 2018.
Wenhan Yang, Jiashi Feng, Guosen Xie, Jiaying Liu*, Zongming Guo, and Shuicheng Yan. "Video Super-Resolution Based on Spatial-Temporal Recurrent Residual Networks", Computer Vision and Image Understanding (CVIU), Vol.168, pp.79-92, Mar. 2018.
Shuai Yang, Jiaying Liu*, Yuming Fang, and Zongming Guo. "Joint-Feature Guided Depth Map Super-Resolution with Face Priors", IEEE Trans. on Cybernetics (TCYB), Vol.48, No.1, pp.399-411, Jan. 2018.
Wenhan Yang, Jiashi Feng, Jianchao Yang, Fang Zhao, Jiaying Liu*, Zongming Guo, and Shuicheng Yan. "Deep Edge Guided Recurrent Residual Learning for Image Super-Resolution", IEEE Trans. on Image Processing (TIP), Vol.26, No.12, pp.5895-5907, Dec. 2017.
Yuming Fang, Jiebin Yan, Jiaying Liu*, Shiqi Wang, Qiaohong Li, and Zongming Guo, "Objective Quality Assessment of Screen Content Images by Uncertainty Weighting", IEEE Trans. on Image Processing (TIP), Vol.26, No.4, Apr. 2017.
Xinfeng Zhang, Ruiqin Xiong, Weisi Lin, Siwei Ma, Jiaying Liu and Wen Gao. "Video Compression Artifact Reduction via Spatio-Temporal Multi-Hypothesis Prediction", IEEE Trans. on Image Processing (TIP), Vol.24, No.12, pp.6048-6016, Dec. 2015.
Yongqin Zhang, Jiaying Liu*, Wenhan Yang and Zongming Guo. "Image Super-Resolution Based on Structure-Modulated Sparse Representation", IEEE Trans. on Image Processing (TIP), Vol.24, No.9, pp.2797-2810, May 2015.
Mading Li, Jiaying Liu*, Jie Ren, Zongming Guo. "Adaptive General Scale Interpolation Based on Weighted Autoregressive Models". IEEE Trans. on Circuit System for Video Technology (TCSVT). Vol.25, No.2, pp.200-211, Feb. 2015.
Yongjin Cho, Do-Kyoung Kwon, Jiaying Liu*, and C.-C. Jay Kuo. "Dependent R/D Modeling Techniques and Joint T-Q Layer Bit Allocation for H.264/SVC", IEEE Trans. on Circuit System for Video Technology (TCSVT), Vol.23, No.6, pp.1003-1015, Jun. 2013.
Jie Ren, Jiaying Liu*, and Zongming Guo. "Context-Aware Sparse Decomposition for Image Denoising and Super-Resolution", IEEE Transactions on Image Processing (TIP), Vol.22, No.4, pp.1456-1469, Apr. 2013.
Jun Sun, Yizhou Duan, Jiangtao Li, Jiaying Liu* and Zongming Guo. "Rate-Distortion Analysis of Dead-Zone Plus Uniform Threshold Scalar Quantization and Its Application—Part I: Fundamental Theory", IEEE Transaction on Image Processing (TIP), Vol.22, No.1, pp.202-214, Jan. 2013.
Jun Sun, Yizhou Duan, Jiangtao Li, Jiaying Liu* and Zongming Guo. "Rate-Distortion Analysis of Dead-Zone Plus Uniform Threshold Scalar Quantization and Its Application—Part II: Two-Pass VBR Coding for H.264/AVC", IEEE Transaction on Image Processing (TIP), Vol.22, No.1, pp.215-228, Jan. 2013.

Conference

Shuai Yang, Zhangyang Wang, Zhaowen Wang, Ning Xu, Jiaying Liu, and Zongming Guo. "Controllable Artistic Text Style Transfer via Shape-Matching GAN", Accepted by International Conference on Computer Vision (ICCV), Seoul, Korea, Oct. 2019.
Shaofan Cai, Xiaoshuai Zhang, Haoqiang Fan, Haibin Huang, Jiaying Liu, Jiaming Liu, Jiaying Liu, Jue Wang, and Jian Sun. "Disentangled Image Matting", Accepted by International Conference on Computer Vision (ICCV), Seoul, Korea, Oct. 2019.
Chia-Wei Hsieh, Chieh-Yun Chen, Chien-Lung Chou, Hong-Han Shuai, Jiaying Liu, and Wen-Huang Cheng. "FashionOn: Detail-preserving Image-based Virtual Try-on via Semantic-guided Optimization", Accepted by ACM Multimedia (ACM MM), Nice, France, Oct. 2019.
Xiang Gao, Wei Hu, Jiaxiang Tang, Jiaying Liu and Zongming Guo. "Optimized Skeleton-based Action Recognition via Sparsified Graph Regression", Accepted by ACM Multimedia (ACM MM), Nice, France, Oct. 2019.
Fu Qiang, Wenhan Yang, Ying Li, and Jiaying Liu*. "Deep Pyramid Variation Learning for Image Interpolation", Proc. of IEEE International Conference on Multimedia & Expo (ICME), Shanghai, China, July 2019.
Xiaoshuai Zhang, Yiping Lu, Jiaying Liu*, and Bin Dong. "Dynamically Unfolding Recurrent Restorer: A Moving Endpoint Control Method for Image Restoration", Proc. of International Conference on Learning Representations (ICLR), New Orleans, Louisiana, May 2019.
Shuai Yang, Jiaying Liu*, Wenjing Wang, and Zongming Guo. "TET-GAN: Text Effects Transfer via Stylization and Destylization", Proc. of AAAI Conference on Artificial Intelligence (AAAI), Honolulu, Hawaii, Jan. 2019.
Yanghao Li, Sijie Song, Yuqi Li, and Jiaying Liu*. "Temporal Bilinear Networks for Video Action Recognition", Proc. of AAAI Conference on Artificial Intelligence (AAAI), Honolulu, Hawaii, Jan. 2019.
Rui Qian, Yunchao Wei, Honghui Shi, Jiachen Li, Jiaying Liu, and Thomas Huang. "Weakly Supervised Scene Parsing with Point-based Distance Metric Learning", Proc. of AAAI Conference on Artificial Intelligence (AAAI), Honolulu, Hawaii, Jan. 2019.
Jiaying Liu, Wenhan Yang, Shuai Yang, Zongming Guo. "Erase or Fill? Deep Joint Recurrent Rain Removal and Reconstruction in Videos", Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2018.
Shuai Yang, Jiaying Liu*, Wenhan Yang, and Zongming Guo. "Context-Aware Unsupervised Text Stylization", Proc. of ACM Multimedia (ACM MM), Seoul, Korea, Oct. 2018.
Qian Rui, Robby Tan, Wenhan Yang, Jiajun Su, and Jiaying Liu*. "Attentive Generative Adversarial Network for Raindrop Removal from A Single Image", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2018.
Sifeng Xia, Wenhan Yang, Yueyu Hu, and Jiaying Liu*. "A Group Variational Transformation Neural Network for Fractional Interpolation of Video Coding", Proc. of Data Compression Conference (DCC), 2018.
Yueyu Hu, Wenhan Yang, Sifeng Xia, and Jiaying Liu*. "Enhanced Intra Prediction with Recurrent Neural Network in Video Coding", Proc. of Data Compression Conference (DCC), 2018.
Sijie Song, Cuiling Lan, Junliang Xing, Wenjun Zeng and Jiaying Liu*. "Skeleton-Indexed Deep Multi-Modal Feature Learning for High Performance Human Action Recognition", Proc. of IEEE International Conference on Multimedia & Expo (ICME), San Diego, July 2018.
Yanghao Li, Naiyan Wang, Jiaying Liu*, and Xiaodi Hou. "Factorized Bilinear Models for Image Recognition", Proc. of International Conference on Computer Vision (ICCV), Venice, Italy, Oct. 2017.
Yanghao Li, Naiyan Wang, Jiaying Liu*, and Xiaodi Hou. "Demystifying Neural Style Transfer", Proc. of International Joint Conference on Artificial Intelligence (IJCAI), Melbourne, Australia, Aug. 2017.
Shuai Yang, Jiaying Liu*, Zhouhui Lian, and Zongming Guo. "Awesome Typography: Statistics-Based Text Effects Transfer", Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, Jul. 2017.
Wenhan Yang, Robby T. Tan, Jiashi Feng, Jiaying Liu, Zongming Guo, and Shuicheng Yan. "Joint Rain Detection and Removal from a Single Image", Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, Jul. 2017.
Sijie Song, Cuiling Lan, Junliang Xing, Wenjun Zeng and Jiaying Liu*. "An End-to-End Spatio-Temporal Attention Model for Human Action Recognition from Skeleton Data". Proc. of AAAI Conference on Artificial Intelligence (AAAI), San Francisco, CA, Feb. 2017.
Wenhan Yang, Shihong Deng, Yueyu Hu, Junliang Xing, and Jiaying Liu*. "Real-Time Deep Video SpaTial Resolution UpConversion SysTem (STRUCT++ Demo)", ACM Multimedia (ACM MM), Silicon Valley, California, U.S., Oct. 2017.
Chunhui Liu, Yanghao Li, Yueyu Hu, and Jiaying Liu*. "Online Action Detection and Forecast via Multi-Task Deep Recurrent Neural Network", Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), New Orleans, LA, Mar. 2017.
Shihong Deng, Jiaying Liu*, Mading Li, Wenhan Yang, and Zongming Guo. "General Scale Interpolation via Context-Aware Autoregressive Model and Multiplanar Constraint", Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), New Orleans, LA, Mar. 2017.
Shuai Yang, Jiaying Liu, Sifeng Xia, and Zongming Guo. "1+N Fusion: Cascaded Self-Portrait Enhancement", Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), New Orleans, LA, Mar. 2017.
Mading Li, Jiaying Liu*, Wenhan Yang, and Zongming Guo. "Joint Denoising and Enhancement for Low-Light Images via Retinex Model", International Forum of Digital TV and Wireless Multimedia Communication (IFTC), Shanghai, China, Nov. 2017. (Best Paper Award)
Mading Li, Jiaying Liu*, Zhiwei Xiong, Xiaoyan Sun, and Zongming Guo. "MARLow: A Joint Multiplanar Autoregressive and Low-Rank Approach for Image Completion", Proc. of European Conference on Computer Vision (ECCV), Amsterdam, Netherlands, Oct. 2016.
Yanghao Li, Cuiling Lan, Junliang Xing, Wenjun Zeng, Chunfeng Yuan, and Jiaying Liu*. "Online Human Action Detection using Joint Classification-Regression Recurrent Neural Networks", Proc. of European Conference on Computer Vision (ECCV), Amsterdam, Netherlands, Oct. 2016.
Mading Li, Jiaying Liu*, Yu Guan and Zongming Guo. "Image Restoration Based on 3-D Autoregressive Model via Low-Rank Minimization", Proc. of Data Compression Conference (DCC), Snowbird, Utah, Apr. 2015.
Wenhan Yang, Jiaying Liu, Shuai Yang, Zongming Guo, "Novel Autoregressive Model Based on Adaptive Window-Extension and Patch-Geodesic Distance for Image Interpolation", Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Brisbane, Australia, Apr. 2015.
Yanghao Li, Jiaying Liu*, Wenhan Yang and Zongming Guo. "Neighborhood Regression for Edge-Preserving Image Super-Resolution", Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Brisbane, Australia, Apr. 2015.
Saboya Yang, Jiaying Liu*, Shuai Yang, Sifeng Xia and Zongming Guo. "Hierarchical Oil Painting Stylization with Limited Reference via Sparse Representation", Proc. of IEEE International Workshop on Multimedia Signal Processing (MMSP), Xiamen, China, Oct. 2015. (Top 10% Paper Awards)
Yongqin Zhang, Jiaying Liu*, Mading Li and Zongming Guo. "BSIK-SVD: A Dictionary-Learning Algorithm for Block-Sparse Representations", Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Florence, Italy, May 2014.
Wei Bai, Jiaying Liu*, Yanghao Li and Zongming Guo. "Image Transformation using Limited Reference with Application to Photo-Sketch Synthesis". Proc. of IEEE Visual Communications and Image Processing (VCIP), Valletta, Malta, Dec. 2014. (Best Paper Award Candidate)
Jiaying Liu, Yongjin Cho and Zongming Guo. "Single-Pass Dependent Bit Allocation in Temporal Scalability Video Coding", Proc. of Data Compression Conference (DCC), Snowbird, Utah, Mar. 2013.
Jie Ren, Jiaying Liu*, Mading Li and Zongming Guo. "Postprocessing of Block-Coded Videos for Deflicker and Deblocking", Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Vancouver, Canada, May 2013.
Jie Ren, Jiaying Liu*, Mading Li, Wei Bai and Zongming Guo. "Image Blocking Artifacts Reduction via Patch Clustering and Low-Rank Minimization", Proc. of Data Compression Conference (DCC), Snowbird, Utah, Mar. 2013.