| On layer normalization in the transformer architecture R Xiong, Y Yang, D He, K Zheng, S Zheng, C Xing, H Zhang, Y Lan, ... Proceedings of the 37th International Conference on Machine Learning, 2020, 2020 | 384 | 2020 |
| Do Transformers Really Perform Badly for Graph Representation? C Ying, T Cai, S Luo, S Zheng, G Ke, D He, Y Shen, TY Liu Thirty-Fifth Conference on Neural Information Processing Systems (NIPS), 2021, 2021 | 329 | 2021 |
| Asynchronous stochastic gradient descent with delay compensation S Zheng, Q Meng, T Wang, W Chen, N Yu, ZM Ma, TY Liu Proceedings of the 34th International Conference on Machine Learning, PMLR …, 2017 | 264* | 2017 |
| Invertible Image Rescaling M Xiao, S Zheng, C Liu, Y Wang, D He, G Ke, J Bian, Z Lin, TY Liu European Conference on Computer Vision (ECCV) 2020, 126-144, 2020 | 117 | 2020 |
| Cross-Iteration Batch Normalization Z Yao, Y Cao, S Zheng, G Huang, S Lin IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021, 2020 | 83 | 2020 |
| Deep learning for prediction of the air quality response to emission changes J Xing, S Zheng, D Ding, JT Kelly, S Wang, S Li, T Qin, M Ma, Z Dong, ... Environmental science & technology 54 (14), 8589-8600, 2020 | 45 | 2020 |
| How could Neural Networks understand Programs? D Peng, S Zheng, Y Li, G Ke, D He, TY Liu Proceedings of International Conference on Machine Learning (ICML), 2021 …, 2021 | 31 | 2021 |
| -SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space Q Meng, S Zheng, H Zhang, W Chen, Q Ye, ZM Ma, TY Liu Proceedings of the 7th International Conference on Learning Representations …, 2018 | 25 | 2018 |
| Stable, Fast and Accurate: Kernelized Attention with Relative Positional Encoding S Luo, S Li, T Cai, D He, D Peng, S Zheng, G Ke, L Wang, TY Liu Advances in Neural Information Processing Systems, 2021 (NeurIPS 2021), 2021 | 20 | 2021 |
| Capacity control of relu neural networks by basis-path norm S Zheng, Q Meng, H Zhang, W Chen, N Yu, TY Liu Proceedings of the 33rd AAAI Conference on Artificial Intelligence, 2019, 2018 | 20 | 2018 |
| Benchmarking graphormer on large-scale molecular modeling datasets Y Shi, S Zheng, G Ke, Y Shen, J You, J He, S Luo, C Liu, D He, TY Liu arXiv preprint arXiv:2203.04810, 2022 | 14 | 2022 |
| Modeling Lost Information in Lossy Image Compression Y Wang, M Xiao, C Liu, S Zheng, TY Liu arXiv preprint arXiv:2006.11999, 2020 | 14 | 2020 |
| Mc-bert: Efficient language pre-training via a meta controller Z Xu, L Gong, G Ke, D He, S Zheng, L Wang, J Bian, TY Liu arXiv preprint arXiv:2006.05744, 2020 | 11 | 2020 |
| First Place Solution of KDD Cup 2021 & OGB Large-Scale Challenge Graph Prediction Track C Ying, M Yang, S Zheng, G Ke, S Luo, T Cai, C Wu, Y Wang, Y Shen, ... arXiv preprint arXiv:2106.08279, 2021 | 8 | 2021 |
| Your transformer may not be as powerful as you expect S Luo, S Li, S Zheng, TY Liu, L Wang, D He arXiv preprint arXiv:2205.13401, 2022 | 6 | 2022 |
| Mimicking atmospheric photochemical modeling with a deep neural network J Xing, S Zheng, S Li, L Huang, X Wang, JT Kelly, S Wang, C Liu, C Jang, ... Atmospheric research 265, 105919, 2022 | 6 | 2022 |
| One transformer can understand both 2d & 3d molecular data S Luo, T Chen, Y Xu, S Zheng, TY Liu, L Wang, D He arXiv preprint arXiv:2210.01765, 2022 | 5 | 2022 |
| OptQuant: Distributed Training of Neural Networks with Optimized Quantization Mechanisms L He, S Zheng, W Chen, ZM Ma, TY Liu Neurocomputing 340, Pages 233-244, 2019 | 5 | 2019 |
| Masked Molecule Modeling: A New Paradigm of Molecular Representation Learning for Chemistry Understanding J He, K Tian, S Luo, Y Min, S Zheng, Y Shi, D He, H Liu, N Yu, L Wang, ... | 2 | 2022 |
| Invertible Rescaling Network and Its Extensions M Xiao, S Zheng, C Liu, Z Lin, TY Liu International Journal of Computer Vision 131 (1), 134-159, 2023 | 1 | 2023 |
Tie-Yan LiuDistinguished Scientist, Microsoft Research AI4Science | IEEE Fellow | ACM Fellow | AAIA FellowVerified email at microsoft.com
