Towards artificial general intelligence via a multimodal foundation model N Fei, Z Lu, Y Gao, G Yang, Y Huo, J Wen, H Lu, R Song, X Gao, T Xiang, ... Nature Communications 13 (1), 3094, 2022 | 233 | 2022 |
Deepseek LLM: Scaling open-source language models with longtermism X Bi, D Chen, G Chen, S Chen, D Dai, C Deng, H Ding, K Dong, Q Du, ... arXiv preprint arXiv:2401.02954, 2024 | 162 | 2024 |
WenLan: Bridging vision and language by large-scale multi-modal pre-training Y Huo, M Zhang, G Liu, H Lu, Y Gao, G Yang, J Wen, H Zhang, B Xu, ... arXiv preprint arXiv:2103.06561, 2021 | 152 | 2021 |
Deepseek-VL: Towards Real-world Vision-language Understanding H Lu, W Liu, B Zhang, B Wang, K Dong, B Liu, J Sun, T Ren, Z Li, Y Sun, ... arXiv preprint arXiv:2403.05525, 2024 | 146 | 2024 |
COTS: Collaborative two-stream vision-language pre-training model for cross-modal retrieval H Lu, N Fei, Y Huo, Y Gao, Z Lu, JR Wen Proceedings of the IEEE/CVF conference on computer Vision and pattern …, 2022 | 73 | 2022 |
VDT: General-purpose Video Diffusion Transformers via Mask Modeling H Lu, G Yang, N Fei, Y Huo, Z Lu, P Luo, M Ding The Twelfth International Conference on Learning Representations, 2024 | 53* | 2024 |
Uniadapter: Unified parameter-efficient transfer learning for cross-modal modeling H Lu, Y Huo, G Yang, Z Lu, W Zhan, M Tomizuka, M Ding The Twelfth International Conference on Learning Representations, 2024 | 25 | 2024 |
Self-supervised video representation learning with constrained spatiotemporal jigsaw Y Huo, M Ding, H Lu, Z Lu, T Xiang, JR Wen, Z Huang, J Jiang, S Zhang, ... | 22 | 2021 |
Learning versatile neural architectures by propagating network codes M Ding, Y Huo, H Lu, L Yang, Z Wang, Z Lu, J Wang, P Luo arXiv preprint arXiv:2103.13253, 2021 | 16 | 2021 |
Cross-modal contrastive learning for generalizable and efficient image-text retrieval H Lu, Y Huo, M Ding, N Fei, Z Lu Machine Intelligence Research 20 (4), 569-582, 2023 | 11 | 2023 |
Multimodal foundation models are better simulators of the human brain H Lu, Q Zhou, N Fei, Z Lu, M Ding, J Wen, C Du, X Zhao, H Sun, H He, ... arXiv preprint arXiv:2208.08263, 2022 | 11 | 2022 |
Compressed video contrastive learning Y Huo, M Ding, H Lu, N Fei, Z Lu, JR Wen, P Luo Advances in Neural Information Processing Systems 34, 14176-14187, 2021 | 10 | 2021 |
LGDN: Language-Guided Denoising Network for Video-Language Modeling H Lu, M Ding, N Fei, Y Huo, Z Lu Advances in Neural Information Processing Systems, 2022, 2022 | 9 | 2022 |
Needle In A Video Haystack: A Scalable Synthetic Framework for Benchmarking Video MLLMs Z Zhao, H Lu, Y Huo, Y Du, T Yue, L Guo, B Wang, W Chen, J Liu arXiv preprint arXiv:2406.09367, 2024 | 6 | 2024 |
Bmu-moco: Bidirectional momentum update for continual video-language modeling Y Gao, N Fei, H Lu, Z Lu, H Jiang, Y Li, Z Cao Advances in Neural Information Processing Systems 35, 22699-22712, 2022 | 5 | 2022 |
Beyond Filtering: Adaptive Image-Text Quality Enhancement for MLLM Pretraining H Huang, Y Huo, Z Zhao, H Lu, S Wu, B Wang, Q Liu, W Chen, L Wang arXiv preprint arXiv:2410.16166, 2024 | | 2024 |
Exploring the Design Space of Visual Context Representation in Video MLLMs Y Du, Y Huo, K Zhou, Z Zhao, H Lu, H Huang, WX Zhao, B Wang, W Chen, ... arXiv preprint arXiv:2410.13694, 2024 | | 2024 |