Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback

Jiakang Yuan, Xiangchao Yan, Shiyang Feng, Bo Zhang, Tao Chen, Botian Shi, Wanli Ouyang, Yu Qiao, Lei Bai, Bowen Zhou

[Project][Paper]

• Propose Dolphin, a closed-loop auto-research framework.

SurveyForge: On the Outline Heuristics, Memory-Driven Generation, and Multi-dimensional Evaluation for Automated Survey Writing

Xiangchao Yan^*, Shiyang Feng^*, Jiakang Yuan, Renqiu Xia, Bin Wang, Bo Zhang, Lei Bai

[Project][Paper]

• Propose SurveyForge which can automatically generate and refine the content of survey.

Consistency-aware Self-Training for Iterative-based Stereo Matching

Jingyi Zhou^*, Peng Ye^*, Haoyu Zhang, Jiakang Yuan (Project Leader), Qiang Rao, YangChenXu Liu, Cailin Wu, Feng Xu, Tao Chen

[Project][Paper]

• Propose CST-Stereo, which achieves impressive results in various scenarios, including in domain, domain adaptive and domain generalization,

GeoX: Geometric Problem Solving Through Unified Formalized Vision-Language Pre-training

Renqiu Xia^*, Mingsheng Li^*, Hancheng Ye, Wenjie Wu, Hongbin Zhou, Jiakang Yuan, Tianshuo Peng, Xinyu Cai, Xiangchao Yan, Bin Wang, Conghui He, Botian Shi, Tao Chen, Junchi Yan, Bo Zhang

[Project][Paper]

• Propose GeoX, a multi-modal large model focusing on geometric understanding and reasoning tasks which reveals the large potential of formalized visual-language pre-training in enhancing geometric problem-solving abilities.

All-in-One: Transferring Vision Foundation Models into Stereo Matching

Jingyi Zhou^*, Haoyu Zhang^*, Jiakang Yuan^*, Peng Ye, Tao Chen, Hao Jiang, Meiya Chen, Yangyang Zhang

[Project][Paper]

• Propose AIOStereo to flexibly select and transfer knowledge from multiple heterogeneous VFMs to a single stereo matching model. (Rank 1st on Middlebury Stereo Evaluation)

Training-Free Adaptive Diffusion with Bounded Difference Approximation Strategy

Hancheng Ye^*, Jiakang Yuan^*, Renqiu Xia, Xiangchao Yan, Tao Chen, Junchi Yan, Botian Shi, Bo Zhang

[Project][Paper]

• Propose AdaptiveDiffusion to adaptively reduce the noise prediction steps during the denoising proces guided by the third-order latent difference.

3DET-Mamba: State Space Model for End-to-End 3D Object Detection

Mingsheng Li^*, Jiakang Yuan^*, Sijin Chen, Lin Zhang, Anyu Zhu, Xin Chen, Tao Chen

[Project][Paper]

• Exploit the potential of Mamba architecture on 3D scene-level perception for the first time.

Reg-TTA3D: Better Regression Makes Better Test-time Adaptive 3D Object Detection

Jiakang Yuan, Bo Zhang, Kaixiong Gong, Xiangyu Yue, Botian Shi, Yu Qiao, Tao Chen

[Project][Paper]

• Explore a new task named test-time domain adaptive 3D object detection and propose a pseudo-label-based test-time adaptative 3D object detection method.

ReSimAD: Zero-Shot 3D Domain Transfer for Autonomous Driving with Source Reconstruction and Target Simulation

Bo Zhang^*, Xinyu Cai^*, Jiakang Yuan, Donglin Yang, Jianfei Guo, Xiangchao Yan, Renqiu Xia, Botian Shi, Min Dou, Tao Chen, Si Liu, Junchi Yan, Yu Qiao

[Project][Paper]

• Provide a new perspective and approach of alleviating the domain shifts, by proposing a Reconstruction-Simulation-Perception scheme.

AD-PT: Autonomous Driving Pre-Training with Large-scale Point Cloud Dataset

Jiakang Yuan, Bo Zhang, Xiangchao Yan, Tao Chen, Botian Shi, Yikang Li, Yu Qiao

[Project][Paper]

• Build a large-scale pre-training point-cloud dataset with diverse data distribution, and meanwhile learn generalizable representations.

Bi3D: Bi-domain Active Learning for Cross-domain 3D Object Detection

Jiakang Yuan, Bo Zhang, Xiangchao Yan, Tao Chen, Botian Shi, Yikang Li, Yu Qiao

[Project][Paper]

• Propose a Bi-domain active learning approach which select samples from both source and target domain to solve the cross-domain 3D object detection task.

Uni3D: A Unified Baseline for Multi-dataset 3D Object Detection

Bo Zhang, Jiakang Yuan, Botian Shi, Tao Chen, Yikang Li, Yu Qiao

[Project][Paper]

• Present a Uni3D which tackle multi-dataset 3D object detection from data-level and semantic-level.

Learning Cross-Image Object Semantic Relation in Transformer for Few-Shot Fine-Grained Image Classification

Bo Zhang^*, Jiakang Yuan^*, Baopu Li, Tao Chen, Jiayuan Fan, Botian Shi

[Project][Paper]

• Propose a Transformer-based double-helix model to achieve the cross-image object semantic relation mining in a bidirectional and symmetrical manner.

MME-Reasoning: A Comprehensive Benchmark for Logical Reasoning in MLLMs

Jiakang Yuan^*, Tianshuo Peng^*, Yilei Jiang, Yiting Lu, Renrui Zhang, Kaituo Feng, Chaoyou Fu, Tao Chen, Lei Bai, Bo Zhang, Xiangyu Yue

[Project][Paper][Huggingface][Learderboard]

• Introduce MME-Reasoning, a comprehensive benchmark specifically designed to evaluate the reasoning capability of MLLMs.

NovelSeek: When Agent Becomes the Scientist – Building Closed-Loop System from Hypothesis to Verification

NovelSeek Team: Bo Zhang, Shiyang Feng, Xiangchao Yan, Jiakang Yuan (Core contributor), Zhiyin Yu, Xiaohan He, Songtao Huang, Shaowei Hou, Zheng Nie, Zhilong Wang, Jinyao Liu, Runmin Ma, Tianshuo Peng, Peng Ye, Dongzhan Zhou, Shufei Zhang, Xiaosong Wang, Yilan Zhang, Meng Li, Zhongying Tu, Xiangyu Yue, Wangli Ouyang, Bowen Zhou, Lei Bai

[Project][Paper]

• Introduce NovelSeek, a unified closed-loop multi-agent framework for Automatic Scientific Research.

OmniCaptioner: One Captioner to Rule Them All

Yiting Lu^*, Jiakang Yuan^*, Zhen Li, Shitian Zhao, Qi Qin, Xinyue Li, Le Zhuo, Licheng Wen, Dongyang Liu, Yuewen Cao, Xiangchao Yan, Xin Li, Botian Shi, Tao Chen, Zhibo Chen, Lei Bai, Bo Zhang, Peng Gao

[Project][Paper]

• Propose Omnicaption, an all-in-one visual to text mapping tool.

Lumina-Image 2.0: A Unified and Efficient Image Generative Framework

Qi Qin, Le Zhuo, Yi Xin, Ruoyi Du, Zhen Li, Bin Fu, Yiting Lu, Jiakang Yuan, Xinyue Li, Dongyang Liu, Xiangyang Zhu, Manyuan Zhang, Will Beddow, Erwann Millon, Victor Perez, Wenhai Wang, Conghui He, Bo Zhang, Xiaohong Liu, Hongsheng Li, Yu Qiao, Chang Xu, Peng Gao

[Project][Paper]

• State-of-the-art text-to-image generation model.

Bidirectional Prototype-Reward co-Evolution for Test-Time Adaptation of Vision-Language Models

Xiaozhen Qiao, Peng Huang, Jiakang Yuan, Xianda Guo, Bowen Ye, Zhe Sun, Xuelong Li

[Project][Paper]

• Novel TTA framework for VLMs.

Chimera: Improving Generalist Model with Domain-Specific Experts

Tianshuo Peng^*, Mingsheng Li^*, Jiakang Yuan, Hongbin Zhou, Renqiu Xia, Renrui Zhang, Lei Bai, Song Mao, Bin Wang, Aojun Zhou, Botian Shi, Tao Chen, Bo Zhang, Xiangyu Yue

[Project][Paper]

• a scalable and low-cost multi-modal pipeline designed to boost the ability of existing LMMs with domain-specific experts.