Research研究方向
My research interests: 3D computer vision, computer graphics, and embodied intelligence,
including inverse rendering, 3D reconstruction, texture generation, active perception,
and end-to-end policy learning.
我的研究方向为:三维计算机视觉、计算机图形学与具身智能,
包括逆向渲染、三维重建、纹理生成、主动感知与端到端策略学习。
|
|
Twin-DAgger: Synergizing Digital Twins and Human Corrections for Efficient Robot Manipulation
Jiahang Li*, Zhirui Zhang*, Kairan Ding, Fan Fei, Yunkai Tang, Jiaming Liu, Xiao He, Ziyu Chen, Gaohao Zhou, Jieji Ren, Yandong Guo, Shanghang Zhang, Boxin Shi
The European Conference on Computer Vision (ECCV), 2026
paper论文 /
poster海报 /
youtubeYouTube /
We propose to treat each real-world intervention as both a spatial probe of failure-prone regions
and a temporal prior of critical deviation moments to guide synthetic data generation, matching conventional
DAgger performance with only 15% of the human interventions.
提出把每一次真实世界的人工干预同时视为定位易失败空间区域的空间探针、以及标记关键偏离时刻的时间先验,
以此指导合成数据生成,仅用 15% 的人工干预即可达到传统 DAgger 的效果。
|
|
PacTure: Efficient PBR Texture Generation on Packed Views with Visual Autoregressive Models
Fan Fei, Jiajun Tang, Fei-Peng Tian, Boxin Shi#, Ping Tan
Accepted by Computational Visual Media Journal (CVMJ), 2026
paper论文 /
We propose a method to efficiently generate physically-based rendering (PBR) textures on a packed multi-view grid
using a visual autoregressive model as multi-view generation backbone.
提出以视觉自回归模型作为多视角生成骨干,在打包的多视角网格上高效生成基于物理渲染(PBR)的材质贴图。
|
|
No Redundancy, No Stall: Lightweight Streaming 3D Gaussian Splatting for Real-time Rendering
Linye Wei, Jiajun Tang, Fan Fei, Boxin Shi, Runsheng Wang, Meng Li
The International Conference on Computer-Aided Design (ICCAD), 2025
paper论文 /
We propose an algorithm/hardware co-design framework for lightweight streaming 3D rendering which
achieves 5.41× speedup over the edge GPU baseline on average and up to 17.3× speedup with the customized
accelerator.
提出一套面向轻量级流式三维渲染的算法/硬件协同设计框架,相比边缘 GPU 基线平均加速 5.41×,配合定制加速器最高可达 17.3× 加速。
|
|
SpecTRe-GS: Modeling Highly Specular Surfaces with Reflected Nearby Objects by Tracing Rays in 3D Gaussian Splatting
Jiajun Tang, Fan Fei, Zhihao Li, Xiao Tang, Shiyong Liu, Youyu Chen, Binxiao Huang, Zhenyu Chen, Xiaofei Wu, Boxin Shi#
The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (Highlight), 2025
paper论文 /
website项目主页 /
We propose a 3D reconstruction method which models highly specular surfaces that reflect nearby objects through
ray tracing in 3D Gaussian Splatting.
提出一种三维重建方法,通过在三维高斯泼溅中追踪光线,对反射邻近物体的高反光表面进行建模。
|
|
VMINer: Versatile Multi-view Inverse Rendering with Near- and Far-field Light Sources
Fan Fei, Jiajun Tang, Ping Tan, Boxin Shi#
The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (Highlight), 2024
paper论文 /
code代码 /
poster海报 /
website项目主页 /
youtubeYouTube /
We use near-field lights, such as flashlights, as sources of lighting variation
to enhance both the practicality and the quality of multi-view inverse rendering.
利用手电筒等近场光源提供光照变化,从而提升多视角逆向渲染的实用性与质量。
|
|
SPLiT: Single Portrait Lighting Estimation Via a Tetrad of Face Intrinsics
Fan Fei*, Yean Cheng*, Yongjie Zhu, Qian Zheng, Si Li, Gang Pan, Boxin Shi#
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
paper论文 /
code代码 /
website项目主页 /
From a single portrait image, we estimate a tetrad of face intrinsics and uses
spherically distributed components to estimate lighting.
从单张人像图像出发,估计一组人脸本征属性,并利用分布到球面上的光照相关本征分量估计场景光照。
|
|