Mutian Tong

I'm currently a research assistant at CIS, University of Pennsylvania, under the supervision of Professor Jiatao Gu and Professor Lingjie Liu. Previously, I finished my undergraduate study at Columbia College, Columbia University in New York with a degree in Mathematics and Computer Science. I was fortunate enough to be advised by Professor Changxi Zheng at Columbia Computer Graphics Group, where I also learnt a lot from Dr. Rundi Wu. My research interestes include 3D/4D World Modeling, Video Generation, and Vision for embodied tasks.
You are welcome to contact me at email

Research

PointAction bridges the gap between generative video models and robust robot control by jointly predicting RGB frames and dynamic 3D pointmaps, which serve as a universal, geometry-aware action interface.

A method for recovering dynamic 3D indoor lighting from a video by learning a light field with help from a 2D diffusion model.

Miscellanea

• I like listening to classical music when I'm at work or not; my favorite composers are Gustav Mahler and Franz Schubert.
• I'm also into hiking and exploring different national parks when I have time; my favorite NP is Arches.