News

  • Our lab is featured on IEEE Spectrum together with other three NYU robotics teams!
  • We have a new opening for a PostDoc researcher in AI/Robotics in 2024! Come join us in our embodied AI research!
  • [05/2023] One paper accepted by RSS 2023.
  • [04/2023] Congratulations to Yuchen and Yaxuan for being accepted to PhD programs respectively at Purdue CORAL Lab and Stevens Institute of Technology.
  • [02/2023] Two papers are accepted by CVPR 2023.
  • [02/2023] Dr. Feng received the NSF Career Award under the Foundational Research in Robotics (FRR) program.
  • [02/2023] Dr. Feng will serve as the area chair for ICCV 2023.
  • [02/2023] We will organize the first coperception workshop at ICRA 2023.
  • [02/2023] Congratulations to Yuxiang for being accepted to PhD program at CUHK MMLab, to Guanbo for being accepted to PhD program at Rensselaer polytech, to Xinzhou for joining Horizon Robotics, to Sriharsha for interning in Tesla, to Rushi for interning in DEKA Research and Development, and to Fady for interning in Bell labs!
  • [01/2023] One paper is accepted by ICLR 2023.
  • [01/2023] Three papers are accepted by ICRA 2023.
  • [09/2022] One paper is accepted by the Conference on Robot Learning (CoRL).
  • [08/2022] Dr. Feng gave an invited seminar talk on 3D Deep Learning for Soft Robotics and Self-Driving at Vanderbilt University.
  • [05/2022] Yiming Li gave a talk about Collaborative and Adversarial 3D Perception for Autonomous Driving at C2SMART.
  • [05/2022] Congratulations to Hanwen Zhao for passing his Ph.D. qualifying exam!
  • [04/2022] Our ICRA'22 paper DeepParticleRobot has been selected as one of the three finalists for ICRA 2022 Outstanding Coordination Paper, congratulations to Jeremy, Erdong, and Yuchen!
  • [04/2022] Congratulations to Ruoyu Wang for passing his Ph.D. thesis defense!
  • [04/2022] Congratulations to Xinru Li for being accepted to Yale University for her MS study, and Ziyan An for being accepted into Vanderbilt University for her CSE Ph.D. study!
  • [03/2022] Dr. Feng will give a keynote talk on June 19th at the CVPR'22 workshop on Computer Vision in the Built Environment.
  • [03/2022] Dr. Feng gave a seminar talk at Rutgers ECE on “Self-Supervised Learning for Robotics: A Tale of Baymax and Wall-E”.
  • [03/2022] Congratulations to Irving Fang for getting internship offer at MERL and and Bharath Surianarayanan at Bell labs!
  • [02/2022] Two papers are accepted by CVPR 2022.
  • [02/2022] Congratulations to Uljad Berdica for winning the prestigious 2022 Rhodes Scholarship at University of Oxford!
  • [02/2022] Two papers are accepted by ICRA 2022.

Current Team

Senior Members

Chen Feng

Principle Investigator (PI) of the AI4CE group. One of Chen’s most ambitious academic dream is to enable robots like Wall-E and Baymax which could help humanity.

Chen Feng

Assistant Professor at NYU

Jing Zhang

Jing Zhang is a postdoctoral fellow. She received her B.E. in Wuhan University. Her research interest lies in 3D computer vision and the application of artificial intelligence in archaeology.

Jing Zhang

Postdoctoral Fellow

Quan Yin

Quan Yin, PHD in civil engineering, Visiting Research Scholar. Quan’s research focuses on reducing labor intensity, improving parameter accuracy, and reducing carbon emissions in the construction process of civil engineering by improving civil engineering machinery.

Quan Yin

Ph.D. Visiting Research Scholar in Civil Engineering

Xuchu Xu

Xuchu is a PhD student. His motto is “Stay hungry, Stay foolish” and wants to be a man from the future.

Xuchu Xu

Ph.D. Candidate in Mechanical Engineering

Wenyu Han

Wenyu is a PhD student. He received his B.Eng. in Dalian University of Technology and M.S. in Northwestern University. His research interest is reinforcement learning, computer vision, and their applications in robotics.

Wenyu Han

Ph.D. Candidate in Mechanical Engineering

Yiming Li

Yiming is a PhD student. He received his B.E. in Tongji University. His research interest is Robot Perception, Navigation and Machine Learning.

Yiming Li

Ph.D. Candidate in Mechanical Engineering

Hanwen Zhao

Hanwen is a PhD student. He received his B.S. from University of Colorado Boulder and M.S. from Columbia University. His research interests are Robotics and Artificial Intelligence.

Hanwen Zhao

Ph.D. Candidate in Mechanical Engineering

Chao Chen

Chao is a PHD student. He is interested in computer vision and robotics. His interest shaped him the sense of engineering to adapt rapidly to the study of computer science.

Chao Chen

Ph.D. Candidate in Computer Science

Anbang Yang

Anbang is pursuing a doctorate in AI4CE lab. Before chasing his Ph.D., he obtained a master’s degree from New York University and a bachelor’s degree from Dalian University of Technology. His research focuses on visual localization, navigation, and multi-view and sensor-based 3D reconstruction.

Anbang Yang

Ph.D. Candidate in Mechanical Engineering

Abdulaziz Mohammad Alaql

Born in Medina Saudi Arabia gained a bachelor’s degree in Computer science and then gained a master’s degree in Applied urban science and technology at NYU. His passion is in IoT applications and smart city technologies. Currently part of PhD Urban Systems program.

Abdulaziz Mohammad Alaql

Ph.D. Candidate in Urban Systems

Ruixuan Zhang

Ruixuan is a Ph.D. student. He is co-advised by Prof.Kaan Ozbay. He received his B.Eng. from Harbin Institute of Technology and M.S. from University of Michigan, Ann Arbor. His research interest lies in cooperative driving automation and intelligent transportation systems.

Ruixuan Zhang

Ph.D. Candidate in Transportation Engineering

Bilal Sher

Bilal has an MS in Civil Engineering from NYU, and a BSc. from the University of Calgary. He is passionate about using technologies such as computer vision and deep learning to solve civil engineering problems.

Bilal Sher

Founder and CEO of Building Diagnostic Robotics, Inc.

Diwei Sheng

Diwei is an Ph.D. student in computer science. His research interests are artificial intelligence and computer vision. He is doing research on visual place recognition.

Diwei Sheng

Ph.D. Student in Computer Science

Irving Fang

Irving is a Ph.D. student from the CSE department. He did his undergraduate at UC Berkeley majoring in Data Science and Math. His research interests lie at the intersection of robotics, vision, and machine learning.

Irving Fang

Ph.D. Student in CSE

Juexiao Zhang

Juexiao Zhang is a Ph.D. student at the Courant Institute majoring in Computer science. He obtained his BS in EE from Tsinghua University. He is interested in machine learning, especially building AI systems that can efficiently learn representations from multimodal signals.

Juexiao Zhang

Ph.D. Student in Computer Science

Liangyan Li

Liangyan Li is a visiting Ph.D. student in Computer Science, currently pursuing her doctoral degree in Electrical and Computer Engineering at McMaster University. She received her M.E. from Tianjin University of Science and Technology. Her research direction focuses on Image Compression for Machines and Model Compression for Large Language Models.

Liangyan Li

Visiting Ph.D. Student in Computer Science

Sihang Li

Sihang Li is a Ph.D student in M.E in Tandon School of Engineering. He received his B.E. in Tongji University. His research interests are Robot Perception, autonomous driving and Machine Learning.

Sihang Li

Ph.D. Student in Mechanical Engineering

Xinhao Liu

Xinhao is a Ph.D student in Computer Science. He received his B.Sc. degree from NYU and NYU Shanghai. His research interest is 3D perception and human-like navigation.

Xinhao Liu

Ph.D. Student in Computer Science

Junior Members

Aabid Patel

I am Aabid Patel, pursuing a Master’s in Mechatronics and Robotics Engineeing at NYU Tandon. My research interests are Perception and Navigation for Autonomous Vehicles, Decision and Behavorial Planning, and Computer Vision in mobile robotics. Currently, I am working on Autonomous Vehicle model on Carla Simulator.

Aabid Patel

M.S. in Mechatronics and Robotics Engineering

Aarav Pandya

Hi, I am Aarav, pursuing MS in computer engineering at NYU. I am interested in computer vision and reinforcement learning, with my current research at AI4CE focusing on deepmapping and point cloud registration. I am passionate about applying AI in automation, especially robotics and software assistants. I also like to study ethics and implications of AI. When I am not working on AI, I like to play soccer and chess.

Aarav Pandya

M.S. in Computer Engineering

Fady Algyar

I am a Master’s candidate in Robotics at NYU and a member of the AI4CE lab. My research focuses on 3D computer vision, point cloud registration, sensor fusion, structure from motion, and visual positioning systems. As an intern at Bell Labs, I am gaining hands-on experience in cutting-edge research and development. I am passionate about developing autonomous and effective robots and contributing to the advancement of the field.

Fady Algyar

M.S. in Robotics

Luoyao Chen

Luoyao is a first-year Master’s student at the Center of Data Science. Before NYU, she obtained her bachelor’s degree at the University of Minnesota, Twin Cities, with a Bachelor of Science in Statistics and Mathematics.

Her research interests are mainly in 2 domains: computer vision using deep learning, and, as you might imagine, data science!

Luoyao Chen

M.S. in Data Science

Mohit Mehta

Mohit is an MS student in Computer Science at NYU Tandon. His research interests are 3D computer vision, Autonomous Vehicles, NeRF, and Reinforcement Learning

Mohit Mehta

M.S. in Computer Science

Satyapalsinh Gohil

My research passion lies in the intersection of 3D computer vision and Deep Learning. I am currently focused on the development of learning-based Point Cloud Registration techniques, to enhance Indoor Navigation Systems.

Satyapalsinh Gohil

M.S. in Robotics

Shuhang Ge

I’m a master student at NYU Tandon in the ECE department. My research interest lies on 3D computer vision, and human–computer interaction

Shuhang Ge

M.S. in Electrical and Computer Engineering

Sruti Madhusudhan

I am currently pursuing a masters degree in Mechatronics and Robotics. My interests include reinforcement learning and SLAM techniques.

Sruti Madhusudhan

M.S. in Mechatronics and Robotics

Taarun Srinivas

Hello! I am Taarun Srinivas and currently pursuing masters in Mechatronics and Robotics at NYU Tandon. Deep Learning, Computer Vision, and robotic applications that involve AI techniques are my areas of focus. I love exploration and one of my visions is to explore the unexplored avenues of deep learning and contribute more to the research community.

Taarun Srinivas

M.S. in Mechatronics and Robotics Engineering

Weicheng Dai

Weicheng Dai is a masters’ student in computer science. His research interests are computer vision and machine learning.

Weicheng Dai

M.S. in Computer Science

Xinran Tang

Xinran Tang is a MS student in Computer Engineering at NYU Tandon. She did her undergraduate at UNNC in Computer Science. Her research interests are computer vision, machine learning and edge computing.

Xinran Tang

M.S. in Computer Engineering

Zegang Cheng (Hooley)

Hi. I’m Zegang, a research assistant in the AI4CE Lab headed by Prof. Chen Feng and a graduated Master’s student in Computer Science from New York University. My area of interests are self-supervised/unsupervised deep learning methodology and model structure design. Currently, I am working on “visual place recognition using temporal sequential images”, “detecting interesting points on panoramic images”, and “generating global features with MAE”.

Zegang Cheng (Hooley)

M.S. in Computer Science

Zhiheng Li

Zhiheng is an undergraduate student from Tandon Electrical and Computer Engineering major. His research and career interests lie in the fields of medical engineering, autonomous vehicle, and computer vision.

Zhiheng Li

B.S. in Electrical and Computer Engineering

Zonglin Lyu

Zonglin is a M.S. student in Courant CS Department. He is interested in learning-based computer vision.

Zonglin Lyu

M.S. in Computer Science

Zijun Wang

Zijun’s research and career interests lie in the fields of autonomous vehicle, machine learning and computer vision.

Zijun Wang

B.S. in Mathematics and Computer Science Double Major

Aditya Wagh

👋 Hi. I’m Aditya, a researcher in the AI4CE Lab at New York University headed by Prof. Chen Feng. My area of interest is 3D Vision + AI. Currently, I am working on improving unsupervised point cloud registration which is a key task in LiDAR based 3D Reconstruction, Mapping and Autonomous Navigation. I am also excited about Geometric Deep Learning, Probalistic Machine Learning, Continual learning, Generative Models, NeRFs (Neural Radiance Fields) and their applications in core 3D vision areas like AR, SLAM and SfM.

Aditya Wagh

M.S. in Electrical and Computer Engineering

Alex(Yu) Yan

Alex is an NYU Tandon undergraduate student majoring in computer science. He is interested in computer vision and machine learning.

Alex(Yu) Yan

B.S. in Computer Science

Alvaro Altamirano Visoso

Alvaro is an undergraduate Mechanical Engineer student with minors in CS and Robotics at NYU Tandon School of Engineering. His main research interests are in computer vision, machine learning, soft robotics and artificial intelligence.

Alvaro Altamirano Visoso

B.S. in Mechanical Engineering

Ammaar Firozi

Ammaar is an undergraduate computer science student at NYU. His interests include computer vision, adversarial machine learning, and software engineering.

Ammaar Firozi

B.S. in Computer Science

Ankush Pratap Singh

Ankush Pratap is a master’s student in Computer Engineering at NYU. His research interests include (but are not limited to) Computer Vision, Deep Neural Networks, GANs, and Recommender Systems. He loves traveling and playing cricket.

Ankush Pratap Singh

M.S. in Computer Engineering

Arthur Ibanda

Arthur is a Masters student in Mechatronics and Robotics at NYU. He received a BEng in Electrical and Mechanical Engineering from The University of Edinburgh. His research interests are in Machine Learning, Computer Vision and Robotics.

Arthur Ibanda

M.S. in Mechatronics and Robotics

Asawari Badkundri

Hi! I’m Asawari, a researcher at NYU’s AI4CE Lab under the guidance of Prof. Chen Feng. I’m currently enrolled in the M.S. program in Computer Engineering at NYU, and my research centers on 3D Vision + AI. More precisely, I’m dedicated to enhancing unsupervised point cloud registration techniques, with applications in Medical Imaging.

Asawari Badkundri

M.S. in Computer Engineering

Ashay Ajbani

I am currently pursuing my Masters in Mechatronics and Robotics at NYU Tandon. My passion lies in Robot Perception, specifically in the fields of Computer Vision and Deep Learning. In my free time, I enjoy playing cricket.

Ashay Ajbani

M.S. in Mechatronics and Robotics

Ashiq Rahman Anwar Batcha

I am Ashiq Rahman, pursuing a Masters in Mechatronics and Robotics Engineering at NYU Tandon. My vision is to explore uncharted territories in robotics and contribute to research domain. My research interests are localization and navigation for autonomous vehicles, perception, and computer vision in mobile robotics. Currently, I am working on Video Visual Place Recognition.

Ashiq Rahman Anwar Batcha

M.S. in Mechatronics and Robotics

Benchik Bayor

Operations Development Chair, Institute of Electrical and Electronics Engineers Brother’s Outreach Chair, Black Muslim Initiative Secretary Chair, Tandon School of Engineering National Society of Black Engineers

Benchik Bayor

B.S. in Electrical and Computer Engineering

Chuanyang Jin

Chuanyang is an NYU undergraduate student majoring in Computer Science and Mathematics. His interests are machine learning and computer vision.

Chuanyang Jin

B.S. in Computer Science and Mathematics

Dekun Ma

Dekun is an undergraduate student at NYU CAS, majoring in Computer Science and Data Science. His interest lies in Computer Vision and Software Engineering.

Dekun Ma

B.A. in Computer Science and Data Science

Dongni(Hellen) Luo

Hellen is a student at Stuyvesant High School. She is interested in astronomy, astrophysics, deep neural networks, and computer vision.

Dongni(Hellen) Luo

High School student

Idan Lau

I am currently pursuing a BS in Computer Science and a Minor in Mathematics at NYU Tandon School Of Engineering. My interests include Backend Programming, Data Science/Machine Learning and Computer Networking

Idan Lau

B.S. in Computer Science

Jiali Xu

Jiali is a fourth year student at NYU Tandon majoring in Computer science. Her research interests are AI, computer vision, and machine learning.

Jiali Xu

B.S. in Computer science

Junyang Tang

Junyang Tang is an Undergraduate student at NYU Tandon, majoring in Electrical Engineering. His research interests are embedded systems, robotics, automation, circuits, microcontrollers, electronics and semiconductors.

Junyang Tang

B.S. in Electrical Engineering

Keifer Lee

Keifer is a master student at NYU Tandon in the ECE department. He received his bachelors degree in Electrical and Electronics Engineering at Taylor’s University. His research interests lie in the intersection of Machine Learning, Computer Vision and Meta-Learning.

Keifer Lee

M.S. in Computer Engineering

Kevin Lee

Kevin is a BS/MS student from NYU Tandon majoring in Computer Science. His interests are in various Machine Learning and AI topics, though his current focus is in Computer Vision.

Kevin Lee

M.S. in Computer Science

Naveen Kumar

Naveen Kumar, MS in Mechatronics and Robotics, Naveen Kumar is doing his MS thesis under the supervision of Dr. Chen Feng, his thesis is in a Startup named “Building Diagnostic Robotics Inc.” based on AI4CE resources. Before coming to NYU, he has worked in Robotics Lab at IIT Jodhpur and He has completed his summer internship in VIM Networks in which he made a robot that can mount optical fiber in the drainage pipe.

Naveen Kumar

M.S. in Mechatronics and Robotics

Nayan Sarode

I am Nayan Sarode, an aspiring engineer specializing in Mechatronics, Robotics, and Automation Engineering.Currently pursuing my Master’s degree at New York University (NYU), I’m set to graduate in 2024. My area of interest lies in Autonomous vehicle field. With a strong foundation in Mechanical Engineering from Dr. Babasaheb Ambedkar Technological University, India, I possess a diverse skill set including proficiency in software tools like SolidWorks, MATLAB, ROS, and programming in Python and C++. Projects like creating an autonomous warehouse inventory robot and designing an autonomous floor cleaning robot showcase my hands-on expertise. I’ve also conducted research on electric mobility challenges in India and even filed a patent for energy-generating shock absorber shoes. With a passion for innovation and a commitment to excellence, I am eager to contribute my skills to dynamic projects and teams in the field of robotics and automation.

Nayan Sarode

M.S. in Mechatronics and Robotics

Nico Harris-de La Tour

Nico is a Masters Student in Mechatronics and Robotics at NYU. He received his BS in Mechanical Engineering from Northeastern University. His main interests are Deep Learning, Computer Vision, and Robotics

Nico Harris-de La Tour

M.S. in Mechatronics and Robotics

Nobel Dang

I am a master’s student in CS at NYU Tandon interested in Computer Vision and Deep Learning. Always looking forward to working and collaborating on interesting projects!

Nobel Dang

M.S. in Computer Science

Pratham Mehta

Pratham Mehta is Masters student in Computer Engineering. His research work in past included about Currency Detection for Impaired Users, Abstractive text summarization uses the Pegasus model,and Sanitizing of Differential Privatized Data Models. He is currently researching in Ai4CE lab. His research interests are in Computer Vision, Natural Language Processing, Artificial Intelligence and Cloud Computing.

Pratham Mehta

B.S. in Computer Science

Prithvi Dev KV

Prithvi recently graduated with MS in Mechatronics & Robotics. He has been part of the FRST Challenge and has worked on UWB Localisation projects. Currently he is working on the Emboddied AI Project of the VIP Self Drive Team. He completed his undergrad in Mechanical Engineering and his interests are towards mechatronics and hardware aspects of the robot.

Prithvi Dev KV

M.S. in Mechatronics and Robotics

Rushi Shah

Rushi is a MS student in Mechatronics and Robotics Engineering at NYU Tandon School of Engineering. His research interests are Autonomous Navigation and Robot Perception. And he’s always up for playing some Badminton!

Rushi Shah

M.S. in Mechatronics and Robotics Engineering)

Shangdong Yang

Shangdong is a MS student in Mechatronics and Robotics at NYU Tandon. He did his undergraduate at SCUT in Automation. His research interests are mobile robotics, robot perception and biorobotics.

Shangdong Yang

M.S. in Mechatronics and Robotics

Shubham Gupta

I am a Master’s in Computer Engineering student at NYU Tandon. I work with Dr. Chen Feng on Neural Radiance Fields and efficient VPR for mobile computing. I also work with Dr. Laure Zanna at M2LInES as a research assistant. I lead the Computer Vision team at NYU Robomasters.

Shubham Gupta

M.S. in Computer Engineering

Sizhe Wei

Sizhe Wei, a visiting research student, is currently pursuing a Master’s in Electrical Engineering at Shanghai Jiao Tong University, after earning his B.E. in 2021. His research centers on multi-agent collaborative perception for improving teamwork among self-driving vehicles and robotics.

Sizhe Wei

Visiting Research Student

Somik Dhar

Somik is a MS student from the ECE department. His research interests lie at the intersection of robotics, vision, and controls.

Somik Dhar

M.S. in Electrical and Computer Engineering

Sudharsan Ananth

Sudharsan Ananth is a Master’s student at New York University in Mechatronics and Robotics. His research interests are computer vision for autonomous vehicles, Deep Learning, and Robot perception.

Sudharsan Ananth

M.S. in Mechatronics and Robotics

Taiyi Pan

Taiyi is a M.S. student in Mechatronics and Robotics at NYU Tandon School of Engineering. His research interests are computer vision, deep neural networks, and event cameras. He loves to travel and to read, and is always ready for an adventure.

Taiyi Pan

M.S. in Mechatronics and Robotics

Tim Guo

Tim (Qinsong) Guo an undergraduate student majoring in mechanical engineering. He likes playing the piano, running, and gaming with friends. In AI4CE, he is a member of the DeepSoRo group and NYU Selfdrive, focusing on soft robotics, machine learning, and hardware controls.

Tim Guo

B.S. in Mechanical Engineering

Vickram Peter

Vickram is a Graduate Student at NYU Center for Urban Science and Progress, MSc. Applied Urban Science and Informatics Program. He wants to make cities better for everyone using tech in an equitable and humanist policy-driven way.

Vickram Peter

M.S. in Applied Urban Science and Informatics

Wei Xia

Wei is currently a junior student majoring in Computer Science and minoring in Maths at NYU. Her research interests are machine learning and computer vision.

Wei Xia

B.S. in Computer Science

Xuefei Yu

Xuefei Yu is a MS student in Mechatronics and Robotics at NYU Tandon. He did his undergraduate at SJSU in Computer Engineering. His research interests are Proprioceptive and tactile sensing for Soft Actuators, Embedded Systems, Manipulation in robotic arms, and Perception in Mobile Robotics.

Xuefei Yu

M.S. in Mechatronics and Robotics

Yifan Wang

Yifan is a master student at NYU Tandon in the ECE department. He received his bachelor degree in USTC majoring in computer science. His research interests are human–computer interaction, deep learning and computer vision.

Yifan Wang

M.S. in ECE

Yilin Zhao

Yilin is a senior majoring CS at NYU Tandon. She is interested in computer vision, machine learning, deep learning and data science.

Yilin Zhao

B.S. in Computer science

Yuchen Liu

I am a junior student major in computer science studying at New York University. My focus is software engineering and game development. I am developing a 3D AI browser in AI4CE Lab at NYU.

Yuchen Liu

M.S. in Computer Science

Ziqin Yuan

A M.S. student in Mechatronics and Robotics. His research interest is Human-Robot Interaction. He loves to travel and to read.

Ziqin Yuan

M.S. in Mechatronics and Robotics

Recent Publications

*
LiDAR-based 4D Occupancy Completion and Forecasting
Among Us: Adversarially Robust Collaborative Perception by Consensus
SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Driving
Collaborative Multi-Object Tracking with Conformal Uncertainty Propagation
Metric-Free Exploration for Topological Mapping by Task and Motion Imitation in Feature Space
Toward Zero-Shot Sim-to-Real Transfer Learning for Pneumatic Soft Robot 3D Proprioceptive Sensing
DeepMapping2: Self-Supervised Large-Scale LiDAR Map Optimization
VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completion
Learning Simultaneous Navigation and Construction in Grid Worlds
Uncertainty Quantification of Collaborative Detection for Self-Driving
Multi-Robot Scene Completion: Towards Task-Agnostic Collaborative Perception
Self-Supervised Visual Place Recognition by Mining Temporal and Feature Neighborhoods
V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Driving
Self-supervised Spatial Reasoning on Multi-View Line Drawings
Egocentric Prediction of Action Target in 3D
A Deep Reinforcement Learning Environment for Particle Robot Navigation and Object Manipulation
Deep Weakly Supervised Positioning for Indoor Mobile Robots
Learning Distilled Collaboration Graph for Multi-Agent Perception
NYU-VPR: Long-Term Visual Place Recognition Benchmark with View Direction and Data Anonymization Influences
Mobile 3D Printing Robot Simulation with Viscoelastic Fluids
Mobile projective augmented reality for collaborative robots in construction
Projector-Guided Non-Holonomic Mobile 3D Printing
Simultaneous Navigation and Construction Benchmarking Environments
Fooling LiDAR Perception via Adversarial Trajectory Perturbation
3D Point Cloud Processing and Learning for Autonomous Driving: Impacting Map Creation, Localization, and Perception
A scene-adaptive descriptor for visual SLAM-based locating applications in built environments
LUVLi Face Alignment: Estimating Landmarks' Location, Uncertainty, and Visibility Likelihood
Real-time Soft Body 3D Proprioception via Deep Vision-based Sensing
Regularizing Neural Networks via Minimizing Hyperspherical Energy
SPARE3D: A Dataset for SPAtial REasoning on Three-View Line Drawings
Deep unsupervised learning of 3D point clouds via graph topology inference and filtering
An assistive low-vision platform that augments spatial cognition through proprioceptive guidance: Point-to-Tell-and-Touch
An Occupancy Grid Mapping enhanced visual SLAM for real-time locating applications in indoor GPS-denied environments
DeepMapping: Unsupervised Map Estimation From Multiple Point Clouds
VLASE: Vehicle Localization by Aggregating Semantic Edges
Simultaneous Edge Alignment and Learning
Mining Point Cloud Local Structures by Kernel Correlation and Graph Pooling
FoldingNet: Point cloud auto-encoder via deep grid deformation
Fast Resampling of Three-Dimensional Point Clouds via Graphs
FasTFit: A fast T-spline fitting algorithm
Direct Multichannel Tracking
CASENet: Deep Category-Aware Semantic Edge Detection
Deep Active Learning for Civil Infrastructure Defect Detection and Classification
Camera marker networks for articulated machine pose estimation
Fast plane extraction in organized point clouds using agglomerative hierarchical clustering
Point-plane SLAM for hand-held 3D sensors

Datasets

NYU-VPR
Composed of images recorded in Manhattan, New York from April 2016 to March 2017. The images were recorded by cameras installed on the front, back, and side parts of taxis with auto-exposure.
View Details
V2X-Sim
A Virtual Collaborative Perception Dataset and Benchmark for Autonomous Driving
View Details
SNAC
Simultaneous Navigation and Construction Benchmarking Environments
View Details
RealCity3D
A Large-scale Georeferenced 3D Shape Dataset of Real-world Cities
View Details
SPARE3D
Contains three types of 2D-3D reasoning tasks on view consistency, camera pose, and shape generation, with increasing difficulty
View Details
EgoPAT3D
An Egocentric Action Target Prediction Dataset
View Details

Teaching

We offer the following courses at NYU across multiple departments:
 
 
 
 
 
ROB-GY 6203 Robot Perception
Every Fall (since 2018) Graduate
 
 
 
 
 
ROB-UY 3203 Robot Vision
Every Spring (since 2020) Undergraduate
 
 
 
 
 
NYU Self-Drive (VIP)
Every Semester (since 2019)
 
 
 
 
 
Machine Learning for MAE/Robotics
2020 Summer Graduate
 
 
 
 
 
Emerging Information and Automation Technologies
2019 Spring Graduate

Funding Sources

We are very grateful for the funding supports from the following agencies, organizations, and companies:

Contact

  • cfeng at nyu dot edu
  • 4th floor, RH409, 6 MetroTech Center, New York University, NY 11201
  • Email to book an appointment