We introduce Humanoid Transformer with Touch Dreaming (HTD), which includes future hand-joint-force prediction and EMA-supervised tactile-latent prediction for versatile humanoid manipulation. We develop a whole-body humanoid manipulation system that combines VR teleoperation with an RL-based whole-body controller. We evaluate five humanoid manipulation tasks spanning insertion, rigid-object reorientation, deformable-object handling, tool use, and bimanual loco-manipulation.
Towards Autonomous Robot-Assisted Minimally Invasive Surgery: a Dexterous Wristed Robotic Kit (DWRK) for Surgical Tasks
Qiming Wu, Xinbo Chen, Binghong Chen, Fanghao Wang, Sibo Hao, Mingchuan Zhou, Limin Zeng abstract
We introduce Dexterous Wristed Robotic Kit(DWRK), designed for autonomous robot-assisted minimally invasive surgery. DWRK provides a reliable modular platform with high dexterity for performing surgical manipulation tasks, enabling data-driven learning approaches toward full surgical autonomy. We implement several benchmark imitation learning algorithms based on this platform.
We proposed a Transformer-based RL framework to help microgripper navigate within a constrained environment with lots of dynamic obstacles and capture the dynamic target. We adopt virtual lidar information for robust perception and use Transformer to extract spatial and temporal information. We propose a deterministic velocity obstacle (DVO), an improved variant of the velocity obstacle (VO), where the sampling process is replaced with odometry-based computation to provide guidance during RL training.
Education
Carnegie Mellon University
M.S. in Mechanical Engineering
Expected 2027
University of Hongkong
Visiting Student
2024.7 - 2024.10
Zhejiang University
B.Eng. in Agricultural Engineering
2021.9 - 2025.6
Working Experience
BOSCH
Robot Learning Research Intern
2026.6 - Present
Dessight Biomedical Company
Research Intern
2025.4 - 2025.7
Personal Projects
A Fast Reinforcement Learning Approach for Fault Tolerant Control of Quadrotorabstract
Trained a small drone to stabilize and track trajectory with a completely fault rotor via RLtools, a C++ RL library for accelerating the training process. It succeeded in simulation but failed in reality.
Student Agricultural Robotics Competitions First Place Award in 2024 ASABE Student Robotics Competition, Anaheim, USA Second Prize in China Agricultural Robot Competition, Wuhan, China abstract
I am mainly responsible for mechanical design of the end-effectors and building controller for navigation and specific motion.