Profiling a Frontier Agent with EBench: From Direct Control to Harness with Policy
Evaluating a frontier agent on EBench under direct robot control and with a harness that can invoke post-trained robot policies.
I am a Research Engineer in Robotics at Shanghai AI Laboratory. I am interested in how offline and agentic reinforcement learning can help embodied agents learn robotic manipulation.
I received my M.Sc. in Control Science and Engineering from Shanghai Jiao Tong University in 2026, where I was advised by Prof. Jun-Guo Lu. My recent work includes actor-free zero-shot RL and memory evolution for embodied agents, alongside embodied agent evaluation and world-action models. I also continue to work on humanoid control: ARIEL builds on my earlier GBC work with demonstration-conditioned execution memory.
I am currently studying how embodied agents learn from experience: transferring a frontier agent’s robot interaction experience to an open model through staged SFT and RL, from visual grounding to closed-loop manipulation.
I am looking for PhD opportunities in robotics and embodied AI. Please feel free to get in touch.
Our EBench report is on arXiv, studying direct robot control and an agent harness with post-trained policies.
PICA-WAM is on arXiv: learning visual perturbation invariance for world action models.
Collaborative technical reports InternW0 and InternW0-Δ are available.
InfCoiL accepted to NeurIPS 2026 — coordinated planning and control for physical human-object interaction.
* Equal contribution (co-first authors).
Evaluating a frontier agent on EBench under direct robot control and with a harness that can invoke post-trained robot policies.
Cross-appearance self-alignment encourages world action models to produce consistent action representations under task-irrelevant visual changes.
A world action model combining predictive dynamics, semantic guidance, and geometric priors, pretrained on more than 20,000 hours of open data.
An asymmetric video-action architecture couples future visual dynamics with continuous robot control, supporting asynchronous prediction and contact-aware interaction.
Accepted
Make generated motion executable. InfCoiL lets a flow-matching planner and a physics-based controller improve each other through shared rollout feedback, alternating their RL updates when progress plateaus.
Vision-driven mobile manipulation through active exploration, visual grounding, and interactive intent disambiguation, with a shared interface for simulation and real robots.
Length-adaptive proximal policy optimization with reinforcement learning from human feedback for non-uniform UAV control.
An open-source pathway from human motion to humanoid action: differentiable retargeting, DAgger-MMPPO, and an Isaac Lab training workflow.
In progress
How can an open model learn to act from a frontier agent’s experience? I am studying the transfer of Astra’s robot interaction experience to Qwen3.8-27B through staged SFT and reinforcement learning, connecting visual grounding, short manipulation skills, and long-horizon tasks.
In development
ARIEL gives an agent a simple interface to whole-body control. Choose a demonstration, load it into memory, then recall the motion or steer its style with velocity and heading commands. The controller keeps executing between agent decisions.
arXiv release pending
An embodied agent learns from execution experience by refining text memory across training episodes, then uses frozen memory at evaluation without updating model weights.
Manuscript in preparation
Given an existing policy, ABI trains only a reusable guide. The guide improves task execution at deployment while the policy stays frozen, with no parameter updates or task-specific policy post-training.