{"id":1175827,"date":"2026-06-17T03:16:12","date_gmt":"2026-06-17T10:16:12","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-blog-post&#038;p=1175827"},"modified":"2026-06-17T09:59:06","modified_gmt":"2026-06-17T16:59:06","slug":"object-centric-residual-rl","status":"publish","type":"msr-blog-post","link":"https:\/\/www.microsoft.com\/en-us\/research\/articles\/object-centric-residual-rl\/","title":{"rendered":"Object-Centric Residual RL for Zero-Shot Sim-to-Real VLA Enhancement"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><em>By\u00a0Kinam Kim, <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/namikosaito\/\" type=\"person\" id=\"43853\">Namiko Saito<\/a>, <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/heecheolkim\/\" type=\"person\" id=\"43949\">Heecheol Kim<\/a>, Katsushi Ikeuchi, Jaegul Choo and <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/yamatsushita\/\" type=\"person\" id=\"43707\">Yasuyuki Matsushita<\/a><\/em><\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<div class=\"yt-consent-placeholder\" data-video-id=\"w7h9SH8vCYI\" data-poster=\"https:\/\/i.ytimg.com\/vi\/w7h9SH8vCYI\/hqdefault.jpg\" style=\"background-image:url(https:\/\/i.ytimg.com\/vi\/w7h9SH8vCYI\/hqdefault.jpg)\"><iframe aria-hidden=\"true\" tabindex=\"-1\" title=\"Object-Centric Residual RL: MSR Blogpost Video\" width=\"500\" height=\"281\" data-src=\"https:\/\/www.youtube-nocookie.com\/embed\/w7h9SH8vCYI?feature=oembed&rel=0&enablejsapi=1\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><div class=\"yt-consent-placeholder__loading\" aria-hidden=\"true\"><svg viewBox=\"0 0 48 48\" focusable=\"false\"><circle cx=\"24\" cy=\"24\" r=\"19\"><\/circle><\/svg><\/div><div class=\"yt-consent-placeholder__overlay\" hidden><button class=\"yt-consent-placeholder__play\"><svg width=\"42\" height=\"42\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" aria-hidden=\"true\" focusable=\"false\"><g fill=\"none\" fill-rule=\"evenodd\"><circle fill=\"#000\" opacity=\".556\" cx=\"21\" cy=\"21\" r=\"21\"\/><path stroke=\"#FFF\" d=\"M29 21l-12 8.5v-17z\"\/><\/g><\/svg><span class=\"yt-consent-placeholder__label\">Video playback requires cookie consent<\/span><\/button><\/div><\/div>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"introduction\">Introduction<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"434\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-17-1024x434.png\" alt=\"teasor\" class=\"wp-image-1176054\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-17-1024x434.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-17-300x127.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-17-768x326.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-17-1536x652.png 1536w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-17-240x102.png 240w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-17.png 1862w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">A residual RL policy learns purely in simulation from object-centric state. Then, we add it to a frozen base VLA, and it transfers zero-shot to the real robot.<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Vision-Language-Action (VLA) models enable broad manipulation capabilities by leveraging large-scale pretraining and robot demonstrations. However, imitation learning can cause small execution errors to accumulate over time, pushing the robot into states that demonstrations did not cover well.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Therefore, we present an&nbsp;object-centric residual reinforcement learning&nbsp;framework that enhances a frozen base VLA without real-world RL. We train a lightweight residual policy entirely in simulation and condition it on object-centric state, proprioception, and the base VLA action rather than raw images. As a result, this observation interface lets the residual transfer zero-shot to the real robot while avoiding the visual sim-to-real gap that affects image-based residuals.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Across five real-robot manipulation tasks, the simulation-trained residual improves average real-robot success from 42% to 76%. In addition, we show that successful residual-corrected rollouts can retrain the base VLA, enabling a self-improvement loop without additional teleoperation.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"method\">Method<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"322\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-14-1024x322.png\" alt=\"object-centric residual RL pipeline\" class=\"wp-image-1175989\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-14-1024x322.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-14-300x94.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-14-768x241.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-14-1536x483.png 1536w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-14-2048x643.png 2048w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-14-240x75.png 240w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Overview of the object-centric residual RL pipeline.<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Stage 1 : <\/strong>Paired Sim\/Real VLA via Teleoperation Replay.&nbsp;We start from a VLA trained on real-robot demonstrations, then replay the same teleoperation actions in simulation to train a simulation counterpart. Because identical action trajectories supervise both the real and simulated VLAs, their action distributions remain aligned despite different visual domains.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Stage 2 :<\/strong> Object-Centric Residual RL.&nbsp;Next, we train the residual policy in simulation on a compact observation consisting of 6-DoF task-relevant object poses, proprioception, and the current base VLA action. Pose noise injection and pose dropout make the residual robust to real-world pose-estimation errors.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Stage 3 :<\/strong> Zero-Shot Real Deployment.&nbsp;Finally, at deployment, the real VLA replaces the simulated VLA, and we add the same residual to the base action at every timestep. Since the residual does not observe images, the simulation need not look visually realistic; moreover, deployment requires no real-world RL, distillation, or residual-policy fine-tuning.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"real-robot-comparison\">Real-Robot comparison<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The following videos demonstrate our real-world robot experiments. The baseline VLA fails in the video on the left, whereas the residual framework successfully completes the task on the right.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"cube-lift\">Cube Lift<\/h3>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-8f761849 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"480\" height=\"271\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/lift_base-2.gif\" alt=\"object-centric residual RL - lift base\" class=\"wp-image-1176025\"\/><figcaption class=\"wp-element-caption\">Base VLA<\/figcaption><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"480\" height=\"271\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/lift_resid-1.gif\" alt=\"object-centric residual RL - lift resid\" class=\"wp-image-1176028\"\/><figcaption class=\"wp-element-caption\">Base VLA + Residual<\/figcaption><\/figure>\n<\/div>\n<\/div>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"pick-and-place\">Pick and Place<\/h3>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-8f761849 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"480\" height=\"271\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/pnp_base-1.gif\" alt=\"object-centric residual RL - pnp base\" class=\"wp-image-1176029\"\/><figcaption class=\"wp-element-caption\">Base VLA<\/figcaption><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"480\" height=\"271\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/pnp_resid-1.gif\" alt=\"object-centric residual RL - pnp resid\" class=\"wp-image-1176032\"\/><figcaption class=\"wp-element-caption\">Base VLA + Residual<\/figcaption><\/figure>\n<\/div>\n<\/div>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"stack-cube\">Stack Cube<\/h3>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-8f761849 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"480\" height=\"271\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/stack_base-1.gif\" alt=\"object-centric residual RL - stack base\" class=\"wp-image-1176033\"\/><figcaption class=\"wp-element-caption\">Base VLA<\/figcaption><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"480\" height=\"271\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/stack_resid-1.gif\" alt=\"object-centric residual RL - stack resid\" class=\"wp-image-1176036\"\/><figcaption class=\"wp-element-caption\">Base VLA + Residual<\/figcaption><\/figure>\n<\/div>\n<\/div>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"stand-cup-up\">Stand Cup Up<\/h3>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-8f761849 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"480\" height=\"271\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/cup_base-1.gif\" alt=\"object-centric residual RL - cup base\" class=\"wp-image-1176019\"\/><figcaption class=\"wp-element-caption\">Base VLA<\/figcaption><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"480\" height=\"271\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/cup_resid-1.gif\" alt=\"object-centric residual RL - cup resid\" class=\"wp-image-1176020\"\/><figcaption class=\"wp-element-caption\">Base VLA + Residual<\/figcaption><\/figure>\n<\/div>\n<\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"main-results\">Main results<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Success rates in simulation and real-robot evaluation. We report simulation results as mean \u00b1 standard deviation over three seeds. Meanwhile, real-robot results report successes out of 20 trials.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><th class=\"has-text-align-center\" data-align=\"center\">Task<\/th><th class=\"has-text-align-center\" data-align=\"center\">Simulation base<\/th><th class=\"has-text-align-center\" data-align=\"center\">Simulation + residual<\/th><th class=\"has-text-align-center\" data-align=\"center\">Real robot base<\/th><th class=\"has-text-align-center\" data-align=\"center\">Real robot + residual<\/th><\/tr><\/thead><tbody><tr><td class=\"has-text-align-center\" data-align=\"center\">Cube Lift<\/td><td class=\"has-text-align-center\" data-align=\"center\">4.3 \/ 20 \u00b1 0.6<\/td><td class=\"has-text-align-center\" data-align=\"center\">20.0 \/ 20 \u00b1 0.0<\/td><td class=\"has-text-align-center\" data-align=\"center\">7 \/ 20<\/td><td class=\"has-text-align-center\" data-align=\"center\">17 \/ 20<\/td><\/tr><tr><td class=\"has-text-align-center\" data-align=\"center\">Pick-and-Place<\/td><td class=\"has-text-align-center\" data-align=\"center\">7.0 \/ 20 \u00b1 2.6<\/td><td class=\"has-text-align-center\" data-align=\"center\">17.0 \/ 20 \u00b1 2.0<\/td><td class=\"has-text-align-center\" data-align=\"center\">9 \/ 20<\/td><td class=\"has-text-align-center\" data-align=\"center\">16 \/ 20<\/td><\/tr><tr><td class=\"has-text-align-center\" data-align=\"center\">Stack Cube<\/td><td class=\"has-text-align-center\" data-align=\"center\">10.0 \/ 20 \u00b1 1.0<\/td><td class=\"has-text-align-center\" data-align=\"center\">14.7 \/ 20 \u00b1 0.6<\/td><td class=\"has-text-align-center\" data-align=\"center\">7 \/ 20<\/td><td class=\"has-text-align-center\" data-align=\"center\">15 \/ 20<\/td><\/tr><tr><td class=\"has-text-align-center\" data-align=\"center\">Close Drawer<\/td><td class=\"has-text-align-center\" data-align=\"center\">11.3 \/ 20 \u00b1 3.2<\/td><td class=\"has-text-align-center\" data-align=\"center\">19.7 \/ 20 \u00b1 0.6<\/td><td class=\"has-text-align-center\" data-align=\"center\">14 \/ 20<\/td><td class=\"has-text-align-center\" data-align=\"center\">20 \/ 20<\/td><\/tr><tr><td class=\"has-text-align-center\" data-align=\"center\">Stand Cup Up<\/td><td class=\"has-text-align-center\" data-align=\"center\">5.3 \/ 20 \u00b1 1.2<\/td><td class=\"has-text-align-center\" data-align=\"center\">14.7 \/ 20 \u00b1 1.2<\/td><td class=\"has-text-align-center\" data-align=\"center\">5 \/ 20<\/td><td class=\"has-text-align-center\" data-align=\"center\">8 \/ 20<\/td><\/tr><tr><td class=\"has-text-align-center\" data-align=\"center\">Average<\/td><td class=\"has-text-align-center\" data-align=\"center\">7.6 \/ 20 \u00b1 1.7<\/td><td class=\"has-text-align-center\" data-align=\"center\">17.2 \/ 20 \u00b1 0.9<\/td><td class=\"has-text-align-center\" data-align=\"center\">8.4 \/ 20<\/td><td class=\"has-text-align-center\" data-align=\"center\">15.2 \/ 20<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"analysis\">Analysis<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">To better understand the advantages of our residual framework over the baseline, we conducted a series of quantitative analyses. The charts below highlight the specific improvements in efficiency and generalization.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"277\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-15-1024x277.png\" alt=\"object-centric residual RL - Figure 1\" class=\"wp-image-1176038\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-15-1024x277.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-15-300x81.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-15-768x208.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-15-1536x415.png 1536w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-15-2048x554.png 2048w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/image-15-240x65.png 240w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">(a) The residual corrects more strongly when the base action deviates from the goal direction. (b) Residual-augmented policies reduce completion time by 9% to 22% on successful episodes.<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"319\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/fig5_sft_avg_overleaf-1024x319.png\" alt=\"object-centric residual RL - Figure 2\" class=\"wp-image-1176040\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/fig5_sft_avg_overleaf-1024x319.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/fig5_sft_avg_overleaf-300x93.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/fig5_sft_avg_overleaf-768x239.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/fig5_sft_avg_overleaf-1536x478.png 1536w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/fig5_sft_avg_overleaf-2048x637.png 2048w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/fig5_sft_avg_overleaf-240x75.png 240w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">(a) Compatibility with different VLA backbones. (b) Object-centric observation transfers most effectively. (c, d) Residual-corrected rollouts improve supervised fine-tuning.<\/figcaption><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"action-correction\">Action correction<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The arrows show the base VLA action, the residual correction, and the combined action. When the base action becomes misaligned, the residual steers it back toward the goal.<\/p>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-8f761849 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"315\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/fig4_action_correction_wide_video-1024x315.png\" alt=\"object-centric residual RL -  Action Correction\" class=\"wp-image-1176050\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/fig4_action_correction_wide_video-1024x315.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/fig4_action_correction_wide_video-300x92.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/fig4_action_correction_wide_video-768x237.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/fig4_action_correction_wide_video-1536x473.png 1536w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/fig4_action_correction_wide_video-240x74.png 240w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2026\/06\/fig4_action_correction_wide_video.png 2000w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n<\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"conclusion-and-future-work\">Conclusion and future work<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Object-centric residual RL combines the generalization ability of VLAs with the precise corrective capability of reinforcement learning.&nbsp;By choosing&nbsp;an observation interface that works in both simulation and reality, we can train the residual entirely in simulation and deploy it zero-shot on the real robot.&nbsp;As a result,&nbsp;the method improves manipulation performance without requiring real-world RL, distillation, or residual-policy fine-tuning.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Beyond direct deployment,&nbsp;the residual-corrected policy also produces better real-robot rollouts. These rollouts can retrain the base VLA and convert task-specific residual corrections into standalone policy improvements.&nbsp;In this way,&nbsp;residual RL can serve not only as an inference-time correction module, but also as a mechanism for generating higher-quality supervision.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Finally,&nbsp;future work includes extending the approach to more cluttered scenes and broader task families. It will also be important to develop more autonomous mechanisms for identifying which task-relevant objects should condition the residual policy.&nbsp;Ultimately,&nbsp;we view object-centric residual RL as one step toward robot learning systems that can use simulation to improve real-world behavior with less human intervention.<\/p>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>By\u00a0Kinam Kim, Namiko Saito, Heecheol Kim, Katsushi Ikeuchi, Jaegul Choo and Yasuyuki Matsushita Vision-Language-Action (VLA) models enable broad manipulation capabilities by leveraging large-scale pretraining and robot demonstrations. However, imitation learning can cause small execution errors to accumulate over time, pushing the robot into states that demonstrations did not cover well. Therefore, we present an&nbsp;object-centric residual [&hellip;]<\/p>\n","protected":false},"author":44211,"featured_media":1176050,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-content-parent":1057371,"msr_hide_image_in_river":0,"footnotes":""},"research-area":[13556],"msr-locale":[268875],"msr-post-option":[],"class_list":["post-1175827","msr-blog-post","type-msr-blog-post","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-locale-en_us"],"msr_assoc_parent":{"id":1057371,"type":"group"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/1175827","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-blog-post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/44211"}],"version-history":[{"count":16,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/1175827\/revisions"}],"predecessor-version":[{"id":1176087,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/1175827\/revisions\/1176087"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/1176050"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=1175827"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=1175827"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=1175827"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=1175827"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}