Robot Calibration
The measurements that make sensor coordinates agree with motion.
Robot calibration estimates the parameters that make a robot's measurements and commands agree on the physical world. Classical kinematic calibration has four steps: modeling, measurement, identification and correctionSource 10.

Self-check
Read the reasoning
- Check the hand-eye rotation and its residualA small angular transform error creates lateral position error that grows with working distance. The consistent direction is a calibration signature.
- Collect more demonstrations at longer distancesMore data can teach a stable bias, but the distance-dependent systematic direction points to geometry. Fixing the transform removes the error for every policy and dataset.
- Fine-tune a larger vision encoderCapacity does not make the camera and robot frames agree. A larger model may conceal the bias on familiar poses and retain the same physical defect.
Systematic, geometry-dependent misses are calibration evidence; measure the transform before changing the learner.
The calibration chain
A manipulation system chains camera intrinsics, depth alignment, extrinsics, joint zeroes, link and tool parameters, payload, timing and actuator response. FoundationPose tracks novel-object poses with or without a modelSource 9, but a wrong hand-eye transform still misplaces the grasp.
Schematic: not drawn to scale
How this was made
- robot base to wrist, set by joint readings and link lengths. Nguyen and colleagues calibrated a humanoid from 31 chosen postures and cut its RMS error 2.3-fold against the manufacturer's model. Source: Nguyen et al. 2025.
- wrist to camera, set by hand-eye calibration. OmniCalib found the CAD values for a wrist camera off by up to 10.56 mm and 1.74 degrees, and writes back only the corrections its observability checks support. Source: Lu et al. 2026.
- camera to box, set by what the camera measures (depth). Khoshelham and Oude Elberink found that a Kinect depth sensor’s random depth error grows from a few millimetres to about 4 cm at its maximum range. Source: Khoshelham et al. 2012.
- wrist to hand, set by tool offset. No source here reports a measured error for the tool offset. It is checked by touching one point with the gripper tip from several angles.
Four calibrated links join the robot base to the box its camera sees: calibration cut a humanoid's error 2.3-fold, a wrist camera's drawing values were off by up to 10.56 mm and 1.74 degrees, a Kinect's depth error reaches about 4 cm, and the tool offset has no sourced error.
The four links and their measured errors
| link | what sets it | measured error |
|---|---|---|
| robot base to wrist | joint readings and link lengths | RMS error cut 2.3-fold by calibration |
| wrist to camera | hand-eye calibration | up to 10.56 mm and 1.74 degrees from CAD |
| camera to box | what the camera measures (depth) | random depth error up to about 4 cm |
| wrist to hand | tool offset | no sourced error; checked by touching one point from several angles |
Camera intrinsics
Intrinsics map pixels to rays through focal lengths, principal point and lens distortion. Zhang's method recovers them from a planar pattern at a few unknown orientationsSource 1, and Kannala and Brandt's generic model covers wide-angle and fisheye lensesSource 11. Refit after any focus, resolution or crop change.
Depth is a measurement model
Stereo depth error scales with the square of distance, and repetitive structures make matches ambiguousSource 6; the D400 datasheet adds saturation from specular reflectionsSource 5. Kinect random error grows from a few millimeters to about 4 cm at maximum rangeSource 12, and a joint depth-color calibration with a depth-distortion model beat the manufacturer'sSource 13.
Hand-eye calibration
Hand-eye calibration finds the gripper-to-camera transform for a wrist camera, or base-to-camera for a fixed one. Shiu and Ahmad cast it as Source 2, Tsai and Lenz solved it in about arithmetic operations for robot stationsSource 3, and Park and Martin derived closed-form exact and least-squares solutionsSource 14.

OpenCV needs at least two motions with non-parallel rotation axes, so three poses, and strongly recommends many moreSource 15. MoveIt's tutorial reports accuracy plateaus after about 12 or 15 samples in most casesSource 16.
Illustrative iris; pose counts cited
How this was made
With 3 poses, the minimum OpenCV requires, the camera's place on the wrist can just be solved; the illustrative uncertainty ring then tightens with more poses, and MoveIt reports the calibration typically plateaus after about 12 or 15 samples.
Poses and how much tighter the estimate gets
| poses | times tighter than with 3 (illustrative) |
|---|---|
| 3 | the baseline |
| 6 | 2.0 |
| 12 | 3.2 |
| 15 | 3.6 |
| 20 | 4.2 |
Markerless methods now rival targets: DREAM's single-image accuracy is comparable to multi-frame offline calibrationSource 17, and Hydra reaches 5 mm task-space accuracy against 7 mm for classical methodsSource 19. DRHeC's authors report 88.9% grasp success on a UR5e, 46.3 points above the differentiable-rendering method EasyHeCSource 20 Source 18.
Kinematic and tool calibration
Manufacturing errors and joint compliance shift an assembled arm from its nominal kinematicsSource 4. Nguyen and colleagues calibrated a humanoid from 31 chosen postures and cut RMS error 2.3-fold against the manufacturer's modelSource 21. OmniCalib found CAD wrist-camera extrinsics off by up to 10.56 mm and 1.74 degrees, and writes back only corrections its observability checks supportSource 22.
Time calibration
A late frame misplaces a moving arm. Kalibr estimates time offsets jointly with spatial transformsSource 23, and IEEE 1588 synchronizes networked clocks to sub-microsecond accuracySource 24. On one RealSense D435 and Airbot Play rig, Realtime-VLA V2 measured camera, proprioception and motion delays of 55, 50 and 150 msSource 25.
Illustrative bench; measured camera delay
How this was made
At a gripper speed of 50 cm a second, the 55 ms camera delay measured on a RealSense D435 rig puts the camera's beam 27.5 mm behind the gripper's pointer on the ruler; the gap is speed times delay.
Gap between the photographed and the real hand
| hand speed (cm a second) | gap (mm) |
|---|---|
| 10 | 5.5 |
| 25 | 13.8 |
| 50 | 27.5 |
| 100 | 55 |
Dynamics and actuator calibration
Sim-to-real work calls this system identification. Atkeson, An and Hollerbach identified load and link inertial parameters by least squares and beat CAD-derived predictionsSource 26, and Gaz and colleagues first identified the Franka Panda's dynamics, joint friction and feasible parametersSource 27.
Hwangbo and colleagues found actuator dynamics central to ANYmal's transfer gap and learned an actuator network from real measurementsSource 7, and SPI-Active, which chooses identification data actively, beats baselines by 42 to 63% in locomotion transferSource 28. Without measured response, a dataset confuses policy and tracking error.
Calibration versus visual servoing
Visual servoing puts the vision sensor inside the control loop and drives image features toward a target through a task functionSource 8. Its interaction model, velocity commands and safety geometry still need consistent conventions.
Drift and ownership
DROID's per-session checkerboard calibrations were not always accurate, and the dataset provides camera-to-base calibrations for about 36,000 scenesSource 29. Most public datasets lack extrinsics; CalibAll recovered them for about 97,000 episodes across 16 datasetsSource 30. Store each calibration with hardware serials, camera settings, tool, software version, date, procedure and residuals, and redo it after a remount, collision, tool or firmware change.
See also
- Action Spaces for Robot Learning
What each action representation gives the learner and asks of the controller.
- Major Datasets
The major open robot datasets and what each collected.
- Sim-to-Real Transfer
Domain randomization, distillation, system identification and real-to-sim reconstruction.
Linked from
- Robot Learning Curriculum for ML Engineers
A dependency-ordered route from supervised learning to real robot policies.
- Sim-to-Real Transfer
Domain randomization, distillation, system identification and real-to-sim reconstruction.
- The Robot Learning Stack
From data capture to robot integration as one reproducible system.
- Kinematics
How joint angles place a robot's hand, and the reverse.
- State Estimation
Kalman filters, factor graphs, and pose estimation from noisy sensors.
- Perception for Manipulation
How camera images become an object's position and orientation.
- ROS 2 for Machine Learning Engineers
ROS 2 as the production boundary around a learned policy.
References
Z. Zhang, IEEE Trans. Pattern Analysis and Machine Intelligence, 2000.
https://doi.org/10.1109/34.888718
Y. C. Shiu, S. Ahmad, IEEE Trans. Robotics and Automation, 1989.
https://doi.org/10.1109/70.88014
R. Y. Tsai, R. K. Lenz, IEEE Trans. Robotics and Automation, 1989.
https://doi.org/10.1109/70.34770
Kevin M. Lynch, Frank C. Park, Cambridge University Press, 2017.
https://hades.mech.northwestern.edu/index.php/Modern_Robotics
RealSense, RealSense, as of 2026-08-22.
https://www.realsenseai.com/wp-content/uploads/2026/03/RealSense-D400-Series-Datasheet-Mar-2026.pdf
Anders Grunnet-Jepsen, John N. Sweetser, John Woodfill, RealSense documentation, as of 2026-08-22.
https://dev.realsenseai.com/docs/tuning-depth-cameras-for-best-performance/
Jemin Hwangbo, Joonho Lee, Alexey Dosovitskiy, Dario Bellicoso, Vassilios Tsounis, Vladlen Koltun, and 1 more, Science Robotics 4(26), 2019.
https://arxiv.org/abs/1901.08652
B. Espiau, F. Chaumette, P. Rives, IEEE Trans. Robotics and Automation, 1992.
https://doi.org/10.1109/70.143350
Bowen Wen, Wei Yang, Jan Kautz, Stan Birchfield, CVPR 2024.
https://arxiv.org/abs/2312.08344
Z. Roth, B. Mooring, B. Ravani, IEEE J. Robotics and Automation, 1987.
https://doi.org/10.1109/JRA.1987.1087124
J. Kannala, S. S. Brandt, IEEE TPAMI, 2006.
https://doi.org/10.1109/TPAMI.2006.153
Kourosh Khoshelham, Sander Oude Elberink, Sensors, 2012.
https://doi.org/10.3390/s120201437
Daniel Herrera C., Juho Kannala, Janne Heikkila, IEEE TPAMI, 2012.
https://doi.org/10.1109/TPAMI.2012.125
F. C. Park, B. J. Martin, IEEE Trans. Robotics and Automation, 1994.
https://doi.org/10.1109/70.326576
OpenCV, OpenCV 4.x Documentation, as of 2026-10-04.
https://docs.opencv.org/4.x/d9/d0c/group__calib3d.html
MoveIt Maintainers, MoveIt Documentation, as of 2026-10-04.
https://moveit.picknik.ai/main/doc/examples/hand_eye_calibration/hand_eye_calibration_tutorial.html
Timothy E. Lee, Jonathan Tremblay, Thang To, Jia Cheng, Terry Mosier, Oliver Kroemer, and 2 more, ICRA 2020, 2019.
https://arxiv.org/abs/1911.09231
Linghao Chen, Yuzhe Qin, Xiaowei Zhou, Hao Su, IEEE Robotics and Automation Letters, 2023.
https://arxiv.org/abs/2305.01191
Martin Huber, Huanyu Tian, Christopher E. Mower, Lucas-Raphael Müller, Sébastien Ourselin, Christos Bergeles, and 1 more, 2025.
https://arxiv.org/abs/2504.20584
Xiaotian Zhang, Yusheng Wang, Naoya Kagawa, Noritaka Takamura, Keiji Okuhara, Hiroyasu Baba, and 1 more, IEEE Trans. Instrumentation and Measurement, 2026.
https://arxiv.org/abs/2609.36779
Thanh D V Nguyen, Vincent Bonnet, Pierre Fernbach, David Daney, Florent Lamiraux, 2025.
https://arxiv.org/abs/2507.16369
Kaixiang Lu, Haiyu Lan, Chunxiao Qiao, You Li, Enyu Li, Yehao Lu, and 3 more, 2026.
https://arxiv.org/abs/2609.19582
Paul Furgale, Joern Rehder, Roland Siegwart, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.
https://doi.org/10.1109/IROS.2013.6696514
IEEE Standards Association, IEEE Standard, 2019.
https://standards.ieee.org/ieee/1588/6825/
Chen Yang, Yucheng Hu, Yunchao Ma, Yunhuan Yang, Jing Tan, Haoqiang Fan, 2026.
https://arxiv.org/abs/2603.26360
Christopher G. Atkeson, Chae H. An, John M. Hollerbach, Int. J. Robotics Research, 1986.
https://doi.org/10.1177/027836498600500306
Claudio Gaz, Marco Cognetti, Alexander Oliva, Paolo Robuffo Giordano, Alessandro De Luca, IEEE Robotics and Automation Letters, 2019.
https://doi.org/10.1109/LRA.2019.2931248
Nikhil Sobanbabu, Guanqi He, Tairan He, Yuxiang Yang, Guanya Shi, 2025.
https://arxiv.org/abs/2505.14266
Alexander Khazatsky, Karl Pertsch, Suraj Nair, 2024.
https://arxiv.org/abs/2403.12945
Sicheng Xie, Lingchen Meng, Zijie Diao, Haidong Cao, Zhiying Du, Shuyuan Tu, and 6 more, 2025.
https://arxiv.org/abs/2511.17001
Further reading
Xingyi Wang, Chenyun Zhang, Weiji Xie, Chao Yu, Wei Song, Chenjia Bai, and 1 more, 2026.
https://arxiv.org/abs/2603.15084
Javier Tirado-Garín, Javier Civera, ICCV 2025.
https://arxiv.org/abs/2503.12701
Minghuan Liu, Zhengbang Zhu, Xiaoshen Han, Peng Hu, Haotong Lin, Xinyao Li, and 9 more, 2025.
https://arxiv.org/abs/2509.02530
Konstantinos Daniilidis, Int. J. Robotics Research, 1999.
https://doi.org/10.1177/02783649922066213
Edwin Olson, ICRA 2011.
https://doi.org/10.1109/ICRA.2011.5979561
Tutian Tang, Minghao Liu, Wenqiang Xu, Cewu Lu, 2024.
https://arxiv.org/abs/2408.10562
J. Swevers, C. Ganseman, D. B. Tukel, J. de Schutter, H. Van Brussel, IEEE Trans. Robotics and Automation, 1997.
https://doi.org/10.1109/70.631234
Filip Bjelonic, Fabian Tischhauser, Marco Hutter, Int. J. Robotics Research, 2025.
https://arxiv.org/abs/2509.06342
Spot a factual error or missing qualification? Report a content correction.