Just wanted to show off my hand eye calibration algorithm. You can see a video of the results here https://imgur.com/a/2dRbYP2.
With the calibration, the robot can know where the camera is at all times, relative to the robot’s fixed base frame. That’s why objects in the pointcloud appear in a consistent reference frame, even though the camera is moving.