I solved it by basing the robot's movements off my own using my position. Hopefully that's vague enough to be a decent hint but not a giveaway...