The key objective of the recent work by Huang and his colleagues was to create a four-legged robot goalkeeper that can perfect its skills as it plays, just as a human goalkeeper would. To do this, the researchers developed a reinforcement learning model that trains the robot via a trial-and-error process, rather than through a fixed, human-engineered strategy.
"The robot first learns different locomotion control policies to preform distinct skills, such as sidestep, dive, and jump, while tracking randomized trajectories for the robot's toes," the researchers explained. "Based on these control policies, the robot then learns a high-level planning policy to select an optimal skill and motion to intercept the ball after examining the detected ball position and robot's states."