DreamWaQer: A quadrupedal robot that can walk in the dark

Professor Hyun Myung's research team at the Urban Robotics Lab in the School of Electrical Engineering is behind the walking robot control technology that enables robust "blind locomotion" in various atypical environments.

The KAIST research team developed DreamWaQ technology, which was named so as it enables walking robots to move about even in the dark, just as a person can walk without visual help fresh out of bed and going to the bathroom in the dark. With this technology installed atop any legged robots, it will be possible to create various types of DreamWaQers.

Existing walking robot controllers are based on kinematics and/or dynamics models. This is expressed as a model-based control method. In particular, on atypical environments like the open, uneven fields, it is necessary to obtain the feature information of the terrain more quickly in order to maintain stability as it walks. However, it has been shown to depend heavily on the cognitive ability to survey the surrounding .

In contrast, the controller developed by Professor Hyun Myung's research team based on (RL) methods can quickly calculate appropriate control commands for each motor of the walking robot through data of various environments obtained from the simulator. Whereas the existing controllers that learned from simulations required a separate re-orchestration to make it work with an actual robot, this controller developed by the research team is expected to be easily applied to various walking robots because it does not require an additional tuning process.

Figure 1. Overview of DreamWaQ, a controller developed by this research team. This network consists of an estimator network that learns implicit and explicit estimates together, a policy network that acts as a controller, and a value network that provides guides to the policies during training. When implemented in a real robot, only the estimator and policy network are used. Both networks run in less than 1 ms on the robot's on-board computer. Credit: KAIST (Korea Advanced Institute of Science and Technology)

Figure 2. Since the estimator can implicitly estimate the ground information as the foot touches the surface, it is possible to adapt quickly to rapidly changing ground conditions. Credit: KAIST (Korea Advanced Institute of Science and Technology)

Figure 3. Results showing that even a small walking robot was able to overcome steps with height differences of about 20cm. Credit: KAIST (Korea Advanced Institute of Science and Technology)