Research

Learning-based Control

Legged robots often face challenges due to their high degrees of freedom and the difficulty of accurately modeling complex environments. These factors discourage the development of robust and stable controllers. However, by leveraging reinforcement learning(RL) techniques, we have successfully developed locomotion controllers that enable the quadrupedal robots to adapt and traverse through challenging terrains such as rough, slippery, and deformable surfaces. This learning-based approach not only improves robustness and stability but also reduces dependency on accruate and computationally intensive models, making our controllers well-suited for practical applications in dynamic and unpredictable environments.

../_images/VariousTerrains.png

Learning-based locomotion on various terrains

Through extensive experimentation, we have demonstrated the effectiveness of our RL-based locomotion controllers. The list of our work is shown below.

../_images/DeformableContactModel.png

Contact model of deformable terrains

  • Suyoung Choi et al., Learning quadrupedal locomotion on deformable terrain. Sci. Robot. 8, eade2256(2023) paper_choi23 video_choi23

../_images/ConcurrentControlDiagram.png

Concurrent training architeture

  • Gwanghyeon Ji et al., “Concurrent Training of a Control Policy and a State Estimator for Dynamic and Robust Legged Locomotion,” in IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 4630-4637, April 2022 paper_ji22 video_ji22

  • Blind locomotion through the natural environment characterized by steep slopes and scattered debris (ongoing) video_compiled video_hiking

  • Whole body control for pushing objects (ongoing)

  • Dynamic locomotion for traversing stepping stones (ongoing)


Autonomous Navigation

Legged robots have great potential for exploring a diverse range of environments accessible to both humans and animals. These encompass urban settings as well as natural landscapes like forests and mountains. However, navigating autonomously in these environments is challenging as it requires the integration of semantic and geometric reasoning for path planning, and the consideration of the robot’s physical constraints and controller characteristics for path tracking.

../_images/AutonomousNavigationFramework.png

Autonomous navigation framework (Top), Testing in the physics simulation (Bottom)

In our lab, we’re actively combining learning-based approaches with classical methods to build an autonomous navigation framework. The framework includes traversibility estimation, efficient path and motion planning, and precise path tracking algorithms. Our ultimate goal is to develop a navigation system that can be applied to various tasks, including autonomous indoor and outdoor inspections. The list of our work is shown below.

../_images/ForwardDynamicsModel.png

Forward dynamics model training pipeline

  • Yunho Kim et al., “Learning Forward Dynamics Model and Informed Trajectory Sampler for Safe Quadruped Navigation,” in Proceedings of Robotics: Science and Systems, New York City, NY, USA, June 2022. paper_kim22 video_kim22


Hardware Platform

Mechanical Design

Our Lab directly creates all the components to experiment with a controller to which the learning algorithm is applied.

../_images/raibo_6.png

Raibo

Raibo, made by Railab, has hardware that can withstand shocks under various conditions and operate robustly regardless of the environment. We also design its own driving units, which are key components consisting of motors, motor reducers, encoders, and motor drivers. With its own form factor, it plays a major role in achieving high efficiency during operation.

../_images/raibo_5.png

Raibo driving units

../_images/raibo_3.png

Raibo Leg Design

Through various simulations, we demonstrate that we can operate robustly and efficiently in various situations. The list of our work is shown below.

    1. Hwangbo, et al. “Cable-driven actuation for highly dynamic robotic systems.” 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2018. Paper3

Electrical Design

We are rigorously pursuing research in the electronics sector for pushing hardware utilization to the extreme. Our research extends from designing power circuit, crucial for handling inrush currents and regenerative braking during impacts, to high-power, high-bandwidth motor drivers. The circuit design, artwork, SMT, and testing are all performed in-house.

../_images/schematic_artwork.png

Circuit drawing (Left), Component layout (Right) [Blurred image for security]

../_images/smt_testing.png

SMT assembly (Left), Testing (Right)

Leveraging our deep understanding of power electronics and robotic systems, we are not just enabling robots to utilize the extreme area of motor capabilities, but also contributing to bridging the sim-to-real gap. Furthermore, taking into account the characteristics of each electronics component, we can build high power and low noise motor driver in a small form factor and facilitate it into efficient locomotion.