############################# Research ############################# ******************************** Learning-based Control ******************************** Legged robots often face challenges due to their high degrees of freedom and the difficulty of accurately modeling complex environments. These factors discourage the development of robust and stable controllers. However, by leveraging reinforcement learning(RL) techniques, we have successfully developed locomotion controllers that enable the quadrupedal robots to adapt and traverse through challenging terrains such as rough, slippery, and deformable surfaces. This learning-based approach not only improves robustness and stability but also reduces dependency on accruate and computationally intensive models, making our controllers well-suited for practical applications in dynamic and unpredictable environments. .. image:: ../_images/research/VariousTerrains.png :width: 100% :align: center .. centered:: Learning-based locomotion on various terrains Through extensive experimentation, we have demonstrated the effectiveness of our RL-based locomotion controllers. The list of our work is shown below. .. image:: ../_images/research/DeformableContactModel.png :width: 100% :align: center .. centered:: Contact model of deformable terrains - Suyoung Choi et al., Learning quadrupedal locomotion on deformable terrain. Sci. Robot. 8, eade2256(2023) `paper_choi23 `_ `video_choi23 `_ .. image:: ../_images/research/ConcurrentControlDiagram.png :width: 100% :align: center .. centered:: Concurrent training architeture - Gwanghyeon Ji et al., "Concurrent Training of a Control Policy and a State Estimator for Dynamic and Robust Legged Locomotion," in IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 4630-4637, April 2022 `paper_ji22 `_ `video_ji22 `_ - Blind locomotion through the natural environment characterized by steep slopes and scattered debris (ongoing) `video_compiled `_ `video_hiking `_ - Whole body control for pushing objects (ongoing) - Dynamic locomotion for traversing stepping stones (ongoing) ---- ***************************** Autonomous Navigation ***************************** Legged robots have great potential for exploring a diverse range of environments accessible to both humans and animals. These encompass urban settings as well as natural landscapes like forests and mountains. However, navigating autonomously in these environments is challenging as it requires the integration of semantic and geometric reasoning for path planning, and the consideration of the robot's physical constraints and controller characteristics for path tracking. .. image:: ../_images/research/AutonomousNavigationFramework.png :width: 100% :align: center .. centered:: Autonomous navigation framework (Top), Testing in the physics simulation (Bottom) In our lab, we're actively combining learning-based approaches with classical methods to build an autonomous navigation framework. The framework includes traversibility estimation, efficient path and motion planning, and precise path tracking algorithms. Our ultimate goal is to develop a navigation system that can be applied to various tasks, including autonomous indoor and outdoor inspections. The list of our work is shown below. .. image:: ../_images/research/ForwardDynamicsModel.png :width: 100% :align: center .. centered:: Forward dynamics model training pipeline - Yunho Kim et al., “Learning Forward Dynamics Model and Informed Trajectory Sampler for Safe Quadruped Navigation,” in Proceedings of Robotics: Science and Systems, New York City, NY, USA, June 2022. `paper_kim22 `_ `video_kim22 `_ ---- ***************************** Hardware Platform ***************************** +++++++++++++++++++++++++++++ Mechanical Design +++++++++++++++++++++++++++++ Our Lab directly creates all the components to experiment with a controller to which the learning algorithm is applied. .. image:: ../_images/robot_design/raibo_6.png :width: 100% :align: center .. centered:: Raibo Raibo, made by Railab, has hardware that can withstand shocks under various conditions and operate robustly regardless of the environment. We also design its own driving units, which are key components consisting of motors, motor reducers, encoders, and motor drivers. With its own form factor, it plays a major role in achieving high efficiency during operation. .. image:: ../_images/robot_design/raibo_5.png :width: 100% :align: center .. centered:: Raibo driving units .. image:: ../_images/robot_design/raibo_3.png :width: 100% :align: center .. centered:: Raibo Leg Design Through various simulations, we demonstrate that we can operate robustly and efficiently in various situations. The list of our work is shown below. - J. Hwangbo, et al. "Cable-driven actuation for highly dynamic robotic systems." 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2018. `Paper3 `_ +++++++++++++++++++++++++++++ Electrical Design +++++++++++++++++++++++++++++ We are rigorously pursuing research in the electronics sector for pushing hardware utilization to the extreme. Our research extends from designing power circuit, crucial for handling inrush currents and regenerative braking during impacts, to high-power, high-bandwidth motor drivers. The circuit design, artwork, SMT, and testing are all performed in-house. .. image:: ../_images/robot_design/schematic_artwork.png :align: center .. centered:: Circuit drawing (Left), Component layout (Right) [Blurred image for security] .. image:: ../_images/robot_design/smt_testing.png :align: center .. centered:: SMT assembly (Left), Testing (Right) Leveraging our deep understanding of power electronics and robotic systems, we are not just enabling robots to utilize the extreme area of motor capabilities, but also contributing to bridging the sim-to-real gap. Furthermore, taking into account the characteristics of each electronics component, we can build high power and low noise motor driver in a small form factor and facilitate it into efficient locomotion.