UP - logo
University of Primorska University Library (UPUK)
  • Transferring a learned qualitative cart-pole control model to uneven terrains [Elektronski vir]
    Šoberl, Domen ; Bratko, Ivan, računalništvo
    Qualitative modeling can be applied to the control of dynamic systems by following these steps: (1) learning a qualitative model of the controlled dynamic system from the system’s behaviors in time, ... (2) using the learned model to derive a qualitative plan for the control task, and (3) executing the qualitative plan on an actual dynamic system. This approach has been demonstrated in the usual cart-pole control domain as significantly more sample efficient than the usual variants of reinforcement learning, by at least two orders of magnitude. The qualitative approach also enables better explanation of the learned control strategy through symbolic planning. In this paper, we generalize the cart-pole problem to uneven terrains, such as driving over a crater or a hill. We study whether the learned flat-surface qualitative controller can be successfully transferred to the tasks of negotiating uneven terrain. Experiments show that the flat-surface qualitative controller is remarkably robust on new, more difficult tasks.
    Source: Discovery science [Elektronski vir] : 26th international conference, DS 2023, Porto, Portugal, October 9-11, 2023 : proceedings (Str. 446-459)
    Type of material - conference contribution ; adult, serious
    Publish date - 2023
    Language - english
    COBISS.SI-ID - 168739075

    Link(s):

    https://link.springer.com/chapter/10.1007/978-3-031-45275-8_30
    https://doi.org/10.1007/978-3-031-45275-8_30
    DOI

Shelf entry