Show simple item record

dc.contributor.authorAndreas A. Malikopoulos
dc.contributor.authorPanos Y. Papalambros
dc.contributor.authorDennis N. Assanis
dc.date.accessioned2017-05-09T00:32:10Z
dc.date.available2017-05-09T00:32:10Z
dc.date.copyrightJuly, 2009
dc.date.issued2009
dc.identifier.issn0022-0434
dc.identifier.otherJDSMAA-26497#041010_1.pdf
dc.identifier.urihttp://yetl.yabesh.ir/yetl/handle/yetl/140199
dc.description.abstractModeling dynamic systems incurring stochastic disturbances for deriving a control policy is a ubiquitous task in engineering. However, in some instances obtaining a model of a system may be impractical or impossible. Alternative approaches have been developed using a simulation-based stochastic framework, in which the system interacts with its environment in real time and obtains information that can be processed to produce an optimal control policy. In this context, the problem of developing a policy for controlling the system’s behavior is formulated as a sequential decision-making problem under uncertainty. This paper considers the problem of deriving a control policy for a dynamic system with unknown dynamics in real time, formulated as a sequential decision-making under uncertainty. The evolution of the system is modeled as a controlled Markov chain. A new state-space representation model and a learning mechanism are proposed that can be used to improve system performance over time. The major difference between the existing methods and the proposed learning model is that the latter utilizes an evaluation function, which considers the expected cost that can be achieved by state transitions forward in time. The model allows decision-making based on gradually enhanced knowledge of system response as it transitions from one state to another, in conjunction with actions taken at each state. The proposed model is demonstrated on the single cart-pole balancing problem and a vehicle cruise-control problem.
dc.publisherThe American Society of Mechanical Engineers (ASME)
dc.titleA Real-Time Computational Learning Model for Sequential Decision-Making Problems Under Uncertainty
dc.typeJournal Paper
dc.journal.volume131
dc.journal.issue4
dc.journal.titleJournal of Dynamic Systems, Measurement, and Control
dc.identifier.doi10.1115/1.3117200
dc.journal.fristpage41010
dc.identifier.eissn1528-9028
dc.treeJournal of Dynamic Systems, Measurement, and Control:;2009:;volume( 131 ):;issue: 004
dc.contenttypeFulltext


Files in this item

Thumbnail
This item appears in the following Collection(s)

Show simple item record