发明名称 Method for converting continuous system to Markov decision process
摘要 A continuous dynamical system is converted to a Markov decision process (MDP) with discrete states. A predetermined number of continuous states of the continuous system is selected, wherein each continuous state corresponds to one discrete state of the MDP. Delaunay triangulation is applied to the continuous states to produce a set of triangles, wherein vertices of each triangle represent the continuous states. For each discrete state, a next discrete state y = f ( x, a ) is determined, wherein x represents the continuous state corresponding to the discrete state, a is a control action, and f is a non-linear transition function for the continuous state. A particular triangle containing the next discrete state y is identified, and the next discrete state y is expressed as probabilities of transitioning to the discrete states corresponding to the continuous states x represented by the vertices of the particular triangle.
申请公布号 EP2341447(A2) 申请公布日期 2011.07.06
申请号 EP20100015889 申请日期 2010.12.21
申请人 MITSUBISHI ELECTRIC CORPORATION 发明人 NIKOVSKI, DANIEL
分类号 G06F17/13;G05B13/02 主分类号 G06F17/13
代理机构 代理人
主权项
地址