On optimal quasi-singular controls in stochastic control problem | Vestnik Tomskogo gosudarstvennogo universiteta. Upravlenie, vychislitelnaja tehnika i informatika – Tomsk State University Journal of Control and Computer Science. 2016. № 3(36).

On optimal quasi-singular controls in stochastic control problem

In the report we consider a stochastic optimal control problem whose mathematical model is given by stochastic differential equation Ito. Let (Q, F, P) be a complete probability space. w(t) be n dimensional standard Winer process determined on the space (Q, F, P) . Lf (?0,R") be a space of measurable with respect by (t, ю) random processes х(t, ю): [/0, ]:Q^ R" such that t1 2 E J |\х (t)|| dt . 0 Here and follows sign E is mathematical expectation. Let on a fixed time interval [t0, t1 ] = T the control process be described by the following stochastic differential system: dх (t) = f (t, х (t), u (t)) dt + о (t, х (t)) dw (t), t e T , X 0 = 0 . Here ft^u) is the given n dimensional vector-function continuous in totality of variables together with partial derivatives with respect by (х, u) to second order inclusively, о (t, х) is a matrix function of sizes (" x ") continues in totality of variables together with partial derivatives with respect by х to second order inclusively. u (t) e Ud = {u (•) e Lf (t0, t1;R )|u (t)e U с R} , where U is the given nonempty, bounded and convex set. Call Ud set of admissible controls. Our goal by minimize the functional I (u ) = E {h (х (t1))}, on the set of admissible controls. Here h(х ) is the given twice continuously differentiable scalar function. By means of the stochastic analogue of the method suggested and developed in the papers of K.B. Mansimov, we get a linearized necessary optimality condition, and also study the quasi-singular case. Necessary optimality condition of quasi-singular controls is established. Then investigated particular cases.

Download file
Counter downloads: 478

Keywords

стохастическая система, оптимальное управление, квазиособые управления, линеаризованное условие оптимальности, stochastic system, optimal control, quasi-singular control, linearized optimality conditions

Authors

NameOrganizationE-mail
Mansimov Kamil B.Baku State University; Institute of Control Systems (Cybernetics) of Azerbaijan National Academy of Sciencesmansimov@front.ru
Mastaliyev Rashad O.Institute of Control Systems (Cybernetics) of Azerbaijan National Academy of Sciencesmastaliyevrashad@gmail.com
Всего: 2

References

Аркин В.И., Саксонов М.Т. К теории стохастического принципа максимума в задачах с непрерывным временем // Модели и методы стохастической оптимизации. М. : ЦЭМИ, 1983. C. 3-26.
Kushner H.J. On the stochastic maximum principle: Fixed time of control // J. Math. Anal. Appl. 1965. V. 11. P. 78-92.
Ha/ayed M. Filippov approach in stochastic maximum principle without differentiability assumptions // Electronic j ournal of differen tial equations. 2010. V. 2010, No. 97. P. 1-13.
Агаева Ч.А. Необходимые условия оптимальности особых управлений в стохастических системах с запаздывающим аргу ментом. Баку, 1990. 20 с. Деп.в ВИНИТИ 19.06.1990. № 3495-890.
Гихман И.И., Скороход А.В. Управляемые случайные процессы. Киев : Наукова думка, 1977. 250 с.
Васильев Ф.П. Методы оптимизации. М. : Факториал, 2002. 824 с.
Габасов Р., Кириллова Ф.М. Особые оптимальные управления. М. : Наука, 1973. 256 с.
Bismut J.M. Linear quadratic optimal stochastic control with random coefficients // SIAM. J. Control andoptimization. 1976. V. 14, №>. 3. P. 419-444.
Мансимов К.Б. Особые управления в системах с запаздыванием. Баку : ЭЛМ, 1999. 176 с.
Мансимов К.Б., Марданов М.Дж. Качественная теория оптимального управления системами Гурса - Дарбу. Баку : ЭЛМ, 2010. 336 с.
Абдуллаев А. А., Мансимов К. Б. Необходимые условия оптимальности в процессах, описываемых системой интегральных уравнений типа Вольтерра. Баку : Элм, 2013. 224 с.
 On optimal quasi-singular controls in stochastic control problem | Vestnik Tomskogo gosudarstvennogo universiteta. Upravlenie, vychislitelnaja tehnika i informatika – Tomsk State University Journal of Control and Computer Science. 2016. № 3(36).

On optimal quasi-singular controls in stochastic control problem | Vestnik Tomskogo gosudarstvennogo universiteta. Upravlenie, vychislitelnaja tehnika i informatika – Tomsk State University Journal of Control and Computer Science. 2016. № 3(36).

Download full-text version
Counter downloads: 769