Modulated MAP states optimal estimation under conditions of its partial observability
This paper considers the modulated MAP, which rate is a piecewise constant random process /(t) with two states: /(t) = / and /(t) = / (/ > / > 0). The time when the process /(t) remains at the i-th state, i - 1,2, depends on two random values: 1) the first random value has the exponential distribution function F/ - = 1 - e '', i = 1,2; when the i-th state ends, the process /(t) transits with the probability equal to one from the i-th state to the j-th state, i, j = 1,2 (i Ф j); 2) the second random value has the exponential distribution function F/ - = 1 - e , i = 1,2; when the i-th state ends, the process /(t) transits with the probability P 1 (/ | /) from the i-th state to the j-th state (i Ф j) and a flow event occurs or /(t) transits with the probability P 0 (/ | /) from the i-th state to the j-th state (i ^ j) but an event does not occur, or the process /(t) transits with the probability P 1 (/ | /) from the i-th state to the i-th state and a flow event occurs. Here P 1 (/j | /) + P 0 (/j | /) + P 1 (/ | /) = 1, i, j = 1,2, i Ф j. The block transition rate matrix for the process /(t) is as follows: -(а 1 + /) а 1 +/ 1P 0 (/ 2| /) а 2 +/ 2P 0(/ 1 | / 2) -(а 2 +/ 2) /1P1 (/J/1) /1P1 (/ 2|/) / 2 P1 (/1 | / 2 ) / 2 P1 (/ 2|/ 2) = 1D0 | Dj| . D = An event generates the period of time called the dead time, during which the flow cannot be observed. After this period ends, a new event also generates the dead time. Having only a sample (t 1,., t n) of events moments, we need to estimate the flow states. The optimal states estimation algorithm is as following: 1) at the initial moment t 0 a priori probability л 1 that /(t) is in / is calculated using the formula . =_а 2 +/2 [1 - P (/ 2|/ 2)]_ ; а 1 +а 2 + / [1 -P 1 (/ | /)] + / 2[1 -P 1 (/ 2 | / 2)] 2) in the interval (t 0, t 1) a posteriori probability w(/ 1| t) is calculated using the formula | t) = 1 2 w(/1 0 + )-w2 1 w(/1 0 + ^--' ; 0 ) , w(/ | t0 + 0) = .1; ' w 2 - w(/ 1| t 0 + 0)-[ - w(/ 1| t 0 + 0)]e A(w2 w1 Х"0 ' ^ l0 > 3) at event occurring moment t k a posteriori probability w(/ 1| t k + 0) is calculated using the formula + / 2 ^(/1 |/ 2 ЫУК/ |/)-/ 2 P1 (/1 |/ 2 )]w(/1 | tk - 0) ' /2 [1 - P0 (М/)] + [[-/2-/1P0 (/J/) + / 2 P0 (М/ )]-w(/1 | tk - 0) where instead of w(/ 1| t k - 0) the value calculated on the formula w> 2 -w(/ | tk + 0)]-w 2[ -w(/ | tk + 0)e -w1 )-tk) W2 -w(/1 | tk + 0)-[ -w(/1 | tk + 0)e -w1 )(-tk) at t k, k = 1,2,., is used; 4) in the interval (t k, t k + T dead] the probability w(/ 1| t) can be found as w(/ 11) = . + [w(/ | t k + 0)-. 1 ]• e k 5) in the interval (t k + T dead, t k+1), k = 1,2,., the value w(/ 1| t) can be calculated by formula used on the step 3, where instead of w(/ 1| t k + 0) the value w(/ 1| t k + T dead) calculated on the step 4 is used. Then go to the step 3. The steps 3-5 are reiterated during observing time. Simultaneously with probability calculation we estimate the flow states: if w(/ 1| t) > w(/ 2| t) than / (t) = / 1, otherwise / (t) = / 2. The results show that the bigger а i, i-1,2, the higher estimation error, and that the bigger quotient / 1// 2, the better estimation.
Keywords
модулированный MAP-поток событий, оптимальное оценивание состояний, метод максимума апостериорной вероятности, непродлевающееся мертвое время, Modulated MAP, optimal state estimation, method of a posteriori probability maximum, non-extendable dead timeAuthors
Name | Organization | |
Berezin Dmitriy V. | Tomsk State University | berezin14@mail.ru |
Nezhel'skaya Lyudmila A. | Tomsk State University | ludne@mail.tsu.ru |
References

Modulated MAP states optimal estimation under conditions of its partial observability | Vestnik Tomskogo gosudarstvennogo universiteta. Upravlenie, vychislitelnaja tehnika i informatika – Tomsk State University Journal of Control and Computer Science. 2015. № 3(32).