Professional Documents
Culture Documents
Fault detection and isolation for a kind of NCSs with Markov Delays
Yue Cheng*, Hao Ye, Yongqiang Wang
Guizeng Wang, Chuanhu Ge
Abstract: A new approach for fault detection and isolation (FDI) of Networked Control Systems (NCSs)
is proposed in this paper. The paper first regards NCSs with unknown network-induced delay as a Jump
Markov linear system (JMLS) with unknown input, then gives a Bayesian estimation of the JMLS based
on Unknown Input Kalman filter (UIKF), and finally uses the estimation results to detect and isolate faults
based on Log-likelihood ratio (LLR) approach. Simulation example shows that the method is robust to
random networked induced-delay and unknown input.
induced delay at the instant k is τ k periods. Suppose that τ k instant k+1 from the density at instant k can be summarized as
follow:
is bounded, i.e. max(τ k ) = s − 1 , and τ k is a discrete-time, time-
homogeneous, s-state, first-order Markov chain with transition Step 1: Obtain μ k′ +1,i , j μ ′ ( k + 1| I k = i, y1:k +1 , rk +1 = j ) ,
probabilities: pi , j = Pr (τ k +1 = j | τ k = j ) . Γ′k +1,i , j Γ′ ( k + 1| I k +1 = i, y1:k +1 , rk +1 = j ) , for i = 1" n (k ) , j = 1" s ,
at instant k+1, by using n(k ) × s parallel Kalman filters, where
Let:
s means the Markov chain has s states.
[
U (k ) = u (k )
T
" u (k − n ) ] ; B(0) = [B
T T
0 " 0] Step 2: Calculate the likelihoods p ( yk +1 | I k = i, y1:k , rk +1 = j ) , for
B(1) = [0 B 0 "];" B(n ) = [0 " 0 B ]
i = 1" n (k ) , j = 1" s ;
τ k = rk +1
Step 3: Calculate the weights α ′ ( k + 1, i, j ) for i = 1" n (k ) ,
Then the NCS model ( 1 ) can be written as
j = 1" s , according to the likelihoods obtained in Step 2 and
⎧ x(k + 1) = Ax(k ) + B(rk +1 )U (k ) + Ed (k ) + Ff (k ) + w(k ) (2)
the transition probability matrix for Markov chain (i.e. π).
⎨
⎩ y (k ) = Cx(k ) + v(k ) Step 4: Let Φ (μ , Γ ) denote a Gaussian function with mean μ
which is a JMLS model with unknown input and fault. Our and covariance Γ. Although the a posteriori density can be
aim is to obtain the approximate a posteriori density of x(k) calculated by
under a fault free hypothesis, and then achieve the target of n( k ) s
2.2 Brief introduction to State Estimation of Jump Markov to avoid the problem of exponentially increasing computation
Linear System and memory, an approximate a posteriori density can be
calculated by
JMLSs are linear systems whose parameters evolve with time n ( k +1)
7295
17th IFAC World Congress (IFAC'08)
Seoul, Korea, July 6-11, 2008
⎝ ⎠
P(k + 1 | I k = i, rk +1 = j , y1:k +1 ) , for i = 1" n (k ) , j = 1" s , at
−1
(
Pkxd+1 / k +1 = Pkx+1 / k +1 Pk x/ k F F T Pk x/ k F
−1
)
−1
instant k+1, by using n(k ) × s parallel UIKFs.
( (
Pkd/ k +1 = F T C T V + CPk x/ k C T ) −1
HF )
−1 (6)
Step 2: Calculate the likelihood of part of the new
xˆ k +1 / k +1 = x k / k + Pkx+1 / k +1 C T V −1 ( y(k + 1) − Cx k / k )
measurement given the measurement up to instant k. This is
( T
)
dˆ k / k +1 = Pkxd+1 / k +1 − Pkd/ k +1 F T Pk x/ k x k / k + Pkxd+1 / k +1 C T V −1 y(k + 1)
−1 T
the main difference between standard JMLS filter and the
Pk x/ k = APkx/ k A T + W filter considering unknown input. Because of the existence of
x k / k = Axˆ k / k + Bu (k ) unknown input d(k), it becomes impossible to obtain the
margin density of p( y (k + 1) | y1:k ) , and only the margin density
3. FDI for NCSs of a part of the new measurement, i.e. Ty(k+1), where T is the
basis of the left null space of CF , can be obtained now
(Keller et al. 1996). In (Keller et al. 1996), the likelihood of
3.1 basic idea
Ty(k+1) given the history measurement is:
As shown in Sec. 2.1, an NCS can be modeled as a JMLS L(k + 1)
with unknown input and fault, i.e. ( 2 ). Since state estimation
⎧ 1 T ~ ⎫
of JMLS based on Kalman filter can not deal with unknown exp⎨− ~y (k + 1 | I k = i, rk +1 = j ) Pty (k + 1 | I k = i )~
y (k + 1 | I k = i, rk +1 = j )⎬
⎩ 2 ⎭
input, we will use UIKF technique to design filters for ( 2 ), =
which are robust to unknown input and a subset of faults, to [
(2π )rank(T ') det P(k + 1 | Ik = i, rk +1 = j, y1:k +1 )
1/ 2
] (7)
achieve the goal of fault detection and fault isolation. And the where
Log-likelihood Ratio (LLR) method (Li and Kadirkamanathan y (k + 1 | Ik = i, rk +1 = j ) = T ( y(k + 1) − Cx(k | I k = i ));
~
2004) is finally adopted to complete the FDI system. ~
((
P(k + 1 | I k = i, rk +1 = j, y1:k +1 ) = T C AP(k | I k = i )AT + W CT + V T T ) )
Step 3: Calculate the weights α ′ ( k + 1, i, j ) for i = 1" n (k ) ,
3.2 Bayesian filter for NCS based on UIKF
j = 1" s . Since there is
The filter for JMLS introduced in Sec. 2.2 is designed in the
framework of Bayes’ rule. It uses Kalman filter to obtain the p( x(k + 1), rk +1 | y1:k +1 )
conditional density p( x(k + 1) | y1:k +1 , ik , rk +1 ) from p( x(k ) | y1:k , ik ) , s , n(k )
= ∑ ( p(x(k + 1) | r k +1 = j , I k = i, y1:k +1 ) Pr (rk +1 = j , I k = i | y1:k +1 ))
because in the Gaussian linear case Kalman filter is equivalent j =1, i =1
7296
17th IFAC World Congress (IFAC'08)
Seoul, Korea, July 6-11, 2008
Up to now, we have completed the task of design a Bayesian If the maximal element in the decision vector is larger than
filter for NCS, which can approximately estimate the a the threshold, we can judge that the fault corresponding to it
posteriori density of the system’s state vector. occurs.
Remark: Because the dimensions of the nf+1 NCS filters are
3.3 FDI strategy different, the mean values of log-likelihoods ln (ci ( j )) are also
Assume that there are nf faults, and they won’t happen different. Therefore, we should subtract the mean value of
simultaneously. For the purpose of fault isolation, we can ln (ci ( j )) from it. Then the mean value of LLR will be near
n −1
divide f into two subsets, i.e. f i ∈ R1 and f i ∈ R f , which zeros in the fault free case.
are composed of the ith fault, and the other faults respectively. 4. Simulation Example
Then the NCS model ( 2 ) becomes:
To illustrate the fault detection algorithm, an example is given
⎧x(k +1) = Ax(k) + B(rk+1 )U(k) + Ed(k) + Fi fi (k) + Fi fi (k) + w(k) ( 10 ) in this section. Suppose that the matrixes of system ( 1 ) are:
⎨
⎩y(k) = Cx(k) + v(k) ⎡ 0 .5 2 0 0 0⎤ ⎡1 0 0⎤
⎢ 0 0.2 1 0 1 ⎥ ⎢0 0 0⎥⎥
We may define nf+1 parallel filters for NCS based on the ⎢ ⎥ ⎢
A=⎢ 0 0 0.3 0 1 ⎥ , B = ⎢0 1 0⎥
method discussed in Sec. 3.2, i.e. filter i, i=0,1…nf, by using ⎢ ⎥ ⎢ ⎥
the method in Sec. 3.2. Among them, filter i, denoted by M i , ⎢0 0 0 0.7 1 ⎥ ⎢0 0 0⎥
⎣⎢ 0 0 0 0 0.1⎦⎥ ⎣⎢0 0 1⎦⎥
is robust to both unknown input d and the ith fault f i (k ) , and
⎡1 0⎤ ⎡1 − 0.5⎤
filter 0, denoted by M 0 , is only robust to unknown input d. ⎢1 0⎥⎥ ⎢0 0 ⎥⎥
⎢ ⎢
C = I 5 , M = ⎢0 0⎥, F = ⎢1 0 ⎥
According to the The LLR approach (Li and ⎢ ⎥ ⎢ ⎥
⎢0 0⎥ ⎢ 0 0 ⎥
Kadirkamanathan 2004), we may further define nf likelihood
⎣⎢0 0⎦⎥ ⎢⎣0 0 ⎥⎦
ratio
⎡1 0.5 ⎤ ⎡1 ⎤
p ( y ( j ) | y1: j −1 , M i )
⎢ 1 0.3⎥⎥ ⎢ 1 0.5 ⎥
k ⎢ ⎢ ⎥
S rk (i ) = ∑ ln ( 11 ) cov(v(k )) = V = 10 − 2 × ⎢ ⎥, cov(w(k )) = W = 10 − 2 × ⎢ 0.5 1 ⎥
p ( y ( j ) | y1: j −1 , M 0 )
1
⎢ ⎥ ⎢ ⎥
j =r ⎢0.5 1 ⎥ ⎢ 1 ⎥
⎢⎣ 0.3 1 ⎥⎦ ⎢⎣ 1⎥⎦
( )
where the likelihood p y ( j ) | y1: j −1 , M i is the one step ahead
And the parameters of the Markov chain are:
output prediction density based on the NCS filter M i ,
⎡ 0.35 0.65 0 ⎤
i=0,1,…nf. ⎢
π = ⎢0.225 0.4179 0.3571⎥⎥
According to LLR approach (Li and Kadirkamanathan 2004), ⎣⎢0.225 0.4179 0.3571⎥⎦
in the presence of fault h, the likelihood based on filter M h π (0 ) = [0.3 0.4 0.3]
won’t change obviously, but the likelihoods based on other
filters will decrease. As a result, the LLR S rk (h ) will positively Figure 1 gives the unknown inputs d1 and d2 and faults f1 and
f2. f1 is an abrupt fault while f2 is an incipient fault. The
drift away and take the greatest value among the LLRs
simulation curve of decision element γ 1 (k ) (dashed curve) and
defined by ( 11 ).
decision element γ 2 (k ) (solid curve) are depicted in figure 2
However, as explained in Step 2 of Sec. 3.2, since there is and figure 3. As shown in figure 1, fault 1 happens at instant
unknown input, we can only get the conditional margin 310, and fault 2 at instant 700. From Figure 2, it can be seen
density of Ty (k + 1) . So ( 11 ) should be modified as that γ 1 (k ) and γ 2 (k ) both exceed the threshold at instant 310,
but since γ 1 (k ) is greater than γ 2 (k ) , we can conclude that
k p (Ti y ( j ) | y1: j −1 , M i ) fault 1 occurs. Similarly, figure 3 shows that γ 2 (k ) exceeds
S rk (i ) = ∑ ln
j =r p (T0 y ( j ) | y1: j −1 , M 0 ) ( 12 ) threshold and is greater than γ 1 (k ) after fault 2 occurs, so we
k
ci ( j ) can conclude that fault 2 has occurred. Further, from Fig.2
= ∑ ln
j =r c0 ( j ) and Fig.3, it can be seen that neither of the curves of decision
element is affected by the unknown input d(k). For
where ci ( j ) is the likelihood of the filter M i , which can be comparison, figure 4 gives the result of the decision vector via
UIKF without considering the switching, i.e. the unknown
calculate according to equation ( 9 ). The decision function network-induced delay. We can see that the UIKF lose its
vector is defined as: validity.
[
γ (k ) = γ 1 (k ) γ 2 (k ) " γ n (k ) f
]
( 13 )
γ i (k ) = max S kj (i )
k − N +1≤ j ≤ k
7297
17th IFAC World Congress (IFAC'08)
Seoul, Korea, July 6-11, 2008
6 6
1400
4 4
2 2 1200
0 0
1000
-2 -2
0 500 1000 0 500 1000
800
Fault 1 Fault 2
2.5
600
1.5 2
1 1.5 400
1
0.5
0.5 200
0 0
0
0 500 1000 0 500 1000 0 100 200 300 400 500 600 700 800 900 1000
Fig. 1 Unknown input and fault Fig. 4 Fault detection and isolation result by LLRs using
UIKF instead of the NCS UIKF filter
300
5. Conclusion
250
A new method for fault detection and isolation (FDI) of
200 Networked Control Systems (NCSs) based on Bayesian
estimation of JMLS, UIKF and LLR is proposed in this paper.
150 This method is robust to network-induced delay, and
traditional unknown input. Simulation example shows the
100 effectiveness of the method.
50
ACKNOWLEDGEMENT
0 The work is supported by the National Natural Science Fund
of China under Grant 60574085.
-50
0 100 200 300 400 500 600 700
REFERENCES
Ackerson Guy A., Fu K.S. (1970). On state estimation in
Fig. 2 Fault detection and isolation result by LLRs for the first switching environments. IEEE transactions on automatic
fault control, 15, 10-17.
Darouach M., Zasadzinski M., Bassong Anana A.,
Nowakowski S. (1995). Kalman filtering with unknown
350
inputs via optimal state estimation of singular systems.
International journal of systems science, 26(10), 2015-
300 2028.
250
Doucet A., Neil. J. Gordon, and Vikram Krishnamurthy
(2001). Particle filters for state estimation of jump
200 Markov linear systems. IEEE transactions on signal
150
processing, 49(3), 613-624.
Ho Y.C., Lee R.C.Y. (1964). A Bayesian approach to
100 problems in stochastic estimation and control. IEEE
50 transactions on automatic control, 9, 333-339.
Jaffer A. G., Gupta S. C. (1971). Optimal sequential
0
estimation of discrete processes with Markov interrupted
-50 observations. IEEE transactions on automatic control, 16,
471-475.
-100
600 650 700 750 800 850 900 950 1000 Keller J.Y., Summerer L., Boutayeb M., Darouach M. (1996).
Generalized likelihood ratio approach for fault detection
in linear dynamic stochastic systems with unknown
inputs. International journal of systems science, 27(12),
Fig. 3 Fault detection and isolation result by LLRs for the 1231-1241.
second fault
7298
17th IFAC World Congress (IFAC'08)
Seoul, Korea, July 6-11, 2008
7299