A Framework Model for Packet Loss Metrics Based

on Loss Runlengths
Henning Sanneck and G. Carle
GMD Fokus, Berlin/Germany
fsanneck,carleg@fokus.gmd.de

MMCN 2000
January 25, San Jose, CA

Overview

Introduction
- Motivation
- Window-Based Mean Loss Rate

Loss runlength model with limited state space

- Metrics (\packet events")
- Metrics (\burst loss events")
- Gilbert model

Application of the model and its metrics

Conclusions / Future Work
1

Intro

Motivation

 Multimedia applications are to some extent loss tolerant

(signal redundancy / signal interpolation using decoder state)

 Time-scale over which loss impact has to be assessed is still \short" however
 Loss recovery mechanisms (FEC) are also sensitive to short-term loss
(short transmission groups ! short delay)
 Need additional metrics to describe the loss process
 Variety of models/metrics proposed in the literature
 ! Which metrics are useful ?
 ! Can a common framework for the models/metrics be identied ?
A Framework Model for Packet Loss Metrics Based on Loss Runlengths

Window-Based Mean Loss Rate

Intro

Averaging done over sliding window of m = 5 and m = 100 packets respectively

1

p100(s)
p5(s)

0.9

mean loss rates over window m

0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0
0

100

200

300

400
500
sequence number s

600

700

800

900

Long-term mean loss rate (m = 100) does not reveal dierences in perception
A Framework Model for Packet Loss Metrics Based on Loss Runlengths

Intro

Window-Based Mean Loss Rate (contd.)

w (s)
m

analysis window

1
m

loss indicator
function

l(s)
1
s
1

pm(s)

mean loss rate

over window

Pa

l
( )wm (s

)
l
(s)  wm(s)
=0
=
pm(s) =
m
m
s: sequence number, a: number of packets sent
A Framework Model for Packet Loss Metrics Based on Loss Runlengths

Intro

Window-Based Mean Loss Rate (contd.)

w (s)
m

analysis window

1
s

loss indicator
function

l(s)

k=3

k=2

1
s
p (s)
1

mean loss rate

over window
s

pm dependent on position s (occurence of k lost packets within the window m)

use occurence of k consecutive lost packets within the window m instead
! only dependent on k, occurence of loss runlengths (ok) is base measure

A Framework Model for Packet Loss Metrics Based on Loss Runlengths

Loss runlength model with limited state space

p m0
p10
p

00

p 20
X== 1

X=0

p 01

X== 2

p 12

p 23

X== m

pmm

p(m-1)m

 X = k: \exactly k consecutive packets lost"

 X  k: \at least k consecutive packets lost"
 X = m: \m consecutive packets lost"

m (model order) set e.g. to lowest number of packets for which an audio
\dropout" is perceived

 ! estimation of model parameters with loss runlengths k

A Framework Model for Packet Loss Metrics Based on Loss Runlengths

Loss runlength model

burst loss (0 < k < m)

burst loss (k = m)

loss over window m

mean loss
cumulative loss
(0 < k < m)
conditional loss
(1 < k < m)
conditional loss
(k = m)

Metrics (packet events)

pL;k = oak
1 (n m + 1)o
n
pL;m =
n m a m+1

X ko
a
X
o
k

pL =
pL;cum(

k=1

)=

n=k

pL;cond(m) = ( d mm)on
n m
(d: number of drops)
=

P (X  k )

L;cum

Xn

E [X ]

(k )
pL;cond(k) = p pL;cum
(k
1)

(state probability)

P (X = k )
P (X = m)

(state probability)

P (X  kjX  k 1)
(state transition prob. p k k )
P (X = mjX = m)
(state transition prob. pmm)

A Framework Model for Packet Loss Metrics Based on Loss Runlengths

1)( )

Loss runlength model

Metrics (burst loss events)

 Y = k: \length of burst loss is exactly k packets"

Loss runlength model
burst loss length (k > 0)
mean burst loss length

a arrivals
a!1
gk = P1ok o
P (Y = k)
n=1 n
P
1
1
X
ko
d
k
g = P1 o = Pk1=1 o = kgk
E [Y ]
k=1 k
k=1 k k=1

A Framework Model for Packet Loss Metrics Based on Loss Runlengths

Loss runlength model for m = 1: Gilbert model

1-P(X=1|X=1)
p00

X=0

X=1

P(X=1|X=1)

p01

 Geometric distribution for residence in state X = 1:

P (Y = k) = P (X = 1jX = 1)k 1(1 P (X = 1jX = 1)); k > 0

A Framework Model for Packet Loss Metrics Based on Loss Runlengths

Application of the model and its metrics

 Trace analysis (real/simulation traces): what model order is applicable for a
certain application in a certain network environment ?

 Trace synthesis: performance assessment of hop-by-hop loss control and end-toend loss recovery

 \Derived" metrics (IETF draft-ietf-ippm-loss-pattern-02.txt),

\composite" metrics (using both loss and no-loss runlengths):
noticeable loss rate: NLR

 Examples for trace analysis:

- periodic trac (voice without silence detection)

- 100000 500000 packets per trace (ca. 1=2 3 hour); visual stationarity
check
>
- various long paths ( 15 hops) within Europe and Europe $ US
- examples show persistent network behaviour (over several hours or even days)

A Framework Model for Packet Loss Metrics Based on Loss Runlengths

10

Example 1: Gilbert model t

P(X=1|X=1) = 0.47

10

k1

P(X=1|X=1)
P(Y=k)

(1P(X=1|X=1))

burst packet loss probabilities P(.)

10

10

10

P(Y=k) (measured)

10

10

-6
10 10 00

P(Y=k) (Gilbert model)

10

15

20
25
30
length of loss burst k

35

40

length of loss burst k

A Framework Model for Packet Loss Metrics Based on Loss Runlengths

45

50
50

11

Example 1: State Probabilities

0

10

1
1

burst packet loss probabilities P(.)

10

P(X=1)=0.04

P(X=k)
P(X>=k)
P(X=m)

10

P(X=m): loss over window m

3

10

P(X>=k): cumulative loss

4

10

10

-6
10 10

P(X=k)

5
10
15
20
25
30
35
40
45
50
00
50
length of loss burst k, length of loss window m
length of loss burst k, length of loss window m

A Framework Model for Packet Loss Metrics Based on Loss Runlengths

12

Example 1: Conditional Loss Probabilities

1

burst packet loss probabilities P(.)

0.9

0.8

0.7

0.6

0.5

0.4
P(X>=k|X>=k1)

0.3

10

15

20
25
30
length of loss burst k

35

40

A Framework Model for Packet Loss Metrics Based on Loss Runlengths

45

50

13

Example 2: Gilbert model t

0

P(X=1|X=1) = 0.79

10

P(X=1|X=1)k1(1P(X=1|X=1))
P(Y=k)

burst packet loss probabilities P(.)

10

P(Y=k) (measured)

10

P(Y=k) (Gilbert model)

3

10

10

-5
10 0
0

10

15
20
length of loss burst k

25

length of loss burst k

A Framework Model for Packet Loss Metrics Based on Loss Runlengths

30

35
35

14

Example 2: State Probabilities

P(X=1)=0.79

10

P(X=m)

P(X=k)
P(X>=k)
P(X=m)

burst packet loss probabilities P(.)

10

P(X>=k)
2

10

P(X=k)
3

10

10

-5
10

0
0

10
15
20
25
length of loss burst k, length of loss window m

35
35
length of loss burst k, length of loss window m

A Framework Model for Packet Loss Metrics Based on Loss Runlengths

30

15

Example 3: Gilbert model t

P(X=1|X=1)=0.99
1 P(Y=k) (measured)
0

10

burst packet loss probabilities P(.)

10

(1P(X=1|X=1))

P(Y=k) (Gilbert model)

10

P(X>=k)

10

P(X=k)

10

-5
10

k1

P(X=1|X=1)
P(Y=k)
P(X=k)
P(X>=k)

8
10
12
length of loss burst k

14

16

length of loss burst k

A Framework Model for Packet Loss Metrics Based on Loss Runlengths

18

20

20
16

Example 3: State Probabilities

1 P(X=1)=0.49
P(X=m)
0

10

P(Y=k)
P(X=k)
P(X>=k)
P(X=m)

burst packet loss probabilities P(.)

10

10

P(X>=k)

10

P(Y=k)

10

P(X=k)
-5
10
80 length of loss burst k, length of loss window m140
80

90

100
110
120
length of loss burst k, length of loss window m

A Framework Model for Packet Loss Metrics Based on Loss Runlengths

130

140

17

Conclusions / Future Work

 Framework model with variable complexity based on loss runlengths
 Expression of well-known and novel loss models and metrics
 Useful for trace assessment and trac generation
 Autocorrelation and composite metrics (cross-correlation loss/no-loss
runlengths)

 Packet-level metrics: ow/ADU structure is not taken into account (video),

however estimation/mapping possible
For some ow types (waveform-coded audio): packet = ADU

 Link to application-level metrics / user perception needed

A Framework Model for Packet Loss Metrics Based on Loss Runlengths

18