DT Guidance

1、DT KPI:

DT KPI - Voice Service - End to End CAC PAC FAC

Service Indicator KPI Weighting Level 0 Level 1 Level 2
CSFB Accessibility Voice - Outgoing Call Setup Success Rate 0.5 97 98.5 99

CSFB Accessibility Voice - Incoming Call Setup Success Rate 0.3 97 98.5 99

Service
CSFB Voice - Outgoing Call Setup Time 0.3 6 6 6
Integrity
Service
CSFB Voice - Incoming Call Setup Time 0.3 3.5 3.5 3.5
Integrity
Service
PS Ping Packet Loss Rate UL/DL 0.5 1 1 1
Integrity
PS Mobility Handover Success Rate Intra Frequency 0.5 97 98 98.5
PS Mobility Handover Success Rate Inter Frequency 0.3 97 98 98.5
PS Mobility Handover Success Rate InterRAT 0.3 96 97 98
Return to LTE Success Rate (Reselection
PS Mobility 0.3 97 98 98.5
from other RAT)
Time to Return to LTE (Reselection from
PS Mobility 0.3 5 5 5
other RAT)
Service
PS SINR >= 12 dB at RSRP >=-90dBm 0.5 70 75 80
Integrity
Data session Setup Success Rate (PDP
PS Accessibility 0.5 98 99 99.5
context already exist)
Service Moving MS near site , Min FTP download
PS 0.3 5 5 5
Integrity file size 1024 MB for LTE
Service Moving MS near site , Min FTP upload file
PS 0.3 3 3 3
Integrity 1024MB for LTE
Service Stationary MS near site , Min UDP
PS 0.3 10 10 12
Integrity download file 1024MB for LTE
Service Stationary MS near site , Min UDP upload
PS 0.3 8 8 8
Integrity file 1024MB for LTE
Service MS roundtrip Ping time latency (RTT Ping
PS 0.5 25 20 18
Integrity 32)
 Index
1、DT KPI: ......................................................................................................................................... 1
2、DT Test ......................................................................................................................................... 3
2.1 CSFB Test ............................................................................................................................. 3
2.3 PS Moving Test .................................................................................................................... 3
2.3 PS Stationary Test ................................................................................................................ 4
2.4 Ping Test .............................................................................................................................. 5
3、DT Test Report ............................................................................................................................. 5
3.1 CSFB Analysis ....................................................................................................................... 6
3.2 Handover Success Rate Intra Frequency ........................................................................... 11
3.3 Return To LTE ..................................................................................................................... 11
(1) Return to LTE Success Rate ........................................................................................ 11
(2) Time to Return to LTE ................................................................................................ 12
3.4 Ping Test ............................................................................................................................ 15
(1) Ping Packet Loss Rate UL/DL ...................................................................................... 15
(2) MS roundtrip Ping time latency (RTT Ping 32) ........................................................... 15
3.5 Throughput Test ................................................................................................................ 16
3.6 Data session Setup Success Rate....................................................................................... 17
2、DT Test

(1) Please do test in idle time, avoid network congestion;

(2) Please keep enough teleohone charge in the test.
(3) Please do CSFB and Ping test in first round and do upload and Download test in second round.

2.1 CSFB Test

(1) Select good wireless enviornment near the site in driving test(Check the RSRP and SINR in
Probe, RSRP>-100dBm and SINR>10dB).
(2) Close UE mobile data switch in CSFB test.
(3) If the 2G/3G core network belong to Nokia, it will have fast return failure issue which has been
confirmed by Nokia and H3I HQ. H3I HQ have agreed give the pass for the KPI of fast return. We
can put fast return success rate value to 100%. (Boy will provide the sites list)
(4) Please start record the LOG from second call, because the first call has long CSFB delay.

2.3 PS Moving Test

(1) Select good wireless enviornment near the site in driving test(Check the RSRP and SINR in
Probe, RSRP>-100dBm and SINR>10dB).
(2) Upload 10 files simultaneously in FTP server, the minimal sizes of every files is 1G. (moving
upload test)
(3) Download 10 files simultaneously in FTP server, the minimal sizes of every files is 1G. (moving
download test)
(4) Please keep download/upload 30s and then start record LOG.
2.3 PS Stationary Test

(1) Select a good position near the site doing test (RSRP>-85dBm and SINR>25dB).
(2) Upload 10 files simultaneously in FTP server, the minimal sizes of every files is 1G. (stationary
upload test)
(3) Download 10 files simultaneously in FTP server, the minimal sizes of every files is 1G.
(stationary download test)
(4) Please keep download/upload 30s and then start record LOG.
(5) If the target value achived, can stop the test.
2.4 Ping Test

(1) Please start record LOG from second ping test, because first ping has long delay.
Set the “Test Interval(ms)” to “1000” in ping test.

3、DT Test Report

Note: When create Assistant Project, please select “all”.

3.1 CSFB Analysis

(1) Input the CSFB test LOG to Assistant and Analysis.

(2) Check the KPI and statistic the Voice - Outgoing Call Setup Success Rate and Voice - Incoming
Call Setup Success Rate.

(3) Statistic the Voice - Outgoing Call Setup Time and Voice - Incoming Call Setup Time.
The formula of CSFB call setup time is defined from signaling “ ExtendedServiceRequest” to
“Alerting”, So we will define this KPI in Assistant first.
① Define the CSFB call setup time KPI in Assiatant.
Select “Custom Analysis” “Delay” “One Delay” “New”
Select “Begin Message” “Add Message” “L3 Message” “NAS” “LTE”
“ExtendedServiceRequest”
Select “End Message” “Add Message” “L3 Message” “NAS”
“WCDMA&GSM&TD-SCDMA NAS” “Call Control” “Alerting”
Set “Name” to “CSFB Call Setup Time”;
Set “Times Out (ms)” to “8000”.
② Check the CSFB Call Setup Time.
3.2 Handover Success Rate Intra Frequency

It can be get in “KPI Result” of Assistant.

3.3 Return To LTE

If the 2G/3G core network belong to Nokia, it will have fast return failure issue which has been
confirmed by Nokia and H3I HQ. H3I HQ have agreed give the pass for the KPI of fast return. We
can put fast return success rate value to 100%. (Boy will provide the sites list)

(1) Return to LTE Success Rate

It can be get in “KPI Result” of Assistant.

(2) Time to Return to LTE

The formula of Fast Return Delay is defined from Event “WCDMAInterRAT

RedirectionToLTEAttempt” to “LTERRCSetupSuc”, So we will define this KPI in Assistant first.
① Define the Fast Return Delay KPI in Assiatant.
Select “Custom Analysis” “Delay” “One Delay” “New”

Select “Begin Message” “Add Message” “Event” “Other” “WCDMAInterRAT

RedirectionToLTEAttempt”.
Select “End Message” “Add Message” “Event” “LTE” “LTERRCSetupSuc”.
Set “Name” to “Fast Return Delay”;
Set “Times Out (ms)” to “7000”.
Check the Fast Return Delay.
3.4 Ping Test

(1) Ping Packet Loss Rate UL/DL

It can be get in “KPI Result” of Assistant.

(2) MS roundtrip Ping time latency (RTT Ping 32)

It uses the minimum value of ping, if minnimum value is zero in Assistant, export the result to
Excel and use the minimum non zero value.
① The minimum value of ping is non zero in Assistant.
② The minimum value of ping is zero in Assistant.

Export the result and use the minimum non zero value, so the ping value of follow figure is
“32ms”.

3.5 Throughput Test

Please obey follow regulation when statistic the UL/DL throughput KPI.
1) RSRP ≥ -90 dBm
2) SINR ≥ 12 dB
3) Distance ≤ 300 meters (DU) or ≤ 500 meters (U, SU, R)
4) Exclude Throughput = 0
If the position can’t satisfy above, exclude it.

3.6 Data session Setup Success Rate