Roaming Test Case Summary for XL Network
Roaming Test Case Summary for XL Network
March, 20 2025
CONTENTS
2G Mobility
4G Idle Mode Interoperability LTE- 4G Radio Resource
2G Basic Service management in 4G Basic Service
connected mode Management 2G Management
• CS Call MOC and • Inter BSC handover • Emergency Call • IMSI ATTACH • SRVCC • Scheduling Priority
MTC for 2G • New IMEI Detect • CSFB and Fast
• SMS MO and SMS • Call Center Attach Detach Return (related
MT • IDD (International FPLMN (Forbidden SPID/QOS/QCI if any)
• Emergency Call Direct Dial) call
• IDD (International MOC/VOIP PLMN)
Direct Dial) call • International SMS OTA testing ( NR area
MOC/ VOIP MO
• International SMS • Roaming inbound only )
MO • Roaming inbound "R" Mark (R = Roaming)
• GPRS VoLTE(voice call) -
• USSD (Call setup time 4s) Network
• SMS Over LTE Display/Operator Logo
• SMS Over SGs
• ViLTE(video call) NITZ ( Network
• FUP test Identity Time Zone )
• Signal Strenght (>-
105 dBm), SINR >6 Paging PS
dB Combine attach
EPC Selection
System Information
Broadcast
Cell Selection and
Reselection
CONTENTS
4G Mobility
4G Interoperability
4G Application 4G Charging 4G IT management in Registration
Multi Vendor
connected mode
• APN Testing • Subscriber who • VIVA • MOCN – MOCN : Intra • MOCN – Non MOCN • 4444 registration
• Web Browsing doesn't have data • Sidompul / ROAMING - NON
(Browsing start package in PCRF (No • NPerf and Inter Frequency ROAMING : Intra
delay <5s) per band Quota Has Balance) Handover (X2 and Inter Frequency
• Speed Test (TBD, SF • Subscriber who Handover (S1/X2)
have Netvelocity) doesn't have data Mandatory) • MOCN – MOCN /
per band package in PCRF (No • MOCN – Non MOCN : ROAMING -
• Open Aplication Quota no balance at ROAMING : Intra
(WhatsApp, all) Intra and Inter and Inter Frequency
Facebook, YouTube) • SMS Frequency Handover Handover (All
- (Surfing • USSD services) - X2
Application start • MyXL (S1/X2)
delay <5s) • MySmartfren • IPV4 Saving Limit
• VoIP Call • Redirection Page
(Whatsapp, Wechat) Allocation IP priotiy
• Video Call IPV6
(Whatsapp, Wechat)
• Live Streaming • IPV6
(Tiktok, YouTube) • Restriction TAC for
• Games (PUBG,
eNodeB for National 4G Carrier
Mobile Legend,FF) - APH Subscriber
Latency (info only ) ROAMING Aggregation
Location Query
• MOCN – MOCN : Intra
( 2CC/3CC )
• Carrier Aggregation • Subscriber location
and Inter Frequency
query
Handover (all services)
- X2
Summary Test Case ROAMING SAMBOJA
Summary :
• Total design test Case 112 items, 94 applicable in the roaming POC
Border NR area
• Design for XL Network 60 items, 48 applicable in the roaming POC (1st phase)
• Design for SF Network 52 items, 47 applicable in the roaming POC
XL
TECH Category OPT Testing Scenario Sub-Scenario XL Any Band Remark
2G Mobility management in connected mode XL Inter BSC handover for 2G Not Applicable POC NR still under same BSC with surrounding (no bsc border), SF doesn't have 2G
4G Idle Mode Management XLSmart IMSI ATTACH FPLMN (Forbidden PLMN) Not Applicable Roaming area is in XL existing network area
4G Idle Mode Management XLSmart IMSI ATTACH OTA testing ( NR area only ) Not Applicable Roaming area is in XL existing network area
4G Idle Mode Management XLSmart IMSI ATTACH "R" Mark (R = Roaming) Not Applicable Roaming area is in XL existing network area
4G Charging XLSmart SMS Not Applicable XL doesn’t have feature sms check (confirm by customer)
4G Charging XLSmart Redirection Page Not Applicable XL redirection not available
4G Mobility management in connected mode XLSmart MOCN – MOCN : Intra and Inter Frequency Handover (X2 Mandatory) Not Applicable non MOCN area, this area is roaming area
4G Mobility management in connected mode XLSmart MOCN – Non MOCN : Intra and Inter Frequency Handover (S1/X2) Not Applicable non MOCN area, this area is roaming area
4G Mobility management in connected mode XLSmart Restriction TAC for eNodeB for National Roaming on border area, Specific Test number Not Applicable Roaming area is in XL existing network area
4G Mobility management in connected mode XLSmart MOCN – MOCN : Intra and Inter Frequency Handover (all services) - X2 Not Applicable non MOCN area, this area is roaming area
4G Interoperability Multi Vendor XLSmart MOCN – Non MOCN / ROAMING - NON ROAMING : Intra and Inter Frequency Handover (S1/X2) Not Applicable Roaming area is in XL existing network area
4G Interoperability Multi Vendor XLSmart MOCN – MOCN / ROAMING - ROAMING : Intra and Inter Frequency Handover (All services) - X2 Not Applicable Roaming area is in XL existing network area
Summary :
• Total Test Case Not Applicable 17 items, on XL Network 12 items and in SF Network 5 items major as below :
• Items related to the MOCN are not applicable for both XL and SF
• Items related to the Roaming are not applicable in XL
Basic Service - CS Call MOC and MTC – 2G
Procedure : Result : 5x MTC and MOC all success, success rate 100%
1. Test Case: CS Call MOC and MTC
2. Test Network:
1. XL 2G (SF 2G Not Applicable)
3. Test Methodology:
1. Stationary Test Call 5x (2G
Network)
4. Test Preparation:
1. 1 test engineer
2. 2 UE with 2 XL sim card (1 MOC
and 1 MTC)
5. Test Step:
1. Open and run screen record
2. Open PHU Application
3. Check the serving network is
correct (2G Network)
4. Open script for CS Call test to B
number
5. Run Script and finish the process
(Call to XL number 5x) Screen Recording MOC Call 5x Screen Recording MTC Call 5x
6. Save the Logfile / video recording MOC MTC
6. Success Criteria: XL UE can call and
receive call in 2G
7. Output: PHU Logfile / Video recording
8. Result: Success
TIME STAMP
TIME STAMP
MO XL SIM MT XL SIM XL Start XL End
85921095946 - 21:06 21:07
Basic Service - Paging CS – 2G
Screen Recording Test CS Call Open PHU Basic Info > PHU Message – Paging Information
Message
TIME STAMP
MO XL SIM MT XL SIM XL Start XL End
85921095946 - 21:43 21:45
Basic Service - SMS MO and SMS MT – 2G
Procedure : Result : 5x SMS MO and SMS MT all success, success rate 100%
1. Test Case: Paging CS 2G
2. Test Network:
1. XL 2G (SF 2G Not Applicable)
3. Test Methodology:
1. Stationary Test 5x (2G Network)
4. Test Preparation:
1. 1 test engineer
2. 1 UE with 1 XL sim card
5. Test Step:
1. Open and run screen record
2. Open PHU Application
3. Check the serving network is
correct 2G Network
4. Open PHU and run script voice call
5. Check basic info > message
6. Save and record the result
6. Success Criteria: XL UE can sent and
receive SMS in 2G
7. Output: Video recording / Log PHU Screen Recording MO SMS 5x Screen Recording MT SMS 5x
8. Result: Success MO MT
TIME STAMP
MO XL SIM MT XL SIM XL Start XL End
85921095946 87859008584 21:36 21:38
Basic Service - Emergency Call – 2G
TIME STAMP
MO XL SIM MT XL SIM XL Start XL End
85921095946 - 21:09 21:11
Basic Service - IDD (International Direct Dial) call MOC/ VOIP – 2G
Procedure : Result : 2x Test International Call (China number) all success, success rate 100%
1. Test Case: Voice Call International 2G
2. Test Network:
1. XL 2G (SF 2G Not Applicable)
3. Test Methodology:
1. Stationary test 2x test
4. Test Preparation:
1. 1 test engineer
2. 1 UE with 1 XL SIM card (MOC)
5. Test Step:
1. Open Screen record
2. Check the serving network is
correct 2G
3. Call International Number via 2G
Network (duration 5s) / Run Script
voice call and finish the process if
use PHU (during test using MTC
Malaysian number)
4. Save video / Save PHU Logfile
6. Success Criteria: XL UE can call
international number
7. Output: PHU Logfile / Video recording
8. Result: Success Screen Recording International Call to International Call Success
Malaysian Number
TIME STAMP
MO XL SIM MT XL SIM XL Start XL End
85921095946 60193671183 11:52 11:53
Basic Service - International SMS MO – 2G
Screen Recording Running script FTP DL on UE success access FTP DL using 2G network
PHU
TIME STAMP
MO XL SIM MT XL SIM XL Start XL End
85921095946 - 21:47 21:49
Basic Service - Emergency Call – 4G
Procedure : Result : 2x Test International Call (China number) all success, success rate 100%
1. Test Case: Voice Call International number
2. Test Network:
1. XL 4G, SF 4G
3. Test Methodology:
1. Stationary test 2x
4. Test Preparation:
1. 1 test engineer
2. 2 UE with 1 XL and 1 SF SIM cards
for MOC
3. 1 UE with international number for
MTC
5. Test Step:
1. Open and run Screen Record /
Open PHU Application
2. Check the serving network is
correct
3. Call International Number via 4G XL Video record SF Video record
Network (during test MT using
Malaysian number) XL MOC number can call international SF MOC number can call international
4. Run Script and finish the process number (sample Malaysian number) number (sample Malaysian number)
5. Save video / Save the Logfile
6. Success Criteria: XL and SF UE can call
international number
7. Output: Video / PHU Logfile TIME STAMP TIME STAMP
8. Result: Success MO XL SIM MT XL SIM XL Start XL End MO SF SIM MT SF SIM SF Start SF End
85921095946 60193671183 11:47 11:49 88210774038 60193671183 11:01 11:02
Basic Service - International SMS MO – 4G
XL Video record UE with INT SIM card can SF Video record UE with INT SIM card can
access network with “R” access network with “R”
logo logo
Procedure : Result : 5x SMS over LTE all success, success rate 100%
1. Test Case: SMS MO and SMS MT
2. Test Network:
1. XL 4G, SF 4G
3. Test Methodology:
1. Stationary test 5x
4. Test Preparation:
1. 1 test engineer
2. 2 UE with 2 XL and 2 SF SIM cards
5. Test Step:
1. Open and run screen record
2. Open PHU Application
3. Check the serving network is
correct and check VoLTE must ON
4. Open script for SMS test to XL/SF
number
5. Open script for MT receive SMS
test
6. Run Script and finish the process XL Screen Recording Setting VoLTE ON XL MO Sent and success SF Screen Recording Setting VoLTE ON SF MO Sent and success
7. Save the Logfile
6. Success Criteria: XL and SF UE can send
and receive SMS in LTE
7. Output: Video / PHU Logfile and check list’
8. Result: Success
Sample trace at core SMS over LTE (XL number) Sample trace at core SMS over LTE (SF number)
SF Screen Recording Check quota daily from Use quota data until After reach limit daily
MySF got message DL Thp decrease
notification
TIME STAMP
MO SF SIM MT SF SIM SF Start SF End
88210774035 - 03:40 03:45
Basic Service – Signal Strength (>-105 dBm), SINR >6 dB – 4G
FPLM
7. Output: Log file PHU
8. Result: SF Success / XL Not Applicable
Details Videos Force manual
FPLMN Forcing manual PLMN After manual select
until get forbidden list, Forcing manual PLMN forbidden PLMN to NR
then moving to NR area during moving to NR area area, not found S.O.S
when arrive to NR area
TIME STAMP
MO SF SIM MT SF SIM SF Start SF End Date SF
088210774035 - 13:45 13:54 12-Mar-25
IMSI ATTACH – "R" Mark (R = Roaming) – 4G
TIME STAMP
MO SF SIM MT SF SIM SF Start SF End
88210774037 - 10:18 10:20
IMSI ATTACH – Network Display/Operator Logo – 4G
MO XL SIM MT XL SIM XL Start XL End Date XL MO SF SIM MT SF SIM SF Start SF End Date SF
85921095946 - 10:05 10:10 8-Mar-25 88221191913 - 16:54 22:45 8-Mar-25
IMSI ATTACH – Paging PS – 4G
Core team success trace XL UE can EPC Selection Core team success trace SF UE can combine attach
TIME STAMP
TIME STAMP
MO XL SIM MT XL SIM XL Start XL End
87859008584 - 22:28 22:31
Radio Resource Management – Scheduling Priority (related SPID/QOS/QCI if any) – 1/1
Volte, QCI=1 WA Video Call, QCI=3 Tiktok, QCI=7 ML, QCI=7 Volte, QCI=1 WA Video Call, QCI=3 Tiktok, QCI=9 ML, QCI=9
Wa VCall_XL
Tiktok_XL
VoLTE_XL VoLTE_SF WA-ViCall_SF Tiktik_SF ML_SF
ML_XL
WA Voice Call, QCI=3 Web Browsing, QCI=6 Youtube, QCI = 6 WA Voice Call, QCI=3 Web Browsing, QCI=9 Youtube, QCI = 9
Time Test : 7 March 2025 (21:51-22:20) WITA Time Test : 7 March 2025 (22:23-22:45) WITA
MISDN: 085921095946 MISDN: 088221191913
IMSI: 510118101588214 IMSI: 510098010905203
Application – APN Testing – 4G
Result HTTP Browsing using PHU, all XL UE sample test < 5s Result HTTP Browsing using PHU, all SF UE sample test < 5s
XL UE : Test result Speed Test using OKLA SF UE : Test result Speed Test using OKLA
Result HTTP Browsing using PHU, all XL UE sample test < 5s Result HTTP Browsing using PHU, all SF UE sample test < 5sz`
XL video record XL UE : sample test watch SF video record SF UE : sample test watch
streaming live Tiktok streaming live Tiktok
Procedure : Result : UE Can Playing Games at NR Area with Latency < 100ms
1. Test Case: Open / Play Games
2. Test Network:
1. XL 4G, SF 4G
3. Test Methodology:
1. Stationary
4. Test Preparation:
1. 1 test engineer
2. 2 UE with 1 XL and 1 SF SIM cards
5. Test Step:
1. Open PHU Application, capture
CGI
2. Call Core Team to Trace QCI
assignment
3. Open Screen Record and record XL UE sample playing PUBG Mobile with latency 55ms SF UE sample playing Mobile Legend with latency 95ms
screen
4. Open Games and play
(PUBG/ML/FF)
5. Record the result
6. Success Criteria: XL and SF UE can play
games with latency < 100ms & QCI TIME STAMP TIME STAMP
Assignment from Core MO XL SIM MT XL SIM XL Start XL End MO SF SIM MT SF SIM SF Start SF End
7. Output: Video record screen 85921095946 - 14:47 14:50 8221191913 - 00:06 00:09
8. Result: Success
Charging – Subscriber who doesn't have data package in PCRF (No Quota Has Balance)
XL video record XL UE still can access MyXL SF video record SF UE still can access MySF
SF video record
SF UE can check balance using SMS
TIME STAMP
MO SF SIM MT SF SIM SF Start SF End
88210774038 - 23:26 23:27
Charging – Check Balance Using USSD
TIME STAMP
MO XL SIM MT XL SIM XL Start XL End
085921095946 - 14:56 14:57
Charging – MySF - GMLC (Local Quota Claim) / Subscriber location query
Video record
TIME STAMP
MO SF SIM MT SF SIM SF Start SF End
088210774037 - 15:46 15:55
IT – Sidompul / VIVA
Tiktok
Sample Core trace RG XL UE each service Sample Core trace RG XL UE each service
Charging – Redirection Page
XL UE can access internet XL UE can access internet SF UE can access internet SF UE can’t access internet
after chose IPV4 after chose IPV6 after chose IPV4 after chose IPV6
TIME STAMP TIME STAMP
MO XL SIM MT XL SIM XL Start XL End MO SF SIM MT SF SIM SF Start SF End
85921095946 - 14:22 14:24 88210774038 - 18:09 18:11
Restriction TAC for eNodeB for National ROAMING
TIME STAMP
XL new sim card NY register can register at NR area SF new sim card NY register can register at NR area
Procedure : Result : UE Success HO from NR to non-NR area with event inter EARFCN / MME
1. Test Case: Moving PS NR > non-NR (SF Area) Sample Success from UE eNodeB (S1)
2. Test Network:
Non-NR
1. SF 4G
3. Test Methodology:
1. Moving DL
4. Test Preparation:
1. 1 test engineer
2. 1 UE with 1 SF SIM cards
5. Test Step:
NR Area
1. Open PHU Application
2. Open script for FTP download
3. Run Script and finish the process
4. Save the Logfile
6. Success Criteria: XL SF can HO inter Sample Success from MME
MME
7. Output: Logfile PHU
8. Result: Success
TIME STAMP
MO SF SIM MT SF SIM SF Start SF End
088210774037 - 14:11 14:23
Handover Inter MME – non-NR (SF native Area) XL NR
Procedure : Result : UE Success HO from NR to non-NR area with event inter EARFCN / MME
1. Test Case: Moving PS non-NR (SF Area) XL NR Sample Success from UE eNodeB (S1) Core
2. Test Network:
1. SF 4G Tracing core SF Success HO (18-Mar)
8. Result: Success
(17-mar)
(17-Mar)
TIME STAMP
MO SF SIM MT SF SIM SF Start SF End
088210774037 - 14:11 14:23
Moving PS – SF Native XL NR area
TIME STAMP
MO SF SIM MT SF SIM SF Start SF End UE try attempt and success to PLMN 51009
Video Record
TIME STAMP