TEMS Pocket 20.0.3 - Release Note

Download as pdf or txt
Download as pdf or txt
You are on page 1of 15

TEMS Pocket 20.0.

3 Release Notes

1 About This Document


This document contains the release notes for all TEMS Pocket 20.x releases,
including Pocket Standard, Professional, Lite, and VeriSite.
New features that are applicable only to TEMS Pocket Professional are tagged with
the superscript Prof (for “Professional”), and features applicable only to TEMS Pocket
VeriSite are marked with the superscript VS (for “VeriSite”). This convention is used
for brevity; please note that tagged items also apply to the Standard product
package, except for data recording, which the Standard package does not support.
© InfoVista Sweden AB 2018. All rights reserved.
TEMS is a trademark of InfoVista. All other trademarks are the property of their
respective holders.

2 Important Information
HTTP testing with the Webkit based client, which is external to TEMS Pocket, will
only work on a subset of device models. On devices that do not support this
function, a notification to that effect (“OnDeviceHttpWebkitService – Not supported
on this device.”) will appear on the Android top bar.
If you are using Sony devices and getting low AQM scores or inaccurate position
data, see the advice at the end of section 6.4.
If you get a 404 error when you try to access the online User's Manual, Quick Guide
or Release Note from TEMS Pocket, you need to clear the application cache:
1. Launch the device's Settings app
2. Tap Apps (or Applications) > TEMS Pocket UI > Storage
3. Tap the Clear Cache button
4. Close the Settings app
5. Restart TEMS Pocket

3 Installation and Upgrading


To install TEMS Pocket 20.0 on a device, please follow the instructions in the TEMS
Pocket 20.x Installation Guide.
Please note that there are separate installation packages for some devices:
 For devices running Android 5.x, use the TEMS Pocket Android 5.x
installation package.
 For other devices, use the TEMS Pocket installer.

© InfoVista Sweden AB (2018) May 25, 2018 1


Note: Before you upgrade a device from an older version of TEMS Pocket to
TEMS Pocket 20.x, you MUST contact InfoVista technical support for more
information.

Note: Always reboot your device after installing or upgrading TEMS Pocket.

© InfoVista Sweden AB (2018) May 25, 2018 2


4 TEMS Pocket 20.0.3
4.1 New Devices

4.1.1 Sony XZ1 701SO


The Sony XZ1 701SO is a version of the Sony Xperia ZX1 for the Japanese market.
With TEMS Pocket you can perform network testing using advanced on-device
client software, like high-speed data testing and voice calling while controlling the
phone behavior.
Specifications *
 Frequency bands:
 LTE: B1(2100), B2(1900), B3(1800), B4(1700), B8(900), B11(1500),
B12(700), B17(700), B28(700), B38(2600), B39(1900), B40(2300),
B41(2500)
 WCDMA: B1(2100), B3(1800), B4(1700), B8(900)
 GSM: 850, 900, 1800, 1900
 Throughput capabilities:
 LTE: Category 16* (1000/150 Mbit/s)
 Real-time control capabilities:
 Lock on RAT: LTE/WCDMA/GSM
 Lock on Band: LTE/WCDMA/GSM
 LTE Cell Lock: EARFCN and PCI Lock
 WCDMA Cell Barred Control
 WCDMA Fast Dormancy Control **
 GSM Cell Lock
 GSM Cell Barred Control
 APN Control
 Google Android 8.0
 WLAN 802.11a/b/g/n/ac (2.4 and 5 GHz)
 Chipset/CPU:
 Qualcomm Snapdragon 835 MSM 8998 (10 nm (4 x 2.35 GHz Kryo & 4 x 1.9
GHz Kryo))
 TEMS Investigation Connect License:
 Sony D
* Depending on the network and SIM card, some functions may not be available in
all variants or markets.
** WCDMA Fast Dormancy Control won't work on the new cell if you select a cell on
another band. Release the control, select the new cell, then apply it to the new cell.

© InfoVista Sweden AB (2018) May 25, 2018 3


4.1.2 Samsung Galaxy Note4 SM-N910F
The Android 6 version of the Samsung Galaxy Note4 SM-N910F is supported by
this release. See the TEMS Pocket 20.0.3 Device Specification for details.

4.2 New Features

4.2.1 OnDevice SMS over IMS - Send and Receive


You can now perform end-to-end testing of the IMS SMS service. The SMS script
action Type can now be set to:
 Send - as in previous releases, used to send an SMS to the specified device
 Receive - new, waits to receive an SMS that matches the specified condition
e.g. starts with "This". Match Type can be set to:
o Regular Expression: enter a regular expression in Match Text that
matches your message
o Starts With: enter a string in Match Text that matches the start of
your test message
o Ends With: enter a string in Match Text that matches the end of
your test message
SMS testing can be monitored on the SMS Progress tab of the Test Status data
view. This displays the number of successful and failed sends and receives, and the
total number of attempts.

4.2.2 eNB antenna support


The number of Tx antennas per carrier is now reported (in the LTE data view) for all
supported devices with Qualcomm or Shannon chipsets.

4.2.3 Android 8 support


Android 8 is now supported on a range of devices:
 Sony Xperia XZ1 701SO
 Sony Xperia XZ Premium G8141 & G8142
 Samsung Galaxy S8 SM-G950F
 Samsung Galaxy S8 SM-G950U
See the TEMS Pocket 20.0.3 Device Specification for details.

4.2.4 Logfile replay


Logfile replay within TEMS Pocket has been made faster: the replay slider can now
be used to fast forward / reverse through the logfile at between 20x and 60x normal
speed.
Note: This function can be used to replay small TEMS Pocket logfiles in TEMS
Pocket. Large logfiles (of more than a few minutes) should be loaded into TEMS
Investigation or TEMS Discovery Device for improved performance. Logfiles from

© InfoVista Sweden AB (2018) May 25, 2018 4


other TEMS products must be loaded into TEMS Investigation or TEMS Discovery
Device for replay.

4.3 Corrected Bugs


 SR00234184: Side menus hard to access on curved models (Galaxy S8)
 SR00241249: On the S8 SM-G950F Control function is missing in 25% of the
time when TEMS Pocket is started
 SR00241250: APN lock should not control pad lock
 SR00242122: Timing Advance (LTE Data>Common) does not work
 SR00243007: Can't see any SIP signalling
 SR00246679: XZP HTTPs URL shown as HTTP URL
 SR00247471: The S8 SM-G950U is missing WCDMA Band 9 and LTE Band 28
 SR00247768: Detected cells reporting is bad
 SR00247905: MCS CQI PMI values missing
 SR00248088: LTE secondary cell throughput populated when only one cell
 SR00249650: Samsung S8 TEMS Pocket cannot replay TEMS Pocket logfiles
 SR00249962 CI information is missing from the Data View header
 SR00250259: Dial failures are reported as "Unknown" rather than dropped or
blocked
 SR00250454 TEMS Director Script Designer additional parameter settings do
not persist
 SR00252857: S1 reported when Carrier aggregation not active
 SR00254494: Script does not stop after Deactivation or Removal
 SR00255852: Stopping logfile recording forces GPS turn off
 SR00256236: No SIP messages displayed for S8 SM-G950U
 SR00256240: TEMS Pocket logfile replay pinpoint display issue
 SR00259770: Voice Script does not work

4.4 Removed Features


The Logfile Replay Back buttons (<1s and <1m) are no longer used. You can use
the slider to rewind the logfile replay.

4.5 Withdrawn Devices


None

© InfoVista Sweden AB (2018) May 25, 2018 5


5 TEMS Pocket 20.0
5.1 New Devices

5.1.1 Samsung Galaxy S8 SM-G9500


The Samsung Galaxy S8 SM-G9500 is a Qualcomm based Android smartphone
aimed for the Chinese market. With TEMS Pocket you can perform network testing
using advanced on-device client software, like high-speed data testing and voice
calling while controlling the phone behavior.
Specifications*:
 Frequency bands:
 LTE: B1(2100), B2(1900), B3(1800), B4(AWS), B5(850), B7(2600), B8(900),
B12(700), B13(700), B17(700), B18(800), B19(800), B20(800), B25(1900),
B26(850), B28(700), B38(2600), B39(1900), B40(2300), B41(2500)
 WCDMA: B1(2100), B2(1900), B5(850), B8(900)
 CDMA: CDMA800, BC0(800)
 TD-SCDMA: B34(2010), B39(1880)
 GSM: GSM850, GSM900, DCS1800, PCS1900
 Throughput capabilities:
 LTE: Category 16* (1000/150 Mbit/s)
 HSDPA Category 24 (42 Mbit/s), HSUPA Category 6 (5.8 Mbit/s)
 GPRS/EDGE Class 12
 Real-time control capabilities:
 Lock on RAT: GSM/WCDMA/CDMA/LTE
 Lock on Band: GSM/WCDMA/CDMA/LTE
 GSM ARFCN
 WCDMA UARFCN
 WCDMA UARFCN+PSC
 LTE EARFCN+PCI
 WB AMR Control
 Google Android 7.0
 WLAN 802.11a/b/g/n/ac (2.4 and 5 GHz)
 Chipset/CPU:
 Qualcomm Snapdragon 835 MSM 8998 (10 nm (4x2.35 GHz Kryo & 4x1.9
GHz Kryo))
 TEMS Investigation Connect License:
 Qualcomm K

© InfoVista Sweden AB (2018) May 25, 2018 6


*Depending on network and SIM-card, all functions may not be available in all
customizations or markets.

5.2 New Features

5.2.1 Synchronize all devices before beginning the test


The new script action, SynchPoint, is used to make sure that both parties in a
mobile to mobile test are ready to start. It synchronizes the devices before executing
the corresponding test actions (like call/answer) to avoid errors due to devices not
being in sync.

5.2.2 Advanced scripting services


The new ODM Scripting Service action makes it possible to control any application
(like a Speed Test app etc.) on the device from a TEMS Pocket script. By using
Python scripting commands, you can control applications and set dynamic KPIs,
which will be returned and logged to the TRP logfile for later post processing.
Please note that InfoVista do not offer any support or documentation for Python
scripting.

5.2.3 PESQ quality measurements on M2F calls


It is now possible to perform audio quality measurements using the PESQ algorithm
on mobile to fixed calls. This makes it possible to ensure that voice quality is as
good as possible not only for mobile to mobile calls, but also mobile to fixed calls.

5.2.4 New LTE bands supported in Band lock on Qualcomm devices


The Band lock in TEMS Pocket has been improved to be able to lock to the
additional LTE Band 65-71 on Qualcomm based devices.

5.3 Corrected Bugs


 The PDSCH MCS CW0/1 never shows 256QAM in the LTE Data Carrier tab.
 Control functions missing on the Samsung SM-G950F.
 Time Second does not persist during upgrade.
 Aborted synchronization operation counter not set to zero after successful sync.
 Agents keep ending up in Not Registered state.
 Facebook problems.

5.4 Removed Features


None

© InfoVista Sweden AB (2018) May 25, 2018 7


5.5 Withdrawn Devices
 HTC 10 (M10H)
 HTC Nexus 9
 HTC One M8f
 Samsung Galaxy A5 SM-A500F
 Samsung Galaxy Note 4 SM-N910T
 Samsung Galaxy Note 5 SM-N920T
 Samsung Galaxy S6 Active SM-G890A
 Samsung Galaxy S6 Edge SM-G928P
 Samsung Galaxy S6 SM-G9208
 Samsung Galaxy S6 SM-G920F
 Samsung Galaxy S6 SM-G920I
 Samsung Galaxy S7 SM-G930U
 Samsung Galaxy Tab S2 SM-T815
 Samsung Galaxy Tab S2 SM-T819
 Sony Xperia Z5 501SO

© InfoVista Sweden AB (2018) May 25, 2018 8


6 Known Bugs and Limitations
6.1 TEMS Pocket Application Related
 Facebook, when used in TEMS Pocket, currently results in operation errors for
some operations.
 LTE MiMo RSSI and RSRQ are sometimes not correctly displayed on the Sony
Xperia XZ Premium, G8141 and G8142.
 The call dialog is not always hidden during MT call on the Sony Xperia XZ
Premium, G8141 and G8142.
 The idle cell list is not always updated on the Sony Xperia XZ premium, G8141
and G8142.
 When resetting LTE Band Lock on HTC M10h, the device changes RAT to
WCDMA and will consequently not measure on LTE after that. As a workaround,
locking on all supported LTE bands will effectively reset the band lock.
 Global mode, which can be activated on CDMA devices, is not supported in
TEMS Pocket. This means that GSM/UMTS operation is not supported, and no
data from these technologies can be presented.
 When using TEMS Pocket for FTP transfer, the throughput will be lower than
when using the phone as a modem.
 When the device is on GSM, the application layer throughput displayed during
HTTP and FTP sessions might dip periodically. The average throughput,
however, is not affected and is calculated correctly.
 When transferring very large files over FTP (for example, 9 concurrent
downloads of a 1 GB file), errors will occur in session progress information:
negative percentages and erroneous byte counts/times.
 When executing several HTTP Get actions in a row, the timestamp of the first
data report of one action may sometimes actually be identical with the timestamp
of the last data report from the previous action. This can occur for FTP as well.
 TEMS Pocket may generate duplicated SIP call events if retransmissions occur.
 It is possible to set up and run voice actions on the HTC Nexus 9 tablet, although
it is not voice capable. (Such actions will of course fail.)
 ABM (Blixt) is designed for LTE and works for LTE Categories up to Cat. 4.
 When using the LTE cell lock function on the Sony Xperia Z5 E6653, it is
necessary to specify both an EARFCN and a PCI. Locking on an EARFCN only
does not work.
 TEMS Pocket devices with Android 5.0 (Lollipop) do not support Iperf testing.
 The Wi-Fi function in TEMS Pocket does not distinguish between 20 MHz and
40 MHz bandwidth measurements. All channels will be displayed as 20 MHz
channels.
 5 GHz Wi-Fi cells are not shown in the Spectrum view.
 In a controller/agent setup, all agents must have the same TEMS Pocket version
as the controller. If they do not, the controller will not connect them.

© InfoVista Sweden AB (2018) May 25, 2018 9


 The controller in a controller/agent setup must run Android 5.0 or higher in order
to operate smoothly.
 During logfile replay, when rewinding, or fast-forwarding more than 60 seconds,
the event markers in line charts and maps will be incorrect or missing. To get
accurate event markers, replay the logfile from beginning to end.
 When disabling a control function on a device with the Samsung Shannon
chipset, all control functions are set to default and needs to be enabled manually
again.
 When you exit TEMS Pocket the first time after an installation, the backend will
presently crash. At subsequent exists, this will not occur.
 TEMS Pocket requires the device to have Android 5 or later.
 The device must be restarted after any installation or upgrade of TEMS Pocket.
 Devices running Android 6 or later must have the “Location Service” enabled in
order for TEMS Pocket to get Wi-Fi data.
 The Antenna verification line chart data view is not populated in logfile replay
mode.
 After starting/restarting a device, wait until all OnDevice services have started
(this can take several minutes); then start TEMS Pocket.
 When running Tango, the Controller and the Agents must be set to the same
time zone.
 If TEMS Pocket UI is restarted during pin-pointing, the pin-pointing session must
be restarted.
 Depending on how often encryption keys are sent by the network, TEMS Pocket
may sometimes need to be set in Flight Mode and then back to network mode
when running VoLTE testing.
 For LTE-CDMA CSFB MT calls can fail to answer in some scenarios. A
workaround is to lock the device to CDMA, which will prevent CSFB.
 TEMS Pocket does not support the use of dual SIM cards. Only SIM slot 1 is
supported.
 When making a voice call with TEMS Pocket, a dialog to select dialing service
may appear. You must select “Phone” and “Always” to ensure correct
functionality in TEMS Pocket.
 It is recommended to avoid extremely large map sets while performing indoor
measurements since it may sometimes result in log files that cannot be read in
post-processing tools.
 If you have a script containing Instagram actions created in TEMS Pocket 16.3.1
or earlier, you must update the script according to the user manual sections
9.3.6 (login, client id) and 9.3.6.1 (sandbox users) to use it with TEMS Pocket
16.3.2 or later.
 If you have a script containing an IP Capture action with both TRP and PCAP
recording enabled created in TEMS Pocket 16.3.2 or earlier, it will only record a
TRP file if used in TEMS Pocket 16.3.3 or later.
 TEMS Pocket 16.3.3 running AQM measurements using P.OLQA on Samsung
SM-G930F may cause device reboot.

© InfoVista Sweden AB (2018) May 25, 2018 10


 Virtual Headset setting (in OnDevice Settings application) should be enabled
when running ODM P.OLQA on some devices (MO device only):
 SM-G935FD: Always use Virtual Headset.
 SM-G930F: Use Virtual Headset when running M2F.
 The Virtual Headset setting will be disabled after device reboot.
 TEMS Pocket presently does not support IPsec encryption algorithm des-ede3-
cbc on devices using the Samsung Shannon chipset.
 Previous versions of TEMS Pocket cannot be upgraded to TEMS Pocket 17.0
without loss of earlier installation and configuration. Contact TEMS support for
more information.
 Page switching in the LTE Cell Configuration view may not work after startup.
Switching to another category and back to the Idle category enables the
functionality.
 In the VeriSite application, when naming a workflow, pressing ENTER in the
Android keyboard instead of “back”, subsequently pressing Cancel in the dialog
will cause the app to crash on Sony XP.
 Starting scripts from the TEMS Pocket user interface while the Workflow
application is running, is not supported.
 The scriptable APN change feature has only been tested on Samsung Galaxy
SM-G928F, but may work on other device models as well.
 To run TEMS Pocket 17.x on SM-N910F and SM-N910T you need to upgrade
the device firmware to a certain firmware version running Android 5.x. Please
contact TEMS support for information about the upgrade process.
 To run TEMS Pocket 17.x on SM-N910F and SM-N910T you need to have base
licenses for TEMS Pocket 15.x, 16.x and 17.x mapped to the device.
 A campaign can presently only contain one (1) workflow.
 The phone number configured in TEMS Pocket VeriSite General Settings may
not remain after restarting the device.
 The time display while replaying a logfile, can sometimes show the wrong value.
Drag the control back to start of the playback to resolve the time display issue.
 When connecting a TEMS Pocket Professional device to a TEMS Director 1.x
server, the TEMS Director Version settings must be set to Version 3.x.
 Using the Remote Control feature in TEMS Director while running tests in TEMS
Pocket will impact logfile size because the IP traffic generated by the live stream
will be recorded to the logfile.
 The TEMS Pocket UI may appear frozen for a while at startup if the TEMS
Pocket Installer is installed on the device. Uninstall TEMS Pocket Installer to
avoid it.
 Changing Pocket Mode may cause a crash.
 The maximum Response Timeout setting for ODM SynchPoint is 60 seconds. If
a value above that is set, it will be handled as 60 seconds.
 In a multi-device configuration, if you switch off Bluetooth on the Controller when
several Agents are connected, the Controller application may restart

© InfoVista Sweden AB (2018) May 25, 2018 11


 If you start TEMS Pocket immediately after a reboot or power on, Control
Functions may not be available immediately - you may need to wait a minute or
two until they're shown as available

6.2 Third-party Data Related


 If two or more cells within the same iBwave transmitter file (for the same floor)
share the exact same channel (GSM: BCCH ARFCN; WCDMA: UARFCN; LTE:
EARFCN; CDMA: RF Channel) and code (GSM: BSIC; WCDMA: scrambling
code; LTE: PCI; CDMA: PN), then TEMS Pocket cannot distinguish between
these cells and therefore cannot present them by name.
 In the VeriSite application “View previous results” will only work if a PDF viewer
is installed on the device. Even then, it may not presently work on all supported
device models. It is always possible to copy the pdf files to a PC and view them
there.

6.3 TEMS Pocket Lite Specific


 On some devices, some values may not be updated due to limitations in the
Android API (e.g. cell identity, Timing Advance, WCDMA scrambling code).
 No updates are obtained from the Android API when the device is in sleep mode
(screen saver, screen power off) as Android tends to shut down API updates
when this happens.
 On some devices, forcing a change of device Network Mode from Android
Mobile network settings will cause Android API to stop updating radio
parameters.
 CDMA/EV-DO cell names are not supported on TEMS Pocket Lite as the
application cannot accurately identify cells with only longitude and latitude
information.
 Limited IPv6 address information is displayed in TEMS Pocket (only first address
shown in field – but there might be multiple addresses).

6.4 Device Hardware Related


 eNB TX Antenna Difference is not supported on Sony Xperia XZ Premium
G8141 and G8142.
 After a period of heavy processing load, devices using the Qualcomm MSM8994
chipset heat up considerably, sometimes to the point where applications (such
as TEMS Pocket) are terminated.
 PEVQ-S is presently not working on HTC M10h.
 On Samsung S7 (and later) with MSM8996 chipset, current Speech Codec is not
recorded for CS calls.
 Cell lock presently does not work on Samsung Galaxy Tab S2 SM-T819.
 A Google account must not be configured on the Samsung SM-G950U.
Rebooting the device with a configured Google account will render the phone
unusable.

© InfoVista Sweden AB (2018) May 25, 2018 12


 When using the LTE Cell Lock on Samsung Galaxy S7 SM-G9350, S8 SM-
G950U, and Sony Xperia XZ Premium G8141/G8142, you need to lock the RAT
to LTE before applying the LTE Cell Lock.
 To use the RAT lock on the Samsung SM-G930V you need to manually set an
APN in the device network settings, and then change it back to default. In other
cases, the RAT lock will generate error messages, however still lock the device
to the selected RAT.
 WCDMA cell lock on the Sony Xperia F8331 (brown) does not lock the device to
the cell correctly on all networks.
 To run TEMS Pocket 17.2 or later on the Sony Xperia Z5 E6653, firmware
version 32.2.A.0.253_2.0.1.36 or later must be installed. Use Xperia Companion
to update the firmware if needed.
 To run TEMS Pocket 17.2 or later on the Sony Xperia Z5 501SO, firmware
version 32.0.C.359_1.0.1.5 or later must be installed. Use Xperia Companion to
update the firmware if needed.
 Please contact TEMS support before performing M2F voice testing using the
Samsung SM-G950F.
 If you are getting low AQM scores when using the following devices:
 Sony Xperia X Performance (F8131)
 Sony Xperia XZ (F8331)
 Sony Xperia XZ Premium (G8141 or G8142)
 Sony Xperia XZ1 701SO
Check if the Ring Volume is set to 0 (off). If it is, increase the volume from 0 to
get more accurate AQM scores. If you want to mute the ringer, set your ringtone
to TEMS_SilentRing.
 If you are getting inaccurate or no positioning data when using the following
devices:
 Sony Xperia X Performance (F8131)
 Sony Xperia XZ (F8331)
 Sony Xperia XZ Premium (G8141 or G8142)
Check if the Location Mode is set to Battery Saving. This turns off the device's
GPS unit to reduce power, but reduces the frequency and accuracy of position
data and may provide none at all. Set Location Mode to High accuracy.
 OnDevice HTTP Download (Get) on the Samsung SM-G950U does not return
any KPIs.
 On an Android 8 device:
o HTTP throughput is not recorded when using the OnDevice File or
OnDevice Browser client type if the URL is specified using a host
name (which must be looked up using DNS). The workaround for this
issue is to specify the host IP address rather than its name.
o In a multi-device (controller:agent) configuration, the Agent
Configuration view displays the Agent ID incorrectly, e.g
02:00:00:00:00:00. The Agent Name is displayed correctly.

© InfoVista Sweden AB (2018) May 25, 2018 13


o VeriSite is not supported.

© InfoVista Sweden AB (2018) May 25, 2018 14


7 Contact Information
Please visit  www.infovista.com/tems for customer support contact information.

© InfoVista Sweden AB (2018) May 25, 2018 15

You might also like