RDT Overview

Real Device Testing (RDT) is a mobile app and Web testing service that enables developers to run their tests on real, physical Android, and iOS devices that are hosted on secure premises. In NetStorm, RDT can perform automating functional, performance, stress, regression, and stability testing of Android & iOS apps and associated services. Using RDT, you can ensure that applications are running smoothly on customer handsets/devices.

RDT provides a versatile mobile-application testing platform using real iOS and Android devices on cloud. It has the largest device farm of real mobile devices, gathered from different regions globally, including the most versatile OS, OEM, and hardware configurations for Android and iOS developers. This helps in test automation, remote manual access and REST API to access, run and manage any tests with these devices.

Supported Applications

There are three types of applications, which can be tested on Real Device as following:

  1. Native Apps: A native application is created for platforms, such as mobile and tablets.
  2. Mobile Web Apps: These are server-side apps to access website(s) on mobile using different browsers, such as Chrome, Firefox by connecting to a mobile network or wireless network, such as WI-FI.
  3. Hybrid Apps: These are combination of Native apps and Web apps.

Supported Operating Systems

RDT supports following operating systems:

  1. Android
  2. iOS

Depending on selected OS, it supports following type of devices:

  1. Mobile
  2. Desktop

Getting Started with RDT

NetStorm RDT offers a huge selection of devices for manual, visual, and automated testing with various loads. With latest devices and browsers being added frequently, you can assure yourself to have the finest test coverage.

You need to perform the following process to use RDT capabilities:

  • Create an RDT Script.
  • Create a Scenario.
  • Add a local or cloud real device.
  • Execute RDT.
  • View reports.

Creating an RDT Script

You can create an RDT script in the following ways:

  • Importing an existing Json file.
  • Manually creating a new script.

Importing an Existing Json File

To create an RDT script, you can import an existing Json file. Perform the following steps:

  1. Select From the UI dashboard click the Scripts from the top panel and the select Create RDT Script icon  from the left panel. The following screen is displayed:

Figure: Create RDT Script Window

2. Specify a name your script.

Note: Script Name consists of a maximum number of 64 characters. The first character must be Alpha. Other characters are Alpha, Numeric or Underscore.

  1. Select a project and subproject from the drop-down lists.
  2. Select a script type, Mobile Web or Native App.
  3. Click Browse to select the required Json file.
  4. Select a script configuration file.
  5. Click View to open the Json file in NetStorm.

Figure: RDT Script with File 

8. Click Create Script to generate a script based on the imported Json file. A message is displayed stating that the script is successfully created.

9. Click Preview to view the RDT script.

Figure: Flow Format

Manually Creating an RDT Script

To create an RDT script in NetStorm:

  1. Click Create. A new Flow script is added.
  2. Right-click Flow and select Add Page.

Figure: Select Add Page

3. Provide page details in the Add Page dialog box:

Figure: Add Page Dialog Box

4. Click OK. A new page is added.

  1. Right-click the new page and select Add Action to specify the required action.

Figure: Add Action Option

6. Provide the required action details and then click Add.

Figure: Adding Action Window

7. Similarly, add more pages as per your requirements.

8. Click Create Script to generate a script.

Specifying RDT Settings

Perform the following steps to execute RDT in NetStorm:

  1. Select View >Scenarios>Scenarios. Create a Scenario (by providing Project, Sub-Project, and Scenario name).

Figure: Create Scenario Dialog Box

  1. Click the + icon to add a group in the Schedule Settings section.
  2. Specify a group name and select the RDT type.

Figure: Add Group

4. Specifying the project name, sub-project, script, and users.

5. Click OK. A new group is created where you can specify the RDT settings.

  1. Edit the duration settings in the group and set it to 1 session.

Note: In RDT, you can run session-specific duration only, you cannot run time-based duration.

Adding Devices: Cloud or Local

You can set up your mobile web or native app in a cloud or local environment.

Setting up a Cloud Device

To specify the required RDT settings for your web application or native app in a cloud environment:

  1. Click the Real Device User Settings option in the left panel.
  2. Enable the Run virtual user as real device user option.

Figure: Real Device User Settings

3. Select the Cloud environment.

4. In the Type field, select:

    1. Mobile Web for enabling the settings for Mobile & Desktop.
    2. Native App for enabling the settings for Mobile only.

5. Based on the type selection, specify your device configuration, such as OS version, Network type, and proxy port.

6. Save your settings. Now, you can run your test by clicking the Start button .

Setting up a Local Device

To specify the required RDT settings for your web application or native app in a local environment:

  1. Click the Real Device User Settings option in the left panel.
  2. Enable the Run virtual user as real device user option.
  3. Select Local as environment for web-app local test only.
  4. Specify the Android device IP and port number.
  5. Click the Add button.
  6. Select the Enable JSProfiling box.
  7. Click Apply.

8. Save your settings . Now, you can run your test by clicking the Start button .

Viewing Results

After you have successfully completed your test run, you can view various types of reports, such as Session Details, App profiling, and domain statistics report.

To view various reports:

  1. Select Reports > Ready > Page Details Reports from the left panel. The Page Average Report is displayed. 

2. Click the Page Average Additional Information icon . You can see Page Average additional information Reports that provides addition information of the page, such as Min / Max / Average of DOMContentLoadedTime, OnLoad Time, Page Load time, and Start Render Time. 

3. Click the required Page Name in the Page Average report. The Page Detail Reports for that page is displayed. 

Viewing Session Details Reports

Click the Session Details icon  on the Page Detail Reports of any page to view the Session Detail Reports.

Viewing App Profiling

Click the Green icon in the Action column of the Page Detail Report to open the profiling data, as shown below:

Note: App profiling data is available only for a cloud setup.

Viewing Request Details

Clicking the Requests of a page, the user is navigated to Request Detail window of that particular page. 

There following reports icons are present on Request Details Page:

Icon Report
Content Type and Domain Statistics Report
Waterfall Report

Viewing the Content Type and Domain Statistics Report

Viewing the Waterfall Report

The following report is displayed:

Vewing the Session Video

From Session Details Page, user can click on Play Session Video button to view the video for the whole Session. 

Visual Comparison

On clicking the Visual Comparison button from Page Detail Report, user can see the Filmstrips as an image, Video, and Visual Progress of a Page.

Comparing Reports

For comparing reports, you need to select two or more pages and click the Compare button.

The following comparison report is displayed.

For Visual Comparison between two or more pages, user needs to select Pages and click on Visual Comparison button on Page Detail Reports window. This displays visual comparison as film strips, visual progress, and video. 

 

Viewing the Average Report

To view the Average of two or more pages, user needs to select the pages and click on Average Reports button from Page Detail Reports window.