52.23.17 HTTP Get

Downloads a URL from an HTTP server.

Configuration property:

Browser Client: Web browser used to conduct HTTP Get sessions.

TEMS Browser: The internal web browser in TEMS Investigation is used.

Internet Explorer: Internet Explorer 9 or later is used.

UE Download: An on-device HTTP client similar to the TEMS Browser is used.

UE Webkit: An on-device web browser is used. Note: This browser can only be used for "Web Browsing", not for "File Transfer", as defined under URL below.

Regarding concurrency limitations, see below.

Client Threads: (TEMS browser) Number of concurrent threads to be used by the client in handling the HTTP session. Note that the main URL (specified under URL) is downloaded only once, regardless of the number of threads.

URL: Main URL of web page or file to download. – In post-processing, the HTTP Get session will be classified as "File Transfer" if the downloaded file has one of the following extensions: .7z, .avi, .bmp, .dat, .jpg, .mp3, .mpg, .png, .rar, .txt, .wav, .zip, .xls, or .xlsx. If the file has some other extension, the session will count as "Web Browsing".

Expected MD5: After downloaded the file, an MD5 hash will be calculated. If this is provided, it will be used to verify with the calculated MD5.

The MD5 format is 32 hexadecimal characters. For multiple files, separate each MD5 with a comma like the URL above.

Terminate All Internet Explorer Processes: (Internet Explorer) If set to True, all Internet Explorer processes will be killed whenever no HTTP Get activity is executing. This ensures that no ghost processes are left running and consuming resources; on the other hand, it also prevents you from doing web browsing with Internet Explorer while HTTP testing is in progress. If you turn this option on, use some other browser for web browsing.

The following proxy settings are available for the TEMS browser and for Internet Explorer.

Use Proxy Server: Select whether to use a proxy server for this connection.

Proxy Server Address: Proxy server address.

Proxy Server Port: Proxy server port.

End Session After Time: If set to True, the HTTP session is ended automatically after a user-specified length of time, indicated in the Time field. The duration is counted from the moment the first HTTP packet is received from the server.

Max Allowed Network Idle Time: Maximum allowed time with no activity on the network connection before the activity is terminated and regarded as failed. The value zero means that any amount of idle time is tolerated.

End Session After Payload Size: If set to True, the HTTP session is ended automatically after a user-specified amount of data has been downloaded. Enter the number of bytes to download in the Payload Size field.

The following settings are available for UE Download and UE Webkit.

Proceed Without IP Sniffer: Set to True to allow the measurements to continue with limited KPIs or no KPIs.
Note: If the connected device is a non-rooted commercial device, always set this setting to True, if set to False, the activity will not run.

DNS Timeout: Maximum timeout to wait for DNS lookup or DNS resolution. Set to 00:00.00 to disable.

IP Service Access Timeout Method A: Maximum time to wait until receiving the first packet with content. Set to 00:00.00 to disable.

IP Service Access Timeout Method B: Maximum time to wait until receiving the first HTTP Get packet. Set to 00:00.00 to disable.

Data Transfer Timeout Method A: Maximum time to wait for last packet after receiving first packet with content. Set to 00:00.00 to disable.

Data Transfer Timeout Method B: Maximum time to wait for last packet after receiving first HTTP Get packet. Set to 00:00.00 to disable.

Network Access Timeout: Maximum time to wait for Network Access. Set to 00:00.00 to disable.

Chunk Size: The size in bytes where chunk report will be created each time the payload reaches. Chunk report is similar to log report except that it is created on every time the payload reaches the chunk size, instead of created on every one second. Set to 0 to disable creating chunk report. Minimum chunk size is 10000 bytes.

The following settings are available for UE Download.

Use Last Connection As Marker For Full Measurement: See diagrams in section "HTTP Signaling Diagram (Multiple Sockets)".

Use Last Connection As Marker For Time Based Measurement: See diagram in section "HTTP Signaling Diagram (Multiple Sockets)".

Connection Timeout: Maximum time to wait until a connection to the referenced resource is established. Set to 00:00.00 to disable.

Read Timeout: Maximum time to wait until the HTTP data transfer is completed. Set to 00:00.00 to disable.

The following settings are available for the UE Webkit browser.

Web page type: Select whether to download a Static or a Live web page. A Live web page is distinguished by the fact that it updates parts of the web page continuously.

Render time (ms): (Static web pages) The rendering time in milliseconds for the web page to load before the browser being closed upon finished download.

Web Page Payload Size (byte): (Static web pages) The expected web page payload size to be downloaded. The value will be used for the calculation of the compression ratio. The payload size for Kepler reference web page should be 815,804 bytes and for Kepler smart phone reference page 145,256 bytes. The standard unit is byte, but the unit can be specified: B for byte, K for kilobyte, M for megabyte, G for gigabyte and T for terrabyte.

Minimum Payload (byte): (Live web pages) Predefined payload size. Stops download when the specified amount of data has been downloaded. See usable unit specifications above.

Silence Time: (Live web pages) Timeout that stops the download if no packets are received whitin the duration. Set to '0' to disable the timeout.

Maximum Wait Time: (Live web pages) Maximum duration before the minimum payload is downloaded and predefined silence time fulfilled. Set to '0' to disable the timeout.

Maximum Session Time: (Live web pages) Maximum duration for the download to be completed. Set to '0' to disable.

Clear Cache: Clears the cache before starting the download if set to 'True'.

Clear Cookies: Clears the cookies before starting the download if set to 'True'.

Render Time: The rendering time (Milliseconds) for the webpage to load before the browser is being closed upon finished download.

 
Lists of HTTP Get information elements and events.
Limitations on HTTP Session Concurrency
Internet Explorer and the TEMS browser cannot run concurrently on the same device.
On the other hand, when either Internet Explorer alone or the TEMS browser alone is used, there are no restrictions on HTTP session concurrency, neither for a single device nor for multiple devices.
Windows 10 Limitations
HTTP Get with Browser Client set to "Internet Explorer" does not work under Windows 10, neither with Internet Explorer itself nor with the Microsoft Edge browser (which is the default one in Windows 10).

52.23.17.1. HTTP Signaling Diagram (Multiple Sockets)

The diagrams below shows the HTTP Get signaling for Multiple Sockets. The trigger points is configurable to use either the first connection or the last connection (last connection is used by default).
Use last connection as trigger points:

Use first connection as trigger points: