...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
Status | ||||
---|---|---|---|---|
|
Table of Contents |
---|
Configuration
Client configuration in $HOME/.greenspector/config.yml
The main configuration file must be located in $HOME/.greenspector/config.yml. To initialize it, simply use the command:
Code Block | ||
---|---|---|
| ||
gspt init -a <greenspectorApi> -p <privateToken> |
where:
greenspectorApi
is your GREENSPECTOR Server API URL (for example https://app.greenspector.com/api);privateToken
is your private token, available in the Preferences screen on your GREENSPECTOR Web Interface.
The file $HOME/.greenspector/config.yml should now exists.
In case you are behind a proxy, set the proxyUrl
property simply by using the command:
Code Block | ||
---|---|---|
| ||
gspt set-proxy
or
gspt set-proxy --proxyUrl <proxyUrl> |
If you want more details on this option, you can run the command:
Code Block | ||
---|---|---|
| ||
gspt set-proxy -h |
To check your configuration, type:
Code Block | ||
---|---|---|
| ||
gspt ping |
...
Status | ||||
---|---|---|---|---|
|
Table of Contents |
---|
Configuration
Client configuration in $HOME/.greenspector/config.yml
The main configuration file must be located in $HOME/.greenspector/config.yml. To initialize it, simply use the command:
Code Block | ||
---|---|---|
| ||
gspt init -a <greenspectorApi> -p <privateToken> |
where:
greenspectorApi
is your GREENSPECTOR Server API URL (for example https://app.greenspector.com/api);privateToken
is your private token, available in the Preferences screen on your GREENSPECTOR Web Interface.
The file $HOME/.greenspector/config.yml should now exists.
To check your configuration, type:
Code Block | ||
---|---|---|
| ||
gspt ping |
This command will tell you whether your basic configuration and credentials are correct or not. If correct, you should have the message "Server pinged with success".
Optional proxy configuration
Info |
---|
The proxy can be automatically detected. In windows, the CLI automatically detects In linux or mac, the CLI automatically detects env variable |
If previous gspt ping does not work in your work office, you probably need to configure a proxy to allow the CLI to access Internet.
You can check if you need to configure a proxy. Use a 4G mobile network for your PC and try to use the CLI. If it works, you need to configure a proxy.
Set the proxyUrl
property simply by using the command:
Code Block | ||
---|---|---|
| ||
gspt set-proxy
or
gspt set-proxy --proxyUrl <proxyUrl> |
If you want more details on this option, you can run the command:
Code Block | ||
---|---|---|
| ||
gspt set-proxy -h |
Example for proxy without authentication:
Code Block | ||
---|---|---|
| ||
gspt set-proxy --proxyUrl "http://testproxy.local:3112/" |
Example for proxy with authentication:
Code Block | ||
---|---|---|
| ||
gspt set-proxy --proxyUrl "http://myuser:mypassword%241%2C%21@testproxy.local:3112/" |
Using --proxyUrl, If you have password with specials characters, you need to encode the password to use as url. You can use this https://smalldev.tools/url-encoder-online
For example, the password mypassword$1,! devient mypassword%241%2C%21
Example for proxy with authentification with interactive mode:
Code Block | ||
---|---|---|
| ||
gspt set-proxy
Enter the Proxy Protocol (http or https)
Proxy Protocol:
http
Enter the Proxy Host
Proxy Host:
testproxy.local
Enter the Proxy Port
Proxy Port:
3112
Is this proxy authenticated? (y/N)
y
Enter the Proxy Username:
myuser
Enter the Proxy Password:
mypassword$1,!
|
You do not need to encode password in this interactive mode
To check your configuration, type:
Code Block | ||
---|---|---|
| ||
gspt ping |
This command will tell you whether your basic configuration and credentials are correct or not. If correct, you should have the message "Server pinged with success".
you can get these errors if you misconfigured your proxy:
Error | Cause |
---|---|
. because an auto detection of your browser is set, you, you can find | Bad port |
Error: Get "https://app.greenspector.com/api/ping": Proxy Authentication Required | Bad user or password |
Error: Get "https://app.greenspector.com/api/ping": proxyconnect tcp: dial tcp 149.202.59.166:3129: i/o timeout | Bad Host |
Error: parse "http://myuser:mypassword": invalid port ":mypassword" after host | Need to encode password |
Error: Get "https://app.greenspector.com/api/ping": proxyconnect tcp: tls: first record does not look like a TLS handshake | Bad protocol, use http instead of https or the opposite |
Tips:
If you do not know the proxy host of your office and your browser is configured automatically to discover the proxy, you can get the following file via your browser :
wpad.<domaine_local>/wpad.dat
Example : https://wpad.myorganisation.fr/wpad.dat
If you open this file, you can find the host and port for the proxy.
Current working folder configuration in $CURRENT_FOLDER/.greenspector/config.yml
In order to be able to use all the features of the GREENSPECTOR CLI, you also need a configuration file in your current working folder ($CURRENT_FOLDER/.greenspector/config.yml). This file contains the following fields:
...
...
$CURRENT_FOLDER/.greenspector/config.yml
Code Block | ||
---|---|---|
| ||
application: <name of the application> version: <version of the application> environment: <environment to run the tests on> platform: <platform of the environment (mobile in most cases)> os: <OS of the environment> version: <version of this OS> device: <device name of the environment> browsers: <list of browsers available on this environment> |
For example:
...
...
$CURRENT_FOLDER/.greenspector/config.yml
Code Block | ||
---|---|---|
| ||
application: MyFirstApplication version: 0.1.2 environment: platform: mobile os: android version: "7" device: nexus6 browsers: - chrome |
...
Before using meter
command, you have to define the application and the version you are working on by setting the configuration file in the current folder by following instructions in paragraph 43909160 CLI#Current working folder configuration in $CURRENT_FOLDER/.greenspector/config.yml.
Send measures
Use this subcommand to send the results files from the current folder to the server:
...
Before using testbench
command, you have to define the application and the version you are working on by setting the configuration file in the current folder by following instructions in paragraph 43909160following instructions in paragraph CLI#Current working folder configuration in $CURRENT_FOLDER/.greenspector/config.yml.
Set the environment
To use the testbench
command, you first need to set the environment for your project.
To do so, you should use this command:
...
This command will ask you to select one environment among the available ones on your server. To select one, simply type the number for the environment you want when asked to.
Run a measure on a website (only available for android)
This feature allows you to run a measure of a website on the Power Test Cloud/Bench.
To use this feature, you have to first configure the application name, version and the environment to run the measure on.
The command to run is:
...
4 - --networkMode: The network mode for the test. Values can be "WIFI", "4G", "3G" or "2G". (Default: WIFI). Optional Optional
5 - --report
: Automatically generate the test report in the .greenspector
folder and wait for the job to end. (Default: false). Optional
This command will send a measure request to the server. After this measure has run on the Power Test Bench/Cloud, you will find the results on the web interface.
Benchmark one or more
...
app (only available for android)
This feature allows you to benchmark your Android application on the Power Test Cloud/Bench.
To use this feature, you have to first configure the application name, version and the environment to run the measure on.
The command to run isthe environment to run the measure on.
The command to run is:
Code Block | ||
---|---|---|
| ||
gspt testbench benchmark-apk --app <path to APK> |
Examples:
Code Block | ||
---|---|---|
| ||
gspt testbench benchmark-apk --apkFile <path to APK> |
Examples:
Code Block | ||
---|---|---|
| ||
app target/final.apk # local path to apk gspt testbench benchmark-apk --app https://demo/demo.apk # apk from public url gspt testbench benchmark-apk --apkFile target/final.apkapp com.microsoft.office.outlook # localpackage pathname to download the apk from the PlayStore gspt testbench benchmark-apk --app target/main.apk --apkFile https://demo/demotarget/app-module.apk --apkFile target/commons.apk --networkMode 3G # three apk from public url to install and launch benchmark in 3G gspt testbench benchmark-apk --apkFileapp com.microsoft.office.outlook # package name to download the apk from the PlayStore gspt testbench benchmark-apk --apkFile target/main.apk --apkFile target/app-module.apk --apkFile target/commons.apk --networkMode 3G # three apk to install and launch benchmark in 3G gspt testbench benchmark-apk --apkFile target/final.apk --iterations 5 --report # Launch 5 iterations of the benchmark and wait for the report |
The options are :
1 - --apkFile
: The APK(s) to benchmark. (If set multiple times, all the APK will be installed but only the first one will be launched and monitored). The apk file could be a local path, a public URL or a package name to download from the PlayStore. Optional if the applications to benchmark are already installed on phone
2 - --iterations
: Number of iterations of measure you want. (Default: 1). Optional
3 - --report
: (Beta feature) Automatically generate the test report in the .greenspector folder and wait for the job to end. (Default: false). Optional
4 - --networkMode: The network mode for the test. Values can be "WIFI", "4G", "3G" or "2G". (Default: WIFI). Optional
This command will send a measure request to the server. After this measure has run on the Power Test Bench/Cloud, you will find the results on the Web Interface.
Some options are deprecated:
...
target/final.apk --iterations 5 --report # Launch 5 iterations of the benchmark and wait for the report
|
The options are :
1 - --app
: The APK(s) to benchmark. (If set multiple times, all the APK will be installed but only the first one will be launched and monitored). The apk file could be a local path, a public URL or a package name to download from the PlayStore. Optional if the applications to benchmark are already installed on phone
2 - --iterations
: Number of iterations of measure you want. (Default: 1). Optional
3 - --report
: (Beta feature) Automatically generate the test report in the .greenspector folder and wait for the job to end. (Default: false). Optional
4 - --networkMode: The network mode for the test. Values can be "WIFI", "4G", "3G" or "2G". (Default: WIFI). Optional
This command will send a measure request to the server. After this measure has run on the Power Test Bench/Cloud, you will find the results on the Web Interface.
Some options are deprecated:
1 - --apkFile
: The APK(s) to benchmark. (If set multiple times, all the APK will be installed but only the first one will be launched and monitored). The apk file could be a local path, a public URL or a package name to download from the PlayStore. Optional if the applications to benchmark are already installed on phone. This option is deprecated, use --app.
2 - --apkFiles: The APK(s) to benchmark. (If set multiple times, all the APK will be installed but only the first one will be monitored). Mandatory option: Minimum 1. This This option is deprecated, use apkFileuse --app.
Run your custom functional tests on your
...
app / website
This feature allows you to run your custom functional tests on your Android application, iOS application or web site on the Power Test Cloud/Bench.
To use this feature, you have to first configure the application name, version and the environment to run the measure on.
The command to run is:
Code Block | ||
---|---|---|
| ||
# To run Greenspector DSL tests gspt testbench custom-tests --app <APK or IPA to install> --testsSuite <suite name:path_testfile1.testgb,path_testfile2.testgb> --monitoredPackage <package to monitor> # To run android tests (uiautomator, espresso) gspt testbench custom-tests --apkFileapp <path to APK to install> --app <path to APK test to install> --app <path to APK> APK test to install> --testPackage <Test package to launch> --monitoredPackage <package to monitor> or |
Examples:
Code Block | ||
---|---|---|
| ||
# To run Greenspector DSL tests gspt testbench custom-tests --apkFile <path to APK>app target/demo.apk --testsSuite <suite name:path_testfile1.testgb,path_testfile2.testgb>suite1:tests/file1.testgb --monitoredPackage <package to monitor> |
Examples:
Code Block | ||
---|---|---|
| ||
com.greenspector.demo.app gspt testbench custom-tests --apkFileapp target/applicationdemo.apkipa --apkFile target/test.apktestsSuite suite1:tests/file1.testgb,tests/file2.tgb --testPackage com.greenspector.demo.teststestsSuite suite2:tests/file3.testgb --monitoredPackage com.greenspector.demo.app gspt testbench custom-tests --apkFile https://dl.greenspector.com/demo/demo.apk --apkFile https://dl.greenspector.com/demo/testuiautomator-debug-androidTest.apk --apkFile https://dl.greenspector.com/demo/testuiautomator-debug.apk --testPackage com.greenspector.demo.test-app fr.francetv.pluzz --testsSuite launch:./script.testgb --monitoredPackage comfr.greenspector.demofrancetv.pluzz --iterations=1 # Other examples to run android tests without GDSL (uiautomator, espresso) gspt testbench custom-tests --apkFileapp target/applicationdemo.apk --apkFileapp target/testtestuiautomator-debug-1androidTest.apk --apkFileapp target/testtestuiautomator-2debug.apk --testPackage com.greenspector.demo.tests.first --testPackage com.greenspector.demo.tests.second --monitoredPackage com.greenspector.demo.app --iterations 5 gspt testbench custom-tests --apkFileapp targethttps://application.apk --apkFile target/test.apk --testPackage com.greenspector.demo.testsdl.greenspector.com/demo/demo.apk --monitoredPackage comapp https://dl.greenspector.demo.app --report gspt testbench custom-tests --apkFile target/applicationcom/demo/testuiautomator-debug-androidTest.apk --testsSuiteapp suite1https:tests//file1.testgb,tests/file2.tgbdl.greenspector.com/demo/testuiautomator-debug.apk --testsSuite suite2:tests/file3.testgbtestPackage com.greenspector.demo.tests --monitoredPackage com.greenspector.demo.app |
The options are:
1 - --apkFileapp
: Precise the APKs APP (android or iOS app) you want to measure and . For android, if you do not have GDSL tests, you put the APKs which contain your functional tests to launch. Prefer separate APKs for your app and for your tests. The apk file app could be a local file path to an ipa or an apk, a public URL to a ipa or apk or a package name to download from the PlayStore.name to download from the PlayStore, or an url to install ipa from Apple store
2 - --testPackage
: For each APK containing functional tests you want to launch (i.e. UI Automator or Espresso tests), precise the name of the android package (i.e. package in file AndroidManifest.xml). All tests in those Android packages will be launched. Only for non GDSL test. Mandatory option: Minimum 1 if --testsSuite testsSuite is not used
3 - --testsSuite
: For each suite, precise the suite name and the lists of test files writen with Greenspector DSL. All test files will be launched in the specified order. Mandatory option: Minimum 1 if --testPackage is not used3
4 - --testsSuitemonitoredPackage
: For each suiteAndroid application you want to monitored, precise the suite name and the lists of test files writen with Greenspector DSL. All test files will be launched in the specified ordername of the android package to get metrics about the process (process data, process CPU…). Probes can monitor multi package at a time. In this case, metrics are agreggated. For website, choose the browser where the tests runs (i.e. com.android.chrome
). Mandatory option: Minimum Minimum 1 if --testPackage is not used4
5 - --iterations
: Number of iterations of measure you want. (Default: 1). Optional
6 - --monitoredPackage
: For each Android application you want to monitored, precise the name of the android package to get metrics about the process (process data, process CPU…). Probes can monitor multi package at a time. In this case, metrics are agreggated. For website, choose the browser where the tests runs (i.e. com.android.chrome
). Mandatory option: Minimum 1
5 - --iterations
: Number of iterations of measure you want. (Default: 1). Optional
6 - --report
: Automatically generate the test report in the .greenspector folder and wait for the job to end.(Default: false). Optional
This command will send a measure request to the server. After this measure will ran on the Power Test Bench/Cloud, you will find the results on the Web Interface.
7 - --extra:
Use to transmit extras parameters to your instrumentation with the format name=value (ie --extra annotation=com.greenspector.demo.test.MyAnnotation add the following parameters to your instrumentation -e annotation com.greenspector.demo.test.MyAnnotation). Thus you can filter your tests for example using those extras parameters : https://developer.android.com/reference/android/support/test/runner/AndroidJUnitRunner). Optional
8 - --networkMode: The network mode for the test. Values can be "WIFI", "4G", "3G" or "2G". (Default: WIFI). Optional
Some options are deprecated:report
: Automatically generate the test report in the .greenspector folder and wait for the job to end.(Default: false). Optional
This command will send a measure request to the server. After this measure will ran on the Power Test Bench/Cloud, you will find the results on the Web Interface.
7 - --extra:
Use to transmit extras parameters to your instrumentation with the format name=value (ie --extra annotation=com.greenspector.demo.test.MyAnnotation add the following parameters to your instrumentation -e annotation com.greenspector.demo.test.MyAnnotation). Thus you can filter your tests for example using those extras parameters : https://developer.android.com/reference/android/support/test/runner/AndroidJUnitRunner). It can also be used to fill parameters on GDSL file. (exemple --extra PARAMETERNAME="value" will replace all ${PARAMETERNAME} in the GDSL file by value). Optional
8 - --networkMode: The network mode for the test. Values can be "WIFI", "4G", "3G" or "2G". (Default: WIFI). Optional
9 - --
disable-dumpsys: Disable Android System Monitoring. By default, this is enabled and will add one iteration to your job for more detailed metrics (Views, Activity, OpenSSL Sockets, ...). If you don't need these metrics, you can disable this iteration, it will reduce testing time.
10 - --
only-dumpsys: Run only a Android System Monitoring iteration. This iteration will only be able to retrieve Android System metrics (Views, Activity, OpenSSL Sockets, ...).
Some options are deprecated:
1 - --apkFile
: Precise the APKs you want to measure and the APKs which contain your functional tests to launch. Prefer separate APKs for your app and for your tests. The apk file could be a local path, a public URL or a package name to download from the PlayStore. This option is deprecated, use --app
1 - --apkFiles
: Precise the APKs you want to measure and the APKs which contain your functional tests to launch. Prefer separate APKs for your app and for your tests. This option is deprecated,
use apkFile
use --app
2 - --testPackages
: For each APK containing functional tests you want to launch (i.e. UIAutomator or Espresso tests), precise the name of the android package (i.e. package in file AndroidManifest.xml). All tests in those Android packages will be launched. This option is deprecated,
use use --testPackage
3 - --monitoredPackages
: The package name of the Android application to monitor with the probes to get metrics about the process (process data, process CPU…). Probes can monitor only one package at a time. For website, choose the browser where the tests runs (i.e. com.android.chrome
). This option is deprecated, use use --monitoredPackage
Related articles
Filter by label (Content by label) | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|