The ArtOfTest.Runner.exe is the command line runner for Test Studio Dev tests and is installed in the Bin folder under the installation directory of the product. The default location is:
- C:\Program Files (x86)\Progress\Test Studio
When working with the execution engine in the command prompt always make sure you have started it as Administrator and have the root directory in context as shown below so that you can call the runner directly.
Here is the Help Screen for ArtOfTest.Runner.exe:
Execution options modify command line test execution behavior. The help screen (displayed by inputting ArtOfTest.Runner.exe -help from the command line) provides a brief explanation of each option. Here are some further notes about specific options.
Several execution options use file paths as values. When using file paths in the command prompt:
- Enclose the file path in double quotes.
- To prevent typing mistakes, use the clipboard paste option within the command prompt window. To find the paste option after copying the path to the clipboard, right mouse click on the top left corner of the command prompt and choose Edit > Paste.
- The test option takes the full path to an individual test file with the .tstest file extension. This file will be located in your main project directory and under any folder structure you have created to organize your tests. You can use the test option by itself. By default results will be stored in the Results folder under the project’s root directory.
ArtOfTest.Runner Test Execution syntax
ArtOfTest.Runner Test Execution result
|0||RUN_TESTS_SUCCESS||Run is processed and all tests passed.|
|1||RUN_TESTS_ERROR||Run is processed and some tests failed.|
|2||NOT_RUN_UNEXPECTED_ERROR||Run is not processed due to unexpected error.|
|3||NOT_RUN_COMPILATION_ERROR||Run is not processed due to compilation errors.|
|10||NOT_RUN_USAGE_INFO||No run to process, requested usage info.|
|11||NOT_RUN_INVALID_COMMAND_ARGS||No run to process due to general invalid arguments error.|
|12||NOT_RUN_TEST_NOT_FOUND||Run is not processed due to invalid test path argument.|
|13||NOT_RUN_TESTLIST_NOT_FOUND||Run is not processed due to invalid test list path argument.|