Scheduling Test Runs (Standalone only)

Test Studio Scheduling allows you to select a test list to execute at a future time, set the date and time for the test run and return later to see the results. The Scheduling Service can schedule the test list to run on remote machines as well.


From your local instance of Test Studio, you can schedule test lists on any machine in your network, including Virtual Machines. If you have to run a number of tests, you can spread the workload between different machines in order to reduce total execution time. All the results will be stored in one centralized location for you to later examine.


Scheduling Overview: 2013 R1


Depending on your scheduling scenario, setup will vary. There are two main scenarios: an 'All-in-one' installation (create, schedule and execute tests all on one machine) and a remote execution installation, where the Test Studio Standalone installation, Scheduling Server and test execution are on more than one machine.

  • All-In-One Installation


    1.  Install the default configuration (Scheduling and Storage are not selected).
    2. Start Test Studio. An icon will appear in your System Tray for the Test Runner process. This process handles test scheduling and scheduled test execution.

      System Tray Icon

    3. Open the project that contains the test list you wish to schedule for execution.
    4. Click Connect in the Scheduling section of the ribbon bar.

      Connect Button

    5. In the Scheduling Server Settings dialog, click Run Locally, then OK.

      Scheduling Server Settings

    6. Schedule Test List execution in the Test Lists view. Your local machine is selected as the execution machine by default.
    7. View Scheduling Results after the scheduled test execution time.


    • Important: If the All-In-One machine has an active firewall, ensure that the following ports are unblocked: 55555, 8009, and 8030-8039.


  • Remote Execution


  • Watch a video tutorial on how to setup remote execution in 2013 R1 and above.

    1.  Install the Scheduling Service and Storage Service components in the Customize Installation dialog during Test Studio Installation for the machine or machines that will host these services. These are not selected by default in a Standalone installation.

      Install Services

    2. If you wish to use an existing server for the Storage Service, click Configure Storage and provide connection details for the database. Otherwise, Test Studio will create a new database. Note: Creating the storage database requires that the database user have the DBCreator Server-Level Role in SQL.
       

      Storage Setup Button
    3. On the Scheduling Server machine, run the Configure as Scheduling Server application and input the address for the Storage Service created in Step 2.

      Configure as Scheduling Server
    4. To configure one or more machines as Execution Servers, run the Start Execution Server application and connect the Execution Server to your Scheduling Server.

      Connect Execution Server to Scheduling Server

    5. Open the project that contains the test list you wish to schedule for execution and click Connect in the Scheduling section of the ribbon bar. 

      Connect Button

    6. In the Scheduling Server Settings dialog, click Run Remotely, input the location of your Scheduling Server, then click Connect.

      Run Remotely

    7. Schedule Test List execution in the Test Lists view. Your local machine is selected as the execution machine by default.
    8. View Scheduling Results after the scheduled test execution time.



  • Important: If the machines in your configuration have active firewalls, ensure that the following incoming ports are unblocked on the appropriate machines:



This diagram shows the basic remote scheduling configuration for 2013 R1 and after.


Scheduling Configuration Diagram


Scheduling Overview: 2012 R2 and Earlier

Follow these steps to create a scheduling server, connect a project to it, schedule a test list and execute it:

  1. Create a Scheduling Server - the scheduling server keeps track of what tests to run and sends this data to the execution servers.
  2. Create an Execution Server - the Execution Server is an instance of Test Studio Standalone, VS plugin, or Run-Time edition. An Execution Server is ready to use when you configure it and register it with the Scheduling Server.
  3. Connect a Project to the Scheduling Server - once you've configured the Scheduling Server and successfully registered at least one Execution Server to it, you're ready to configure a test project for execution.
  4. Run List Remotely - immediately execute a test list remotely on one or more Execution Servers.
  5. Schedule Test List Execution - schedule a test list for one or more future executions.
  6. Scheduling Results - view the results upon completion.

 

Click the image below to see a Scheduling Configuration conceptual diagram for 2012 R2 and earlier.