Once you have configured your Scheduling setup with at least one execution machine connected and your current project is connected to the Scheduling service, you can proceed with scheduling test lists remotely.
Once you have a test list, you can schedule it for execution. From Test List tab - click on Schedule TestList in the Scheduling ribbon.
Select the desired time and recurrence settings for this test run. In product version R3 2015 we've introduced the ability to schedule test lists Minutely and Hourly.
Select Machine(s) step lets you pick the Execution Server on which to run the test list. If the list is empty, add at least one Execution Server. Picking multiple servers will result in the Test List executing simultaneously on all selected machines.
Distribute tests among these machines - Test Studio will split up the test list and assign each test to a different machine automatically. Note: If this setting is not selected, each test will run once on each machine you select, which may result in multiple test results for each test in the list.
Get latest version of tests automatically from TFS - available only if the project is connected to a TFS. If checked - Test Studio will perform a "check out" operation on the project latest version at each execution machine before running the test list.
Important Test Studio ignores time zone differences and completely disregards the date and time on the Execution Server(s). The only date and time taken into account is on the machine where the Scheduling Server is located. This can lead to problems when the Scheduling Server is not located on the machine you're scheduling from and there are time zone differences between the two machines.
This step is optional. Notifications are sent from the Scheduling Server and it needs the necessary permissions to use the SMTP server with credentials as configured in the Create a Scheduling Server section. Without these SMTP settings, Step 3 will be skipped.
Screenshot below shows all settings available for adjustment in the notification configuration step.
Further email customization information is available here.
Once you close the Scheduling Wizard, the scheduled run should appear in the Results tab. It should be yellow, indicating it's waiting to be executed.
To remove a scheduled test execution:
- In the Results tab, hover over the scheduled test execution. Click the close button that appears.
- If the scheduled test run is recurring, select whether to delete all instances or edit the scheduled run to remove specific test runs.
As of release 2017 R3 (v.2017.3.1010) you can choose whether to automatically upload all recent changes to the storage database. The below dialog will be triggered after saving the project and if there are any upcoming scheduled test list runs within that project.
If it is clear whether the automatic upload for that project is required or not and you don't want to see the notification by each save operation you could check the respective checkbox. The selected option will be applied on project level and performed automatically once the project is saved. Alternatively you could leave the prompt dialog to be triggered by each save operation and choose each time whether to upload the changes or not.
Note! See here for more details if that message doesn't appear anymore.
These steps lets you configure the e-mail notification you will receive upon test list completion.
To disable mail notification, check "I'm good...no mail for me!".
If you check "Send test results by email" select one of these three options:
Always - receive a notification no matter what the result, pass or fail.
Only on execution errors (related to the app) - sends an email only if a "normal" error is encountered. (For example, an error that's related to the application under test such as missing controls, wrong text values, etc.)
Under Email Customization customize the recipients, subject line, content, and attachments. Select the body content and attachments by checking the appropriate checkboxes.
Under Subject Line, type "//" to invoke the token field menu and include data from the test results in the subject line.
Note! Once a test list is scheduled with any email settings applied, the selected settings will persist in that dialog next time a job is scheduled within the same project.
To view the resulting email format, see the email preview on the right.
To further customize the email notification, click the Edit button and input custom text into the email template.