Test Case Execution

Test Cases

Overview

Test execution is done through test runs — a named collection of test cases executed at a point in time against a specific build, sprint, or release. A run gives you a snapshot of quality at that moment and produces a pass/fail record that can be referenced later.

When a test case fails during execution, you can file a defect directly from the run with the test context pre-filled — no copy-pasting steps required.

Creating a test run

1Go to Test Cases in the left sidebar
2Click the Runs tab
3Click New Test Run
4Give the run a name — e.g. "Sprint 14 Regression" or "v2.4 Release Smoke Test"
5Select which test cases to include (see options below)
6Click Start Run

Selecting test cases for the run

  • All test cases — includes every test case in the project. Use for full regression.
  • By sprint — includes test cases linked to stories in a specific sprint. Use for sprint sign-off.
  • By release — includes test cases linked to stories in a release. Use for release validation.
  • Manual selection — pick test cases individually. Use for targeted or exploratory runs.
  • From previous run — re-run all, failed, or blocked cases from a past run. Use for regression after a fix.

Executing tests

Open the run to see the full list of test cases. Work through them one at a time:

1Click a test case row to expand it and read the steps and expected result
2Follow the steps in the application you're testing
3Compare what happened to the expected result
4Record the outcome using the result buttons: Pass, Fail, Blocked, or Skip
5Add a note if needed — especially for Fail and Blocked results
6Move to the next test case

Result statuses

ResultWhen to use it
Not StartedTest case is in the run but hasn't been executed yet.
PassExecuted and the system behaved as expected.
FailExecuted and the system did not match the expected result. A defect should be filed.
BlockedCould not be executed — environment issue, missing data, or a dependent defect.
SkippedIntentionally not run in this cycle — noted for future runs.

Filing a defect from a failed test

When a test case fails, file a defect immediately while the failure is fresh. Silverile pre-fills the defect form with the test context so you don't have to re-enter the steps.

1Mark the test case as Fail
2Click File Defect — it appears next to the result buttons after you record a Fail
3The defect form opens with the title, steps, and expected result pre-populated
4Add a screenshot or screen recording — attach it before saving
5Set the Severity and any other fields
6Click Create Defect
7The defect is created and automatically linked back to this test case and run
Pre-filled fieldWhat gets populated
TitlePre-filled from the test case title. Edit to be more specific about the failure.
DescriptionPre-filled with the test steps and the expected vs. actual result. Add observed behaviour and any error messages.
SeveritySet manually — choose based on the impact of the failure.
Linked TestAuto-linked to the test case that failed. Preserved for traceability.
AttachmentAdd a screenshot or screen recording before saving — this saves significant investigation time.
The test case remains linked to the defect permanently. When you view the defect, you can navigate directly to the test case that found it — and when the defect is fixed and verified, the next test run will confirm the fix.

Completing a run

When all test cases have been executed (or you've decided to stop), mark the run complete:

1From the run detail view, click Complete Run
2A summary dialog shows pass rate, fail count, and blocked count
3Confirm — the run status changes to Completed and results are locked

Completed runs are preserved in the Runs history. The pass rate and any linked defects remain visible for audits and retrospectives.

Troubleshooting

I can't find the test run I created

Test runs are listed under Test Cases → Runs. Use the status filter to show In Progress or Completed runs. Runs don't appear in the main test case list — look for the Runs tab.

The "File Defect" button isn't available after marking a test as Failed

The File Defect button appears only when a test case is marked as Fail within an active test run. If you recorded a Fail outside of a run, open the run, find the test case, and use the button from there.

The defect I filed from a test run isn't showing in the Defect List

The defect is created in the project's defect tracker immediately. Refresh the Defect List page. If still missing, check that you're viewing the correct project.

I can't edit a test result after saving it

Results within a run can be updated as long as the run is still In Progress. Open the run, find the test case, and click the result to change it. Once a run is marked Complete, results are locked.

A team member can't see the test run

Test runs follow project access. Confirm the team member has project access. Read-only members can view runs but cannot record results.

I want to re-run only the failed tests from a previous run

When creating a new run, choose "Import from previous run" and filter to Failed and Blocked cases only. This creates a focused regression run without re-testing cases that already passed.