Objectives

• Performed tests for registered systems

Pre-requisites

• Test Session is configured and opened
• Participants are registered
• Systems are registered
• Systems configurations are ready to exchange informations
• Tests are ready, validated and assigned

Inputs

• Key Performance Indicators that allow following the progress of the test execution
• Reporting elements that need to be provided in the test session report
• Satisfaction questionnaire for participants are prepared

Actions

• Test Session Manager
• Sends Kick-off mail (see template)
• Consults KPI
• Turns critical status to on
• Grades systems
• It is possible to add some test case to the test plan, even if they are not planned at the beginning.
• SUT Operators
• Run assigned tests
• Store any proof of test execution (logs, trace...)
• Change tests status
• Complete the satisfaction questionnaire
• Monitors
• Verify assigned tests
• Specific attention must be paid at the moment a test result seems to be false : monitor checks environment first after concluding if the result is false or not
• in case of Test steps are not performed (eg : NIST tools not available), monitor mentions it and adds a comment on the reason why it is not impacting the test result.
• Complete the satisfaction questionnaire

Outputs

• Satisfaction questionnaires, see for example the Istanbul survey
• Set of test instances performed during the Test Session execution (includes Monitors and SUT operators comments)

Tools

• test instance workflow 

Flowchart