Skip to content

Home

Jump to bottom
Fernando Pastor edited this page Jan 5, 2023 · 6 revisions

Welcome to the TESTAR_iv4xr wiki!

TESTAR execution flow

TESTAR is a scriptless testing tool that integrates the iv4XR plugin to test eXtended Reality (XR) systems. The flow cycle of this scriptless process consists on:

  1. Use the iv4XR-plugin to observe the XR state.
  2. Derive all possible actions to execute for each observed XR entity.
  3. Select an action to execute by using a random, prioritization of Reinforcement Learning algorithm.
  4. Execute the action.
  5. Apply Oracles to validate if the XR system contains failures.

reduced_TESTAR_flow_with_state_model

TESTAR results

TESTAR creates two main types of results while exploring the XR systems:

  • HTML report that indicates the observed state and executed actions step-by-step with textual and visual information. This HTML report is always active and created in an output folder by default.

  • State Model inferred that contains information regarding how the executed actions allow transit between the observed states. In order to use the State Model functionality, it is necessary to configure the OrientDB database.

TESTAR Requirements

  • Windows 10, 11, Server 2016, Server 2019 OS
  • Java 11 to Java 14 (With Java 15, it is not possible to modify the protocol at the moment)
  • OrientDB v 3.0.34 (to infer a State Model if option enabled)

Wiki structure

  • iv4XR plugin extension TESTAR core was extended with an iv4XR java package to allow the tool to interact with the XR systems.
  • Project compilation TESTAR uses Gradle to compile the project and create an executable.
  • Java protocols TESTAR java protocols allow users to customize the decision-making of the flow cycle.
  • LabRecruits TESTAR contains a set of protocols to explore the LabRecruits demo game automatically.
  • Space Engineers TESTAR contains a set of protocols to explore the Space Engineers industry game automatically.
  • State Model TESTAR can infer a State Model automatically using the OrientDB database.

Contact information

On this wiki page, we are going to offer information about the configuration and execution of TESTAR for the exploration of the LabRecruits and Space Engineers systems under test. For any suggestions or errors found, please open an issue or send an email to tanja@testar.org and fernando@testar.org .

Clone this wiki locally