Test Runs

Understanding Test Execution and Results in Iris

Test runs represent individual executions of tests by Iris agents. Each test run captures the complete journey of a test, including interactions, validations, and results.

Understanding Test Runs

Execution History

Complete record of test progression

Agent Activity

Detailed agent interactions and decisions

Visual Evidence

Screenshots and recordings

Results

Performance metrics and outcomes

Test Run Lifecycle

1. Initialization

   Agent preparation

   Environment setup

   Resource allocation

   Configuration loading
2. Execution

   Step-by-step progression

   Real-time monitoring

   Error handling

   State management
3. Completion

   Result compilation

   Resource cleanup

   Report generation

   Notification dispatch

Test Run Data

Captured Info

Timing

Execution timestamps and duration

Actions

Detailed agent activities

Responses

System feedback and states

Evidence

Visual proof and logs

Analytics

Key Metrics

Success/failure status tracking

Execution time analysis

Resource utilization stats

Error pattern detection

Coverage measurements

Real-time Monitoring

Monitoring Features

Live Tracking

Progress monitoring

Agent activity tracking

Error detection

Performance analysis

Control Options

Interventions

Pause execution

Manual override

Debug mode

Emergency stop

Results and Reporting

Test Reports

Available Reports

Detailed execution logs

Visual evidence collection

Performance analytics

Error summaries

Integrations

Connected Systems

CI/CD pipeline integration

Notification systems

Analytics platforms

Issue tracking systems

Troubleshooting

Common Issues

Known Problems

Failed executions

Timeout issues

Resource constraints

Integration errors

Solutions

1. Analysis

   Investigate error logs and patterns

2. Diagnosis

   Review configurations and states

3. Resolution

   Apply fixes and verify solutions

4. Prevention

   Update procedures to prevent recurrence

Historical Data

Storage

Data Management

Result archival

Log retention

Evidence backup

Analysis

Analytical Tools

Trend visualization

Performance graphs

Coverage mapping