Microshift Ci:test Job

コミュニティGood70/100申請する

updated 7d ago

The microshift-ci:test-job command fetches comprehensive information from a Prow CI job execution and displays it in both JSON and Markdown formats.

ソースウェブサイトドキュメント7

Microshift Ci:test Job で何ができる？

name: microshift-ci:test-job argument-hint: description: Analyze a MicroShift Prow CI Test Job execution user-invocable: true allowed-tools: Skill, WebFetch, Bash, Read, Write, Glob, Grep

microshift-ci:test-job

Synopsis

/microshift-ci:test-job <job-url>

Description

The microshift-ci:test-job command fetches comprehensive information from a Prow CI job execution and displays it in both JSON and Markdown formats.

This command provides:

Job metadata (status, timing, architecture, image type)
MicroShift version being tested
Test scenarios executed and their results
Build information
Links to logs and artifacts

This command is useful for understanding what was tested in a specific job run, identifying failures, and accessing detailed logs and artifacts.

Implementation

This command works by:

Parsing the job URL to extract job name, ID, and configuration (architecture, image type, version)
Fetching job metadata from finished.json and started.json to get status, timing, and result information
Extracting MicroShift version using the extract-version.py helper script from build logs
Listing test scenarios by fetching the scenario-info directory structure from GCS artifacts
Analyzing test results for each scenario using the microshift-ci:test-scenario command to get comprehensive JSON data
Compiling artifacts and logs by constructing URLs to build logs, test execution logs, and failure diagnostics
Generating a detailed Markdown report with job overview, version info, scenario results, and artifact links

The command integrates with the microshift-ci:test-scenario command to provide detailed per-scenario analysis and aggregates all information into a human-readable report with proper formatting (status icons, duration calculations, failure summaries).

Arguments

$1 (job-url): URL to the Prow CI job - Required
- Formats accepted:
  - Full Prow dashboard URL: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/<job-name>/<job-id>
  - GCS web URL: https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/logs/<job-name>/<job-id>
  - Job ID only (e.g., "1979744605507162112") - will attempt to infer job type from context

Return Value

Format: Markdown
Location: Output directly to the conversation
Content:
- Job overview (status, timing, configuration)
- MicroShift version details
- Test scenario results
- Build information
- Links to logs and artifacts

Implementation Steps

Step 1: Parse Arguments and Validate Job URL

Goal: Extract the job name, job ID, and job configuration.

Actions:

Parse the job URL to extract:
- Job name (e.g., "periodic-ci-openshift-microshift-release-4.20-periodics-e2e-aws-tests-bootc-release-periodic")
- Job ID (e.g., "1979744605507162112")
Determine job configuration from job name:
- Architecture: x86_64 or aarch64 (look for "arm" in job name)
- Image type: bootc or rpm-ostree (look for "bootc" in job name)
- Version: extract from job name (e.g., "4.20")
Validate URL format
If only job ID provided, ask user for job type or attempt to determine from recent jobs

Example Parsing:

URL: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-microshift-release-4.20-periodics-e2e-aws-tests-bootc-release-periodic/1979744605507162112

Extracted:
- job_name: "periodic-ci-openshift-microshift-release-4.20-periodics-e2e-aws-tests-bootc-release-periodic"
- job_id: "1979744605507162112"
- version: "4.20"
- arch: "x86_64"
- image_type: "bootc"

Step 2: Fetch Job Metadata

Goal: Get job information (status, timing, result).

Actions:

Construct the GCS URL for the finished.json file:

https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/logs/<job-name>/<job-id>/finished.json

Fetch the finished.json file using curl or WebFetch
Parse the JSON to extract:
- Job result (SUCCESS/FAILURE/ABORTED)
- Timestamp (start/end times)
- Duration
- Passed status
- Metadata (repo, revision, etc.)

Fetch started.json for additional metadata:

curl -s "https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/logs/<job-name>/<job-id>/started.json"

Step 3: Extract MicroShift Version

Goal: Determine the exact MicroShift version being tested.

This command includes a Python script that automates version extraction from test logs.

Script Location: plugins/microshift-ci/scripts/extract-version.py

Usage:

python3 plugins/microshift-ci/scripts/extract-version.py <prow_url> <scenario>

Arguments:

prow_url: The full Prow CI job URL (e.g., "https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-microshift-release-4.20-periodics-e2e-aws-tests-bootc-release-periodic/1979744605507162112")
scenario: The test scenario name (e.g., "el96-lrel@ipv6")

Example:

# Extract version for a specific job and scenario
python3 plugins/microshift-ci/scripts/extract-version.py "https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-microshift-release-4.20-periodics-e2e-aws-tests-bootc-release-periodic/1979744605507162112" "el96-lrel@ipv6"

Output (JSON):

{
  "success": true,
  "version": "4.20.0-202510161342.p0.g17d1d9a.assembly.4.20.0.el9.x86_64",
  "build_type": "zstream",
  "url": "https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/logs/...",
  "error": null
}

Build Types Detected:

"nightly": Nightly development builds
"ec": Engineering Candidate
"rc": Release Candidate
"zstream": Stable/zstream release

Step 4: List Test Scenarios

Goal: Find all test scenarios executed in this job and list them.

Output (JSON):

{
  "job_id": "1979744605507162112",
  "scenarios": [
    "el94-y2@el96-lrel@standard1",
    "el96-lrel@standard1",
    "el96-lrel@lvm",
    "el96-lrel@dual-stack",
    "el96-lrel@ipv6"
  ],
  "total_scenarios": 5
}

Step 5: Analyze Test Results for Each Scenario

Goal: Get detailed test execution results for each scenario.

Method: Use the microshift-ci:test-scenario command for each scenario to get comprehensive JSON data.

Actions: For each scenario found in Step 4:

Get scenario details using the microshift-ci:test-scenario command:
```
/microshift-ci:test-scenario <job-url> <scenario-name>
```
Parse the JSON response which includes:
- Test results summary (total, passed, failed, errors, skipped)
- Individual test case details
- Failure messages and details (if any)
- Scenario configuration (RHEL version, test category)
- Execution timing
- Links to all artifacts

Example JSON Response:

{
  "scenario": {
    "name": "el96-lrel@standard1",
    "description": "RHEL 9.6 Latest Release - Standard Tests",
    "configuration": {
      "rhel_version": "9.6",
      "release_type": "latest",
      "test_category": "Standard Tests"
    }
  },
  "test_results": {
    "status": "passed",
    "summary": {
      "total": 65,
      "passed": 65,
      "failed": 0,
      "errors": 0,
      "skipped": 0
    },
    "execution_time_seconds": 1234.56,
    "test_cases": [
      {
        "name": "MicroShift boots successfully",
        "status": "passed"
      }
    ],
    "failures": []
  },
  "artifacts": {
    "junit_xml": "https://...",
    "boot_log": "https://...",
    "debug_log": "https://..."
  }
}

Extract key information from each scenario:
- Overall status (passed/failed)
- Test counts
- Failure details (for failed scenarios)
- Execution time
- Test category and configuration

Alternative Manual Method (if microshift-ci:test-scenario command unavailable):

Fetch junit.xml directly from artifact URL
Parse XML to extract test counts
Check boot_and_run.log for execution details
Extract scenario metadata from directory structure

Step 6: Compile Artifacts and Logs

Goal: Provide links to useful artifacts and logs.

Actions:

Compile key artifact URLs:
- Build log: artifacts/<job-type>/openshift-microshift-infra-iso-build/build-log.txt
- Test logs for each scenario
- JUnit XML reports
- Any failure logs or sosreports
Categorize artifacts by type:
- Build artifacts
- Test execution logs
- Failure diagnostics
- System information

Step 7: Generate Detailed Report

Goal: Create a comprehensive, well-structured report.

Report Structure:

# MicroShift CI Job Details

## Job Overview
- **Job ID**: <job-id>
- **Job Name**: <job-name>
- **Status**: ✓ SUCCESS / ✗ FAILURE / ⚠️ ABORTED
- **Architecture**: x86_64 / aarch64
- **Image Type**: bootc / rpm-ostree
- **Duration**: Xh Ym Zs
- **Started**: YYYY-MM-DD HH:MM:SS UTC
- **Finished**: YYYY-MM-DD HH:MM:SS UTC

## MicroShift Version
- **Full Version**: <full-version-string>
- **Build Type**: nightly / RC / EC / stable
- **Base Version**: X.Y.Z
- **Commit**: <commit-hash>
- **Build Timestamp**: YYYY-MM-DD-HHMMSS

## Test Scenarios

### Scenario: <scenario-name>
- **Description**: <RHEL version and test type>
- **Status**: ✓ PASS / ✗ FAIL
- **Tests**: X passed, Y failed, Z skipped
- **Duration**: Xm Ys

**Failures** (if any):
- Test: <test-name>
  - Error: <error-message>
  - Log: [View](<log-url>)

[Repeat for each scenario]

## Build Information
- **Build Status**: SUCCESS / FAILURE
- **Build Log**: [View](<build-log-url>)
- **Build Duration**: Xm Ys

## Artifacts & Logs
- [Build Log](<url>)
- [Test Execution Logs](<url>)
- [Scenario Details](<url>)
- [Full Artifacts](<artifacts-url>)

## Links
- [View on Prow CI](<prow-url>)
- [Browse All Artifacts](<gcsweb-url>)

Step 8: Error Handling

Goal: Handle errors gracefully.

Common Issues:

Job not found (404):
- Verify job ID is correct
- Check if job is still running (no finished.json yet)
- Provide helpful error message to user
- Handle network errors gracefully
Artifacts not available:
- Some jobs may not have all artifacts
- Gracefully handle missing files
- Indicate which artifacts are unavailable in the report
Invalid job URL:
- Validate URL format before making requests
- Handle malformed URLs
- Provide examples of valid formats
- Suggest using job ID from Prow job URL
Version extraction failures:
- Handle cases where version cannot be determined
- Provide partial information if available
- Include error message in report

Examples

Example 1: Successful Job Analysis

/microshift-ci:test-job https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-microshift-release-4.20-periodics-e2e-aws-tests-bootc-release-periodic/1979744605507162112

Output:

# MicroShift CI Job Details

## Job Overview
- **Job ID**: 1979744605507162112
- **Job Name**: periodic-ci-openshift-microshift-release-4.20-periodics-e2e-aws-tests-bootc-release-periodic
- **Status**: ✓ SUCCESS
- **Architecture**: x86_64
- **Image Type**: bootc
- **Duration**: 1h 43m 40s
- **Started**: 2025-10-19 03:01:17 UTC
- **Finished**: 2025-10-19 04:44:57 UTC

## MicroShift Version
- **Full Version**: 4.20.0-0.nightly-2025-10-15-110252-20251017171355-4ad30ab2d
- **Build Type**: nightly
- **Base Version**: 4.20.0
- **Commit**: 4ad30ab2d
- **Build Date**: 2025-10-15

## Test Scenarios

### Scenario: el96-lrel@standard1
- **Description**: RHEL 9.6 Latest Release - Standard Tests
- **Status**: ✓ PASS
- **Tests**: 45 passed, 0 failed, 2 skipped

[Additional sections...]

Example 2: Using GCS Web URL

/microshift-ci:test-job https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/logs/periodic-ci-openshift-microshift-release-4.20-periodics-e2e-aws-tests-release-arm-periodic/1979744608019550208

Example 3: Failed Job Analysis

/microshift-ci:test-job https://prow.ci.openshift.org/view/gs/test-platform-results/logs/some-failing-job/9876543210

Output would include failure details:

## Job Overview
- **Status**: ✗ FAILURE
...

## Test Scenarios
...
**Failures**:
- Test: <test-name>
  - Error: <error-message>
  - Log: [View](<log-url>)

Example 4: Job ID Only

/microshift-ci:test-job 1979744605507162112

(May prompt for additional context or attempt to determine job type from recent jobs)

Notes

This command provides comprehensive analysis including job status, MicroShift version, test scenarios, and detailed results
Works with MicroShift-specific Prow CI jobs
Requires internet access to fetch job data from Prow CI
All times are displayed in UTC
Duration is calculated from the finished.json timestamp and start time from started.json
The command is read-only and does not modify any CI job data
Useful for debugging specific test failures or understanding what was tested

インストール

Microshift Ci:test Job をクライアントに追加します。お使いのものを選んでください。

npx skills add openshift-eng/edge-tooling

Installs every skill in the repository, then prompts for which to keep.

/plugin marketplace add openshift-eng/edge-tooling

Adds the repository as a plugin marketplace; install individual plugins with `/plugin install`.

git clone https://github.com/openshift-eng/edge-tooling
cp -r plugins/microshift-ci/skills/test-job ~/.claude/skills/

A skill is a plain directory. Copy it into `.claude/skills/` in a project or in your home directory.

Microshift Ci:test Job で何ができる？

name: microshift-ci:test-job argument-hint: description: Analyze a MicroShift Prow CI Test Job execution user-invocable: true allowed-tools: Skill, WebFetch, Bash, Read, Write, Glob, Grep

microshift-ci:test-job

Synopsis

Description

Implementation

Arguments

Return Value

Implementation Steps

Step 1: Parse Arguments and Validate Job URL

Step 2: Fetch Job Metadata

Step 3: Extract MicroShift Version

Step 4: List Test Scenarios

Step 5: Analyze Test Results for Each Scenario

Step 6: Compile Artifacts and Logs

Step 7: Generate Detailed Report

Step 8: Error Handling

Examples

Example 1: Successful Job Analysis

Example 2: Using GCS Web URL

Example 3: Failed Job Analysis

Example 4: Job ID Only

Notes

インストール

スコア