Skip to content

test: set up itk nightly runs#1052

Open
kdziedzic70 wants to merge 1 commit intomainfrom
dziedzick/itk-nightyly
Open

test: set up itk nightly runs#1052
kdziedzic70 wants to merge 1 commit intomainfrom
dziedzick/itk-nightyly

Conversation

@kdziedzic70
Copy link
Copy Markdown
Contributor

@kdziedzic70 kdziedzic70 commented May 6, 2026

Description

This PR:

  • configures nightly runs for itk tests
  • uploads the results to nightly-metrics rolling release to be re-used for visual inspection
  • separates test cases definition from execution script

Thank you for opening a Pull Request!
Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • Follow the CONTRIBUTING Guide.
  • Make your Pull Request title in the https://www.conventionalcommits.org/ specification.
    • Important Prefixes for release-please:
      • fix: which represents bug fixes, and correlates to a SemVer patch.
      • feat: represents a new feature, and correlates to a SemVer minor.
      • feat!:, or fix!:, refactor!:, etc., which represent a breaking change (indicated by the !) and will result in a SemVer major.
  • Ensure the tests and linter pass (Run bash scripts/format.sh from the repository root to format)
  • Appropriate docs were updated (if necessary)

Fixes #<issue_number_goes_here> 🦕

@kdziedzic70 kdziedzic70 requested a review from a team as a code owner May 6, 2026 08:52
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request refactors the ITK test execution by externalizing test scenarios into a JSON file and introducing a Python script to manage test history for nightly runs. The review feedback highlights critical improvements for error handling in the history processing script, specifically recommending that the script fail explicitly on network or file-loading errors to prevent data loss and ensure that the CI pipeline correctly identifies test failures through appropriate exit codes.

Comment thread itk/process_results.py Outdated
Comment thread itk/process_results.py Outdated
Comment thread itk/process_results.py Outdated
@kdziedzic70 kdziedzic70 force-pushed the dziedzick/itk-nightyly branch 2 times, most recently from ace973a to d942519 Compare May 6, 2026 09:26
Comment thread itk/process_results.py Fixed
@kdziedzic70 kdziedzic70 changed the title [WIP]test: set up itk nightly runs test: set up itk nightly runs May 6, 2026
@kdziedzic70 kdziedzic70 force-pushed the dziedzick/itk-nightyly branch from d942519 to cb49919 Compare May 6, 2026 09:57
Comment thread itk/process_results.py Fixed
Comment thread itk/process_results.py Fixed
Comment thread itk/process_results.py Fixed
@kdziedzic70 kdziedzic70 force-pushed the dziedzick/itk-nightyly branch from cb49919 to 0961c8f Compare May 6, 2026 10:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant