Skip to content

Conversation

@rauchy
Copy link

@rauchy rauchy commented Jan 13, 2026

Summary

Migrate from GitHub Statuses API to Checks API for integration test reporting.

Why: The current setup uses a Personal Access Token (PAT) with the Statuses API, which requires monthly token rotation. By switching to the Checks API with GitHub App authentication, we eliminate this maintenance burden.

Changes:

  • Generate a second GitHub App token (DECO_TEST_APPROVAL_APP) for creating check runs
  • Create an "Integration Tests" check before triggering the workflow
  • Pass check_run_id to eng-dev-ecosystem so it can update the check status
  • Update get_status() to query Checks API instead of Statuses API

This aligns CLI with how the SDKs handle integration test status reporting.

@eng-dev-ecosystem-bot
Copy link
Collaborator

eng-dev-ecosystem-bot commented Jan 13, 2026

Commit: 4de54b2

Run: 21135977236

Env ❌​FAIL 🟨​KNOWN 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
🟨​ aws linux 7 10 2 411 695 24:57
🟨​ aws windows 10 7 2 413 693 22:48
❌​ aws-ucws linux 3 3 14 2 583 568 63:24
❌​ aws-ucws windows 3 6 11 2 585 566 60:43
💚​ azure linux 12 3 413 694 20:04
🟨​ azure windows 4 8 3 415 692 19:50
❌​ azure-ucws linux 3 1 11 3 581 567 48:02
❌​ azure-ucws windows 3 4 8 3 583 565 42:32
❌​ gcp linux 2 11 1 3 400 700 23:41
❌​ gcp windows 2 11 1 3 402 698 22:22
24 interesting tests: 17 KNOWN, 5 FAIL, 1 SKIP, 1 RECOVERED
Test Name aws linux aws windows aws-ucws linux aws-ucws windows azure linux azure windows azure-ucws linux azure-ucws windows gcp linux gcp windows
🟨​ TestAccept 🟨​K 🟨​K 🟨​K 🟨​K 💚​R 🟨​K 🟨​K 🟨​K 🟨​K 🟨​K
🟨​ TestAccept/bundle/deployment/bind/alert 🙈​S 🙈​S 🙈​S 🙈​S 💚​R 💚​R 💚​R 💚​R 🟨​K 🟨​K
❌​ TestAccept/bundle/deployment/bind/alert/DATABRICKS_BUNDLE_ENGINE=direct ✅​p ✅​p ✅​p ✅​p ❌​F ❌​F
❌​ TestAccept/bundle/deployment/bind/alert/DATABRICKS_BUNDLE_ENGINE=terraform ✅​p ✅​p ✅​p ✅​p ❌​F ❌​F
🟨​ TestAccept/bundle/generate/alert 💚​R 🟨​K 💚​R 🟨​K 💚​R 🟨​K 💚​R 🟨​K 🟨​K 🟨​K
🟨​ TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=direct 💚​R 🟨​K 💚​R 🟨​K 💚​R 🟨​K 💚​R 🟨​K 🟨​K 🟨​K
🟨​ TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=terraform 💚​R 🟨​K 💚​R 🟨​K 💚​R 🟨​K 💚​R 🟨​K 🟨​K 🟨​K
🟨​ TestAccept/bundle/resources/alerts/basic 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 🟨​K 🟨​K
🟨​ TestAccept/bundle/resources/alerts/basic/DATABRICKS_BUNDLE_ENGINE=direct 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 🟨​K 🟨​K
🟨​ TestAccept/bundle/resources/alerts/basic/DATABRICKS_BUNDLE_ENGINE=terraform 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 🟨​K 🟨​K
🟨​ TestAccept/bundle/resources/alerts/with_file 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 🟨​K 🟨​K
🟨​ TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=direct 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 🟨​K 🟨​K
🟨​ TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=terraform 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 🟨​K 🟨​K
🙈​ TestAccept/bundle/resources/permissions 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions 🟨​K 🟨​K 🟨​K 🟨​K 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct 🟨​K 🟨​K 🟨​K 🟨​K
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform 🟨​K 🟨​K 💚​R 💚​R
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions 🟨​K 🟨​K 💚​R 💚​R 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct 🟨​K 🟨​K 💚​R 💚​R
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform 🟨​K 🟨​K 💚​R 💚​R
❌​ TestAccept/bundle/resources/synced_database_tables/basic 🙈​s 🙈​s ❌​F ❌​F 🙈​s 🙈​s ❌​F ❌​F 🙈​s 🙈​s
❌​ TestAccept/bundle/resources/synced_database_tables/basic/DATABRICKS_BUNDLE_ENGINE=direct ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/resources/synced_database_tables/basic/DATABRICKS_BUNDLE_ENGINE=terraform ❌​F ❌​F ❌​F ❌​F
💚​ TestAccept/ssh/connection 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
Top 36 slowest tests (at least 2 minutes):
duration env testname
5:57 gcp linux TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
5:35 aws linux TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
5:28 aws-ucws linux TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
5:17 gcp linux TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
5:08 gcp windows TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
5:02 azure-ucws linux TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
4:45 azure linux TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
4:37 azure-ucws windows TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
4:36 azure-ucws windows TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
3:28 gcp windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:21 gcp linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:13 gcp windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:05 gcp linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:55 aws-ucws linux TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
2:47 aws-ucws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:44 aws-ucws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:42 aws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:42 aws-ucws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:39 aws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:37 aws-ucws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:31 aws linux TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
2:26 aws-ucws windows TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
2:17 azure windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:16 aws windows TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
2:15 aws-ucws windows TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
2:14 gcp windows TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
2:13 azure-ucws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:13 azure-ucws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:09 azure-ucws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:09 azure-ucws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:08 aws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:07 azure linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:06 azure windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:06 aws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:05 aws windows TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
2:05 azure linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct

@rauchy rauchy force-pushed the deco-26060-checks-api branch from b246212 to 7bc545c Compare January 13, 2026 09:28
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 09:28 — with GitHub Actions Inactive
@rauchy rauchy force-pushed the deco-26060-checks-api branch from 7bc545c to f262fde Compare January 13, 2026 09:37
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 09:37 — with GitHub Actions Inactive
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 09:37 — with GitHub Actions Inactive
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 09:38 — with GitHub Actions Inactive
@rauchy rauchy force-pushed the deco-26060-checks-api branch from f262fde to 7ec8e57 Compare January 13, 2026 09:54
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 09:54 — with GitHub Actions Inactive
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 09:54 — with GitHub Actions Inactive
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 09:55 — with GitHub Actions Inactive
@rauchy rauchy force-pushed the deco-26060-checks-api branch from 7ec8e57 to 82b55b4 Compare January 13, 2026 10:13
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 10:13 — with GitHub Actions Inactive
@rauchy rauchy force-pushed the deco-26060-checks-api branch from 82b55b4 to 3b91a81 Compare January 13, 2026 10:31
@rauchy rauchy temporarily deployed to test-trigger-is January 13, 2026 10:31 — with GitHub Actions Inactive
@rauchy rauchy requested a review from pietern January 13, 2026 10:32
@rauchy rauchy temporarily deployed to test-trigger-is January 16, 2026 15:57 — with GitHub Actions Inactive
@rauchy rauchy force-pushed the deco-26060-checks-api branch from 5002672 to bec0687 Compare January 18, 2026 15:45
@rauchy rauchy temporarily deployed to test-trigger-is January 18, 2026 15:45 — with GitHub Actions Inactive
@rauchy rauchy enabled auto-merge January 18, 2026 15:52
@rauchy rauchy temporarily deployed to test-trigger-is January 19, 2026 08:27 — with GitHub Actions Inactive
@rauchy rauchy force-pushed the deco-26060-checks-api branch from e03cd0c to 4de54b2 Compare January 19, 2026 11:35
@rauchy rauchy temporarily deployed to test-trigger-is January 19, 2026 11:35 — with GitHub Actions Inactive
Use GitHub Checks API instead of Statuses API to report integration
test results. This enables the use of GitHub App authentication and
eliminates the need for monthly PAT rotation.

Changes:
- Generate a second GitHub App token for check creation
- Create check run before triggering tests in eng-dev-ecosystem
- Pass check_run_id to the workflow for status updates
- Update get_status() to query Checks API instead of Statuses API
allows ecosystem workflows to extract just the summary line without grep parsing
temporarily use omer-lachish_data/deco-26173-cli-report-in-checks branch
to test new check report functionality before merging
@rauchy rauchy force-pushed the deco-26060-checks-api branch from 4de54b2 to 75b2e2e Compare January 19, 2026 12:59
@rauchy rauchy deployed to test-trigger-is January 19, 2026 13:00 — with GitHub Actions Active
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants