Add release-doctor agentic workflow for automated release pipeline monitoring#500
Merged
Conversation
…ring Add comprehensive release-doctor workflow that monitors all stages of the release pipeline and creates diagnostic issues when failures occur. The workflow: - Monitors prepare-release, release, and update-package-manifests workflows - Analyzes failed jobs and extracts error logs - Verifies release integrity (binaries, CHANGELOG sync, version consistency) - Checks package manifest update PRs - Creates detailed GitHub issues with root cause analysis and remediation steps - Only triggers on workflow failures to avoid noise The workflow uses GitHub Copilot as the AI engine and has appropriate permissions to inspect workflows, read repository contents, search issues/PRs, and create diagnostic issues. Co-authored-by: Mossaka <5447827+Mossaka@users.noreply.github.com>
Add comprehensive documentation for the release-doctor agentic workflow including: - What workflows it monitors (prepare-release, release, update-package-manifests) - What it checks (binaries, CHANGELOG sync, version consistency, manifest PRs) - How it works (automatic triggering, smart detection, deep analysis) - Benefits and usage instructions - How to view results and historical patterns Co-authored-by: Mossaka <5447827+Mossaka@users.noreply.github.com>
Copilot
AI
changed the title
[WIP] Add release-doctor workflow for failure detection
Add release-doctor agentic workflow for automated release pipeline monitoring
Nov 2, 2025
Mossaka
suggested changes
Nov 2, 2025
Comment on lines
+7
to
+9
| ### Added | ||
|
|
||
| - Release Doctor agentic workflow that monitors the entire release pipeline (prepare-release, release, update-package-manifests) and automatically creates diagnostic issues when failures occur, including verification of release binaries, CHANGELOG synchronization, version consistency, and package manifest updates |
Contributor
Author
There was a problem hiding this comment.
Done in e55e3ed. Removed the CHANGELOG entry for release-doctor.
Comment on lines
+120
to
+139
| ## Release Pipeline Monitoring | ||
|
|
||
| If the automated workflows fail, you can follow the manual process: | ||
| The [Release Doctor workflow](.github/workflows/release-doctor.md) automatically monitors the entire release pipeline and creates diagnostic issues when failures occur. | ||
|
|
||
| 1. **Create and push the release tag manually** (if `auto-tag-release.yml` fails): | ||
| ```bash | ||
| # Checkout the main branch and pull the latest changes | ||
| git checkout main | ||
| git pull origin main | ||
| ### What It Monitors | ||
|
|
||
| # Create a new tag (e.g., v0.4.0) | ||
| git tag -a v<version> -m "Release v<version>" | ||
|
|
||
| # Push the tag | ||
| git push origin v<version> | ||
| ``` | ||
| The Release Doctor monitors three critical workflows: | ||
|
|
||
| 1. **Prepare Release** (`prepare-release.yml`): Version bump PR creation | ||
| 2. **Release** (`release.yml`): Binary builds, GitHub release creation, CHANGELOG updates | ||
| 3. **Update Package Manifests** (`update-package-manifests.yml`): Homebrew and WinGet updates | ||
|
|
||
| ### What It Checks | ||
|
|
||
| When a release workflow completes, the Release Doctor performs comprehensive verification: | ||
|
|
||
| **For All Workflows:** | ||
| - Analyzes failed jobs and extracts error logs | ||
| - Identifies root causes and error patterns | ||
| - Searches for similar historical failures |
Contributor
There was a problem hiding this comment.
@copilot the monitor pipeline should not be in release.md. but it should be documented in the docs on what agentic workflow we use
Contributor
Author
There was a problem hiding this comment.
Done in e55e3ed. Moved the release-doctor documentation from RELEASE.md to docs/design/agentic-workflows.md where it's listed alongside other agentic workflows.
- Remove CHANGELOG entry as requested - Remove "Release Pipeline Monitoring" section from RELEASE.md - Add release-doctor to the list of workflows in docs/design/agentic-workflows.md Addresses feedback from @Mossaka to document agentic workflows in the docs rather than in RELEASE.md Co-authored-by: Mossaka <5447827+Mossaka@users.noreply.github.com>
Mossaka
approved these changes
Nov 2, 2025
Mossaka
added a commit
to Mossaka/wassette
that referenced
this pull request
Feb 2, 2026
…nitoring (microsoft#500) * Initial plan * feat: Add release-doctor agentic workflow for release pipeline monitoring Add comprehensive release-doctor workflow that monitors all stages of the release pipeline and creates diagnostic issues when failures occur. The workflow: - Monitors prepare-release, release, and update-package-manifests workflows - Analyzes failed jobs and extracts error logs - Verifies release integrity (binaries, CHANGELOG sync, version consistency) - Checks package manifest update PRs - Creates detailed GitHub issues with root cause analysis and remediation steps - Only triggers on workflow failures to avoid noise The workflow uses GitHub Copilot as the AI engine and has appropriate permissions to inspect workflows, read repository contents, search issues/PRs, and create diagnostic issues. Co-authored-by: Mossaka <5447827+Mossaka@users.noreply.github.com> * docs: Document release-doctor workflow in RELEASE.md Add comprehensive documentation for the release-doctor agentic workflow including: - What workflows it monitors (prepare-release, release, update-package-manifests) - What it checks (binaries, CHANGELOG sync, version consistency, manifest PRs) - How it works (automatic triggering, smart detection, deep analysis) - Benefits and usage instructions - How to view results and historical patterns Co-authored-by: Mossaka <5447827+Mossaka@users.noreply.github.com> * docs: Move release-doctor documentation to agentic-workflows.md - Remove CHANGELOG entry as requested - Remove "Release Pipeline Monitoring" section from RELEASE.md - Add release-doctor to the list of workflows in docs/design/agentic-workflows.md Addresses feedback from @Mossaka to document agentic workflows in the docs rather than in RELEASE.md Co-authored-by: Mossaka <5447827+Mossaka@users.noreply.github.com> --------- Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: Mossaka <5447827+Mossaka@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The release pipeline has grown complex (prepare-release → PR → release → CHANGELOG update → package manifests), making failures difficult to diagnose. This adds automated monitoring and diagnostic issue creation.
Implementation
New agentic workflow (
.github/workflows/release-doctor.md):prepare-release.yml,release.yml,update-package-manifests.ymlSeven investigation phases:
Verification checks:
Issue structure:
Permissions: Read-only except
issues: write(via safe-outputs for security)Documentation: Added release-doctor to the agentic workflows list in
docs/design/agentic-workflows.mdalongside other agentic workflows (Issue Triage Bot, Scout Research Agent, CI Doctor).Example Scenario
When the release workflow fails to build ARM64 macOS binary:
darwin_arm64)rustup target add aarch64-apple-darwin)Original prompt
💬 We'd love your input! Share your thoughts on Copilot coding agent in our 2 minute survey.