dotnet / runtime

.NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.
https://docs.microsoft.com/dotnet/core/
MIT License
14.85k stars 4.62k forks source link

Enable post back of JIT test pipeline results to triggering GitHub PR #93138

Open BruceForstall opened 10 months ago

BruceForstall commented 10 months ago

CodeGen pull requests (PRs) automatically or manually trigger various AzDO pipelines, such as superpmi-diffs, superpmi-replay, Antigen, Fuzzlyn. These pipelines in particular produce results in Markdown format that are exposed in the AzDO UI in an "Extensions" page.

This work item is to enable a mechanism where these pipelines can post back to the triggering GitHub issue the contents of the Extensions page, or some other bespoke GitHub results summary. This would make the results easier to find (it would not be necessary to search for the results in the AzDO UI), and the results would be retained longer (as the AzDO results have a very short retention lifetime).

Related: https://github.com/dotnet/runtime/issues/81838

category:eng-sys theme:super-pmi skill-level:intermediate cost:medium impact:medium

ghost commented 10 months ago

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch See info in area-owners.md if you want to be subscribed.

Issue Details
CodeGen pull requests (PRs) automatically or manually trigger various AzDO pipelines, such as [superpmi-diffs](https://dev.azure.com/dnceng-public/public/_build?definitionId=152), [superpmi-replay](https://dev.azure.com/dnceng-public/public/_build?definitionId=150), [Antigen](https://dev.azure.com/dnceng-public/public/_build?definitionId=147), [Fuzzlyn](https://dev.azure.com/dnceng-public/public/_build?definitionId=149). These pipelines in particular produce results in Markdown format that are exposed in the AzDO UI in an "Extensions" page. This work item is to enable a mechanism where these pipelines can post back to the triggering GitHub issue the contents of the Extensions page, or some other bespoke GitHub results summary. This would make the results easier to find (it would not be necessary to search for the results in the AzDO UI), and the results would be retained longer (as the AzDO results have a very short retention lifetime). Related: https://github.com/dotnet/runtime/issues/81838 category:eng-sys theme:super-pmi skill-level:intermediate cost:medium impact:medium
Author: BruceForstall
Assignees: -
Labels: `area-CodeGen-coreclr`
Milestone: 9.0.0
jkoritzinsky commented 10 months ago

There’s an AzDO task for creating GitHub issue comments: https://learn.microsoft.com/en-us/azure/devops/pipelines/tasks/reference/github-comment-v0?view=azure-pipelines