Skip to content

Infra improvements for Helix #68176

Closed
Closed
Infra improvements for Helix#68176
Labels
area-Infrastructure-coreclrOnly use for closed issues
Milestone
8.0.0

Description

@agocke
agocke
opened on Apr 18, 2022

List of requests from Helix to reduce failure overhead from PayloadGroup0, which seems to be returning a non-zero exit code very often.

  • Investigate potentially reducing/combining files. There is significant overhead “per file”, and this run produces a lot of files that are fairly low value, from what I can see in them. Maybe it would be possible to only output a single, combined file? Or maybe only generate the files when something “interesting happens”?
  • Potentially name the PayloadGroup0 different things in different scenarios, so that it’s easier to identify where problems are coming from.
  • Investigate why this item is failing, on average, 1600 a day. It seems like if it’s failing this often, the value might be low… it seems unlikely anyone has the time to investigate 1600 failures every day. Maybe specific tests inside it can be disabled if we have some way to dig in a bit more about what’s going on inside them. (We might be able to help investigation here if you need)

Runfo Tracking Issue: payloadgroup0 work item

Build Definition Kind Run Name Console Core Dump Test Results Run Client
333853 runtime PR 88604 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333842 runtime PR 88345 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333824 runtime PR 88242 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333781 runtime PR 88415 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333768 runtime PR 88268 mono linux arm64 Release @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8 console.log runclient.py
333768 runtime PR 88268 Mono browser wasm Release @ (Ubuntu.1804.Amd64)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-webassembly console.log runclient.py
333768 runtime PR 88268 mono windows x64 Release @ Windows.10.Amd64.Open console.log runclient.py
333768 runtime PR 88268 mono linux x64 Release @ Ubuntu.1804.Amd64.Open console.log runclient.py
333768 runtime PR 88268 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333768 runtime PR 88268 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
333768 runtime PR 88268 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
333750 runtime PR 88245 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333671 runtime PR 85562 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333574 runtime PR 88521 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333481 runtime PR 88595 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333388 runtime PR 88242 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333387 runtime PR 88242 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333378 runtime PR 87773 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333375 runtime PR 87260 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333367 runtime Rolling coreclr osx x64 Checked @ OSX.1200.Amd64.Open console.log runclient.py
333367 runtime Rolling coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333355 runtime PR 86787 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333354 runtime PR 86787 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333257 runtime PR 88584 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333211 runtime PR 88510 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333208 runtime PR 88572 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333196 runtime PR 80331 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333189 runtime PR 88559 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333168 runtime PR 88543 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333161 runtime Rolling coreclr osx x64 Checked @ OSX.1200.Amd64.Open console.log runclient.py
333161 runtime Rolling coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333109 runtime PR 88554 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
333109 runtime PR 88554 coreclr windows x64 Checked @ Windows.10.Amd64.Open console.log core dump runclient.py
333063 runtime PR 88521 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
332991 runtime Rolling coreclr osx x64 Checked @ OSX.1200.Amd64.Open console.log runclient.py
332991 runtime Rolling coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
332945 runtime PR 88543 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
332907 runtime PR 88034 coreclr linux x64 Checked no_tiered_compilation @ Ubuntu.1804.Amd64.Open console.log runclient.py
332907 runtime PR 88034 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
332898 runtime PR 88543 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
332849 runtime Rolling coreclr osx x64 Checked @ OSX.1200.Amd64.Open console.log runclient.py
332849 runtime Rolling coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
332826 runtime PR 86841 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
332801 runtime PR 88415 mono windows x64 Release @ Windows.10.Amd64.Open console.log runclient.py
332801 runtime PR 88415 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
332773 runtime PR 88531 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
332590 runtime PR 88543 mono linux arm64 Release @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8 console.log runclient.py
332590 runtime PR 88543 mono linux x64 Release @ Ubuntu.1804.Amd64.Open console.log runclient.py
332590 runtime PR 88543 mono windows x64 Release @ Windows.10.Amd64.Open console.log runclient.py
332590 runtime PR 88543 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
332336 runtime PR 88531 coreclr osx x64 Checked no_tiered_compilation @ OSX.1200.Amd64.Open console.log runclient.py
332317 runtime PR 88415 mono windows x64 Release @ Windows.10.Amd64.Open console.log runclient.py
331541 runtime PR 88371 mono linux arm64 Release @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8 console.log runclient.py
331541 runtime PR 88371 mono windows x64 Release @ Windows.10.Amd64.Open console.log runclient.py
331541 runtime PR 88371 mono linux x64 Release @ Ubuntu.1804.Amd64.Open console.log runclient.py
331541 runtime PR 88371 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331541 runtime PR 88371 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331490 runtime PR 88404 mono linux arm64 Release @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8 console.log runclient.py
331490 runtime PR 88404 mono linux x64 Release @ Ubuntu.1804.Amd64.Open console.log runclient.py
331490 runtime PR 88404 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331490 runtime PR 88404 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331467 runtime PR 88508 mono linux arm64 Release @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8 console.log runclient.py
331467 runtime PR 88508 mono linux x64 Release @ Ubuntu.1804.Amd64.Open console.log runclient.py
331467 runtime PR 88508 mono windows x64 Release @ Windows.10.Amd64.Open console.log runclient.py
331467 runtime PR 88508 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331467 runtime PR 88508 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331430 runtime PR 88503 mono linux arm64 Release @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8 console.log runclient.py
331430 runtime PR 88503 mono windows x64 Release @ Windows.10.Amd64.Open console.log runclient.py
331430 runtime PR 88503 mono linux x64 Release @ Ubuntu.1804.Amd64.Open console.log runclient.py
331430 runtime PR 88503 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331430 runtime PR 88503 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331425 runtime PR 88502 mono linux arm64 Release @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8 console.log runclient.py
331425 runtime PR 88502 mono windows x64 Release @ Windows.10.Amd64.Open console.log runclient.py
331425 runtime PR 88502 mono linux x64 Release @ Ubuntu.1804.Amd64.Open console.log runclient.py
331425 runtime PR 88502 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331425 runtime PR 88502 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331294 runtime PR 88498 mono linux arm64 Release @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8 console.log runclient.py
331294 runtime PR 88498 mono linux x64 Release @ Ubuntu.1804.Amd64.Open console.log runclient.py
331294 runtime PR 88498 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331294 runtime PR 88498 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331203 runtime PR 86875 mono linux arm64 Release @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8 console.log runclient.py
331203 runtime PR 86875 mono windows x64 Release @ Windows.10.Amd64.Open console.log runclient.py
331203 runtime PR 86875 mono linux x64 Release @ Ubuntu.1804.Amd64.Open console.log runclient.py
331203 runtime PR 86875 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331203 runtime PR 86875 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331166 runtime PR 87562 mono linux arm64 Release @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8 console.log runclient.py
331166 runtime PR 87562 Mono browser wasm Release @ (Ubuntu.1804.Amd64)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-webassembly console.log runclient.py
331166 runtime PR 87562 mono linux x64 Release @ Ubuntu.1804.Amd64.Open console.log runclient.py
331166 runtime PR 87562 mono windows x64 Release @ Windows.10.Amd64.Open console.log runclient.py
331166 runtime PR 87562 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331166 runtime PR 87562 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331160 runtime PR 87857 mono linux arm64 Release @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8 console.log runclient.py
331160 runtime PR 87857 mono windows x64 Release @ Windows.10.Amd64.Open console.log runclient.py
331160 runtime PR 87857 mono linux x64 Release @ Ubuntu.1804.Amd64.Open console.log runclient.py
331160 runtime PR 87857 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331160 runtime PR 87857 mono osx x64 Release @ OSX.1200.Amd64.Open console.log runclient.py
331159 runtime Rolling mono linux arm64 Release @ (Ubuntu.1804.Arm64.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8 console.log runclient.py
331159 runtime Rolling Mono browser wasm Release @ (Ubuntu.1804.Amd64)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-webassembly console.log runclient.py
331159 runtime Rolling mono windows x64 Release @ Windows.10.Amd64.Open console.log runclient.py
331159 runtime Rolling mono linux x64 Release @ Ubuntu.1804.Amd64.Open console.log runclient.py

Displaying 100 of 381 results

Build Result Summary

Day Hit Count Week Hit Count Month Hit Count
23 61 128

Activity

  1. agocke
    added
    area-Infrastructure
    on Apr 18, 2022
  3. ghost added
    untriagedNew issue has not been triaged by the area owner
    on Apr 18, 2022
  4. agocke
    added this to the 7.0.0 milestone on Apr 18, 2022
  5. agocke
    removed
    untriagedNew issue has not been triaged by the area owner
    on Apr 18, 2022

  6. agocke commented on Apr 18, 2022

    @agocke
    agocke
    on Apr 18, 2022
    MemberAuthor

    cc @MattGal @ChadNedzlek

  7. ChadNedzlek commented on Apr 18, 2022

    @ChadNedzlek
    ChadNedzlek
    on Apr 18, 2022
    Contributor

    Updated the 1600 -> 100 (the 1600 was from a bad query I made). 100 is still a lot per day though.

  8. MattGal commented on Apr 18, 2022

    @MattGal
    MattGal
    on Apr 18, 2022
    Member

    I'm just following along for now; please ping me if you want me to participate in any investigations or check whether improvements work (though if the work items start passing, that's a very good sign)

  9. agocke
    added this to Runtime Infraon Jul 1, 2022
  10. jtschuster
    added
    blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
    on Jul 15, 2022
  11. danmoseley
    added
    area-Infrastructure-coreclrOnly use for closed issues
    and removed
    area-Infrastructure
    on Jul 26, 2022
  13. jeffschwMSFT
    removed
    blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
    on Aug 1, 2022

  14. hoyosjs commented on Aug 5, 2022

    @hoyosjs
    hoyosjs
    on Aug 5, 2022
    Member

    @agocke Is it a good idea to have a tracking issue of such a wide issue with runfo? (aka, if the common coreclr tests fails fails, immediately add it here)

  15. hoyosjs
    modified the milestones: 7.0.0, 8.0.0 on Aug 10, 2022

  16. agocke commented on Jul 10, 2023

    @agocke
    agocke
    on Jul 10, 2023
    MemberAuthor

    I think this is no longer interesting -- we're tracking things at a more granular level now and this is just catching everything in coreclr Pri0. Closing.

  17. agocke
    closed this as completedon Jul 10, 2023
  18. github-project-automation
    moved this to Done in Runtime Infraon Jul 10, 2023
  19. ghost locked as resolved and limited conversation to collaborators on Aug 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area-Infrastructure-coreclrOnly use for closed issues

    Type

    No type

    Projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions