Skip to content

dotnet-watch tests failing #40006

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
dsplaisted opened this issue Apr 4, 2024 · 12 comments
Open

dotnet-watch tests failing #40006

dsplaisted opened this issue Apr 4, 2024 · 12 comments

Comments

@dsplaisted
Copy link
Member

dsplaisted commented Apr 4, 2024

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=629827
Build error leg or test failing: dotnet-watch.Tests.dll.1.WorkItemExecution
Pull request: #39888

Error Message

##[error].packages/microsoft.dotnet.helix.sdk/8.0.0-beta.24177.1/tools/Microsoft.DotNet.Helix.Sdk.MultiQueue.targets(89,5): error : (NETCORE_ENGINEERING_TELEMETRY=Test) Work item dotnet-watch.Tests.dll.1 in job 82728a56-9430-4356-ab82-1c21670792a7 has failed

{
  "ErrorMessage": "",
  "ErrorPattern": "Work item dotnet-watch\\.Tests\\.dll\\.1 in job [a-z0-9\\-]+ has failed",
  "BuildRetry": true,
  "ExcludeConsoleLog": true
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=629827
Error message validated: [Work item dotnet-watch\.Tests\.dll\.1 in job [a-z0-9\-]+ has failed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/4/2024 9:51:10 AM UTC

Report

Build Definition Step Name Console log Pull Request
1049413 dotnet/sdk 🟣 Run ContainerBased Tests Log #49124
1049342 dotnet/sdk 🟣 Run TestBuild Tests Log #48910
1049317 dotnet/sdk 🟣 Run ContainerBased Tests Log #48910
1048504 dotnet/sdk 🟣 Run ContainerBased Tests Log #48910
2714659 dotnet-sdk Run FullFramework Tests Log #50200
2714660 dotnet-sdk Run FullFramework Tests Log #50201
1048044 dotnet/sdk Run TestBuild Tests Log #49097
1047665 dotnet/sdk 🟣 Run TestBuild Tests Log #49055
1047515 dotnet/sdk 🟣 Run TestBuild Tests Log #49086
1047375 dotnet/sdk 🟣 Run ContainerBased Tests Log #48910
1047138 dotnet/sdk 🟣 Run TestBuild Tests Log #49079
1047333 dotnet/sdk 🟣 Run ContainerBased Tests Log #48910
1047254 dotnet/sdk 🟣 Run ContainerBased Tests Log #48910
1047203 dotnet/sdk 🟣 Run ContainerBased Tests Log #48910
1047112 dotnet/sdk 🟣 Run ContainerBased Tests Log #48910
2713321 dotnet-sdk Run FullFramework Tests Log #50200
2713322 dotnet-sdk Run FullFramework Tests Log #50201
1045987 dotnet/sdk 🟣 Run ContainerBased Tests Log #48910
1045951 dotnet/sdk 🟣 Run ContainerBased Tests Log #48910
2712819 dotnet-sdk Run FullFramework Tests Log #50200
2712820 dotnet-sdk Run FullFramework Tests Log #50201
1045311 dotnet/sdk Run TestBuild Tests Log #49059
1045302 dotnet/sdk Run TestBuild Tests Log #48956
1045296 dotnet/sdk Run TestBuild Tests Log #49057
1044972 dotnet/sdk 🟣 Run ContainerBased Tests Log #48910
1044734 dotnet/sdk Run TestBuild Tests Log #48964
1044931 dotnet/sdk 🟣 Run ContainerBased Tests Log #48910
1044918 dotnet/sdk Run TestBuild Tests Log #49047
2711793 dotnet-sdk Run TestBuild Tests Log #50177
2711792 dotnet-sdk Run TestBuild Tests Log #50176
2711714 dotnet-sdk Run FullFramework Tests Log #50177
2711716 dotnet-sdk Run TestBuild Tests Log #50176
2711332 dotnet-sdk Run FullFramework Tests Log #50169
2711331 dotnet-sdk Run FullFramework Tests Log #50167
2710972 dotnet-sdk Run TestBuild Tests Log #49770
2710971 dotnet-sdk Run TestBuild Tests Log #50127
2710822 dotnet-sdk Run FullFramework Tests Log #50127
2710771 dotnet-sdk Run FullFramework Tests Log #49770
1043560 dotnet/sdk Run FullFramework Tests Log #49012
1043554 dotnet/sdk Run TestBuild Tests Log #48919
1043298 dotnet/sdk Run FullFramework Tests Log #49001
1043238 dotnet/sdk Run TestBuild Tests Log #48977
1042570 dotnet/sdk 🟣 Run TestBuild Tests Log #48982
1042686 dotnet/sdk Run TestBuild Tests Log #48984
1042252 dotnet/sdk Run TestBuild Tests Log #48977
1041088 dotnet/sdk Run TestBuild Tests Log #48925
1041013 dotnet/sdk Run TestBuild Tests Log #48935
1040634 dotnet/sdk 🟣 Run TestBuild Tests Log #48909
2707961 dotnet-sdk Run FullFramework Tests Log #49771
2707868 dotnet-sdk Run TestBuild Tests Log #49771
1039826 dotnet/sdk Run TestBuild Tests Log #48907
1039353 dotnet/sdk 🟣 Run ContainerBased Tests Log #48887
1037623 dotnet/sdk Run TestBuild Tests Log #48883
2705215 dotnet-sdk Run FullFramework Tests Log #49771
2705076 dotnet-sdk Run TestBuild Tests Log #49771
1036710 dotnet/sdk Run TestBuild Tests Log #48737
1036717 dotnet/sdk Run TestBuild Tests Log #48858
1036711 dotnet/sdk Run TestBuild Tests Log #48751
1036716 dotnet/sdk Run TestBuild Tests Log #48859
1035705 dotnet/sdk Run TestBuild Tests Log #48696
2704494 dotnet-sdk Run FullFramework Tests Log #49771
1035704 dotnet/sdk Run TestBuild Tests Log #48697
2703565 dotnet-sdk Run FullFramework Tests Log #49771
1035212 dotnet/sdk Run FullFramework Tests Log #48832
1035154 dotnet/sdk 🟣 Run TestBuild Tests Log #48609
1034753 dotnet/sdk Run TestBuild Tests Log #48696
1034754 dotnet/sdk Run TestBuild Tests Log #48697
2702675 dotnet-sdk Run FullFramework Tests Log #49771
1033821 dotnet/sdk Run TestBuild Tests Log #48697
1033729 dotnet/sdk 🟣 Run TestBuild Tests Log #48813
2698630 dotnet-sdk Run TestBuild Tests Log #49424
1029908 dotnet/sdk Run TestBuild Tests Log #48773
2697900 dotnet-sdk Run FullFramework Tests Log #49424
1027611 dotnet/sdk Run FullFramework Tests Log #48736
1027246 dotnet/sdk Run TestBuild Tests Log #48735
1027155 dotnet/sdk Run TestBuild Tests Log #48731
1027076 dotnet/sdk 🟣 Run TestBuild Tests Log #48690
2694051 dotnet-sdk Run FullFramework Tests Log #49424

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
4 40 78
@marcpopMSFT
Copy link
Member

@tmat
Copy link
Member

tmat commented Jun 26, 2024

No luck yet. This might help: https://github.com/dotnet/sdk/blob/d45e40d665e647804de03d2b4eec2aae9c488cb5/test/dotnet-watch.Tests/xunit.runner.json

It will print out test info every 20 seconds a test is running.

@marcpopMSFT
Copy link
Member

@tmat another failure this morning shows a bunch of build processes for watch apps still running... https://helixre107v0xd1eu3ibi6ka.blob.core.windows.net/dotnet-sdk-refs-pull-41958-merge-84357342ee154a5088/dotnet-watch.Tests.dll.2/1/console.3dddc463.log?helixlogtype=result

@tmat
Copy link
Member

tmat commented Jul 3, 2024

Looks like that's in 8.0 branch. Porting test diagnostics from 9: #41963

@Forgind
Copy link
Contributor

Forgind commented Aug 26, 2024

This has been making one of my PRs fail today, so I looked into it a bit. Based on when this issue was created and which tests are failing, I suspect this PR:
#39618

I asked jasonmalinowski whether the MSBuildWorkspace is supposed to support F# because I'd found a code snippet that suggested that it shouldn't, and he said it doesn't and never did. Did that PR make us use MSBuildWorkspace in a different way than we had before?

@Forgind
Copy link
Contributor

Forgind commented Aug 26, 2024

The changes to HotReloadDotNetWatcher look most suspicious to me. It looks like a substantial change to how we call MSBuild.

@Forgind
Copy link
Contributor

Forgind commented Jan 18, 2025

Ping @tmat
This is still a serious pain point, currently preventing MSBuild from merging their code flow to 9.0.2xx. I already clicked rerun twice. I pointed to a PR that I think is likely to blame.

@tmat
Copy link
Member

tmat commented Jan 19, 2025

Fixes targeting 9.0.3xx: #45999, #46141

@nagilson
Copy link
Member

@tmat Thank you for making some PRs to try to remedy this -- we are still seeing this in 9.0.2xx, 9.0.1xx, and main, 10 preview 2. Do your changes need to be ported?

@tmat
Copy link
Member

tmat commented Feb 20, 2025

They don't flow automatically to main?

Re 9.0.2xx, 9.0.1xx - these are product changes. Do they meet the servicing bar?

@nagilson
Copy link
Member

nagilson commented Feb 20, 2025

They should flow to main, but either something went wrong and it didn't for those PRs, or the fix did not work, since it is still showing up in .net 10 preview 2: #46983

I dont think they would meet the bar that, so good point. 9.0.3xx though, they probably do.

@tmat
Copy link
Member

tmat commented Feb 21, 2025

Might be something else causing failure in 10 P2. Do you have a link to the failed run? The PR is merged.

@dotnet-policy-service dotnet-policy-service bot removed the untriaged Request triage from a team member label Apr 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants