Description
Long running tests:
- CancelPendingTask -
ReadAsync_CancelPendingTask_ThrowsCancellationException(disabled in PR Disable long running ReadAsync_CancelPendingTask_ThrowsCancellationException tests for some Http1 cases #72596 on 7/21)System.Net.Http.Functional.Tests.Http1CloseResponseStreamConformanceTests.ReadAsync_CancelPendingTask_ThrowsCancellationException- Http1CloseResponseStreamConformanceTestsSystem.Net.Http.Functional.Tests.Http1RawResponseStreamConformanceTests.ReadAsync_CancelPendingTask_ThrowsCancellationException- Http1RawResponseStreamConformanceTests
- CancelPendingValueTask -
ReadAsync_CancelPendingValueTask_ThrowsCancellationException(disabled in PR Disable ReadAsync_CancelPendingValueTask_ThrowsCancellationException for Http1 #72854 on 7/27)System.Net.Http.Functional.Tests.Http1RawResponseStreamConformanceTests.ReadAsync_CancelPendingValueTask_ThrowsCancellationException- Http1RawResponseStreamConformanceTestsSystem.Net.Http.Functional.Tests.Http1CloseResponseStreamConformanceTests.ReadAsync_CancelPendingValueTask_ThrowsCancellationException- Http1CloseResponseStreamConformanceTests
Regression on 7/20
Failures 6/30-8/5:
| Date | Runs |
|---|---|
| 8/5 | 1x PR occurrence - likely older source code |
| 8/4 | 1x PR occurrence - likely older source code |
| 8/3 | 1x PR occurrence - likely older source code |
| 7/27 | 24x (1x in Official runs) |
| 7/26 | 29x (2x in Official runs) |
| 7/25 | 12x (2x in Official runs) |
| 7/24 | 8x (3x in Official runs) |
| 7/23 | 5x (1x in Official runs) |
| 7/22 | 20x (0x in Official runs) |
| 7/21 | 61x (5x in Official runs) |
| 7/20 | 35x (7x in Official runs) |
Given the high frequency, we should disable the test ASAP.
let timeouts = (includePR : bool) {
cluster('engsrvprod.kusto.windows.net').database('engineeringdata').WorkItems
| where Status == "Timeout"
| where FriendlyName startswith "System.Net.Http.Functional.Tests"
//| where Finished > datetime('2021-09-07')
| distinct JobId, WorkItemId, Name, FriendlyName, ConsoleUri
| join kind=inner (cluster('engsrvprod.kusto.windows.net').database('engineeringdata').Jobs
| where ((Branch == 'refs/heads/main') or (Branch == 'refs/heads/master') or (includePR and (Source startswith "pr/")) or (Branch startswith 'refs/heads/release/6.0'))
| where Type startswith "test/functional/cli/"
and not(Properties contains "runtime-staging")
| summarize arg_max(Finished, Properties, Type, Branch, Source, Started, QueueName) by JobId
| project-rename JobType = Type) on JobId
| order by Finished desc
};
timeouts(true);Original report
Couldn't add runfo information since the work item has the same name as previously fixed issues. But this timeout behavior has occurred in the following rolling build runs:
https://dev.azure.com/dnceng/public/_build/results?buildId=1893373&view=results
https://dev.azure.com/dnceng/public/_build/results?buildId=1893617&view=results
https://dev.azure.com/dnceng/public/_build/results?buildId=1893157&view=results
https://dev.azure.com/dnceng/public/_build/results?buildId=1893763&view=results
The timeout occurs when executing the long-running test System.Net.Http.Functional.Tests.Http1RawResponseStreamConformanceTests.ReadAsync_CancelPendingTask_ThrowsCancellationException
These timeout are occurring on both runtime and runtime-extra-platforms
Related to #72209
{
"ErrorMessage": "[Long Running Test] 'System.Net.Http.Functional.Tests.Http1RawResponseStreamConformanceTests.ReadAsync_CancelPending",
"BuildRetry": false
}Report
Summary
| 24-Hour Hit Count | 7-Day Hit Count | 1-Month Count |
|---|---|---|
| 3 | 18 | 33 |