Closed
Description
Describe the bug
Most (10 of 12) gRPC tests started failing in https://dev.azure.com/dnceng/public/_build/results?buildId=769894, the validation build for a dependency update from dotnet/runtime and dotnet/efcore (#24876). Skipping all tests in that PR. They will need to be investigated and re-enabled.
Note this is likely a product issue and not just a test problem.
To Reproduce
Re-enable one of the tests mentioning this bug. Watch it fail.
Exceptions (if any)
For example…
[xUnit.net 00:00:09.39] Client process output:
[xUnit.net 00:00:09.39] ======================================
[xUnit.net 00:00:09.39] Application started.
[xUnit.net 00:00:09.39] NetCoreAppVersion: 5.0.0-rc.1.20412.8+0db8ecbea291c09cfd84d7f33ea049f5c0cec94f
[xUnit.net 00:00:09.39] Use TLS: False
[xUnit.net 00:00:09.39] Use Test CA: False
[xUnit.net 00:00:09.39] Client type: httpclient
[xUnit.net 00:00:09.39] Server host: localhost
[xUnit.net 00:00:09.39] Server port: 38719
[xUnit.net 00:00:09.39] running special_status_message
[xUnit.net 00:00:09.39] �[40m�[37mdbug�[39m�[22m�[49m: Grpc.Net.Client.Internal.GrpcCall[1]
[xUnit.net 00:00:09.39] => GrpcMethodType:Unary GrpcUri:/grpc.testing.TestService/UnaryCall
[xUnit.net 00:00:09.39] Starting gRPC call. Method type: 'Unary', URI: 'http://localhost:38719/grpc.testing.TestService/UnaryCall'.
[xUnit.net 00:00:09.39] �[40m�[37mdbug�[39m�[22m�[49m: Grpc.Net.Client.Internal.GrpcCall[18]
[xUnit.net 00:00:09.39] => GrpcMethodType:Unary GrpcUri:/grpc.testing.TestService/UnaryCall
[xUnit.net 00:00:09.39] Sending message.
[xUnit.net 00:00:09.39] �[40m�[37mtrce�[39m�[22m�[49m: Grpc.Net.Client.Internal.GrpcCall[21]
[xUnit.net 00:00:09.39] => GrpcMethodType:Unary GrpcUri:/grpc.testing.TestService/UnaryCall
[xUnit.net 00:00:09.39] Serialized 'Grpc.Testing.SimpleRequest' to 68 byte message.
[xUnit.net 00:00:09.39] �[40m�[37mtrce�[39m�[22m�[49m: Grpc.Net.Client.Internal.GrpcCall[19]
[xUnit.net 00:00:09.39] => GrpcMethodType:Unary GrpcUri:/grpc.testing.TestService/UnaryCall
[xUnit.net 00:00:09.39] Message sent.
[xUnit.net 00:00:09.39] �[41m�[30mfail�[39m�[22m�[49m: Grpc.Net.Client.Internal.GrpcCall[6]
[xUnit.net 00:00:09.39] => GrpcMethodType:Unary GrpcUri:/grpc.testing.TestService/UnaryCall
[xUnit.net 00:00:09.39] Error starting gRPC call.
[xUnit.net 00:00:09.39] System.Net.Http.HttpRequestException: An error occurred while sending the request.
[xUnit.net 00:00:09.39] ---> System.IO.IOException: The response ended prematurely.
[xUnit.net 00:00:09.39] at System.Net.Http.HttpConnection.FillAsync(Boolean async)
[xUnit.net 00:00:09.39] at System.Net.Http.HttpConnection.ReadNextResponseHeaderLineAsync(Boolean async, Boolean foldedHeadersAllowed)
[xUnit.net 00:00:09.39] at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
[xUnit.net 00:00:09.39] --- End of inner exception stack trace ---
[xUnit.net 00:00:09.39] at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
[xUnit.net 00:00:09.39] at System.Net.Http.HttpConnectionPool.SendWithRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
[xUnit.net 00:00:09.39] at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
[xUnit.net 00:00:09.39] at System.Net.Http.DiagnosticsHandler.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
[xUnit.net 00:00:09.39] at System.Net.Http.HttpClient.FinishSendAsync(ValueTask`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts, Boolean buffered, Boolean async, CancellationToken callerToken, Int64 timeoutTime)
[xUnit.net 00:00:09.39] at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request)
[xUnit.net 00:00:09.39] �[40m�[37mdbug�[39m�[22m�[49m: Grpc.Net.Client.Internal.GrpcCall[8]
[xUnit.net 00:00:09.39] => GrpcMethodType:Unary GrpcUri:/grpc.testing.TestService/UnaryCall
[xUnit.net 00:00:09.39] gRPC call canceled.
[xUnit.net 00:00:09.39] �[41m�[30mfail�[39m�[22m�[49m: Grpc.Net.Client.Internal.GrpcCall[3]
[xUnit.net 00:00:09.39] => GrpcMethodType:Unary GrpcUri:/grpc.testing.TestService/UnaryCall
[xUnit.net 00:00:09.39] Call failed with gRPC error status. Status code: 'Internal', Message: 'Error starting gRPC call: An error occurred while sending the request.'.
[xUnit.net 00:00:09.39] �[40m�[37mdbug�[39m�[22m�[49m: Grpc.Net.Client.Internal.GrpcCall[4]
[xUnit.net 00:00:09.39] => GrpcMethodType:Unary GrpcUri:/grpc.testing.TestService/UnaryCall
[xUnit.net 00:00:09.39] Finished gRPC call.
[xUnit.net 00:00:09.39] ERROR: Unhandled exception. System.InvalidOperationException: Expected Unknown but got Internal.
[xUnit.net 00:00:09.39] ERROR: at InteropTestsClient.Assert.AreEqual(Object expected, Object actual) in F:\workspace\_work\1\s\src\Grpc\test\testassets\InteropClient\Assert.cs:line 47
[xUnit.net 00:00:09.39] ERROR: at InteropTestsClient.InteropClient.RunSpecialStatusMessageAsync(TestServiceClient client) in F:\workspace\_work\1\s\src\Grpc\test\testassets\InteropClient\InteropClient.cs:line 676
[xUnit.net 00:00:09.39] ERROR: at InteropTestsClient.InteropClient.RunTestCaseAsync(IChannelWrapper channel, ClientOptions options) in F:\workspace\_work\1\s\src\Grpc\test\testassets\InteropClient\InteropClient.cs:line 267
[xUnit.net 00:00:09.39] ERROR: at InteropTestsClient.InteropClient.Run() in F:\workspace\_work\1\s\src\Grpc\test\testassets\InteropClient\InteropClient.cs:line 139
[xUnit.net 00:00:09.39] ERROR: at InteropTestsClient.InteropClient.<>c.<Run>b__7_1(ClientOptions options) in F:\workspace\_work\1\s\src\Grpc\test\testassets\InteropClient\InteropClient.cs:line 131
[xUnit.net 00:00:09.39] ERROR: at CommandLine.ParserResultExtensions.WithParsed[T](ParserResult`1 result, Action`1 action)
[xUnit.net 00:00:09.39] ERROR: at InteropTestsClient.InteropClient.Run(String[] args) in F:\workspace\_work\1\s\src\Grpc\test\testassets\InteropClient\InteropClient.cs:line 119
[xUnit.net 00:00:09.39] ERROR: at InteropTestsClient.Program.Main(String[] args) in F:\workspace\_work\1\s\src\Grpc\test\testassets\InteropClient\Program.cs:line 33
Further technical details
See @JamesNK's comments: #24876 (comment)