WebHostBuilder.ConfigureServices method not found when using nunit3testadapter 4.4.0

[iamzhaoxu]

Describe the bug
I try to update the WireMock.Net to 1.5.17 and the nunit3testadapter to 4.4.0 in the test project and I got an exception when starting the wiremock as below

System.MissingMethodException : Method not found: 'Microsoft.AspNetCore.Hosting.IWebHostBuilder Microsoft.AspNetCore.Hosting.IWebHostBuilder.ConfigureServices(System.Action1<Microsoft.Extensions.DependencyInjection.IServiceCollection>)'. StackTrace: at WireMock.Owin.AspNetCoreSelfHost.StartAsync() at WireMock.Server.WireMockServer..ctor(WireMockServerSettings settings) at WireMock.Server.WireMockServer.Start(Nullable1 port, Boolean ssl)
Error Message:
OneTimeSetUp: System.MissingMethodException : Method not found: 'Microsoft.AspNetCore.Hosting.IWebHostBuilder Microsoft.AspNetCore.Hosting.IWebHostBuilder.ConfigureServices(System.Action1<Microsoft.Extensions.DependencyInjection.IServiceCollection>)'. Stack Trace: Failed WhenGetArticles_GivenApiReturnTwoErrorResponses_ShouldRetry [54 ms] Error Message: OneTimeSetUp: System.MissingMethodException : Method not found: 'Microsoft.AspNetCore.Hosting.IWebHostBuilder Microsoft.AspNetCore.Hosting.IWebHostBuilder.ConfigureServices(System.Action1<Microsoft.Extensions.DependencyInjection.IServiceCollection>)'.
Stack Trace:
Failed WhenGetArticles_GivenQueryMoreThanBatchSize_ShouldReturnExpected [54 ms]
Error Message:
OneTimeSetUp: System.MissingMethodException : Method not found: 'Microsoft.AspNetCore.Hosting.IWebHostBuilder Microsoft.AspNetCore.Hosting.IWebHostBuilder.ConfigureServices(System.Action`1<Microsoft.Extensions.DependencyInjection.IServiceCollection>)'.
Stack Trace: ....

After I downgrade the nunit3testadapter 4.4.0 back to 4.3.1 then the same test worked again. I am not sure this is issue from WireMock and Nunit3TestAdpter and thereby I raised this issue in both projects.

I heard that WebHostBuilder was depreciated dotnet/aspnetcore#20964 before but I still can see the .NET 7 still try to support it from https://learn.microsoft.com/en-us/dotnet/api/microsoft.aspnetcore.hosting.webhostbuilder.-ctor?view=aspnetcore-7.0.

Expected behaviour:
I will expect the latest of WireMock.Net should work with the latest nunit3testadapter

Test to reproduce
1 Refence WireMock.Net 1.5.17 and nunit3testadapter 4.4.0 in the same test project

[Merlijnv]

We are having the same issue but not using WireMock

[OsirisTerje]

@iamzhaoxu Can you add a small repro project ?
@Merlijnv What are you actually using ?

[Merlijnv]

@OsirisTerje Packages Used:
coverlet.collector 3.2.0
FluentAssertions 6.10.0
Microsoft.AspNetCore.TestHost 6.0.14
Microsoft.NET.Test.Sdk 17.5.0
NUnit 3.13.3
NUnit3TestAdapter 4.3.1
Specflow.NUnit + SpecFlow.Tools.MsBuild.Generation + SpecFlow 3.9.74

[OsirisTerje]

@Merlijnv Ok, then can you also provide a small repro for your case?

[ghelyar]

It's not just this, we are getting method not found exceptions across many of our repos on many different methods.

System.MissingMethodException : Method not found: 'System.Text.Encodings.Web.JavaScriptEncoder System.Text.Json.JsonSerializerOptions.get_Encoder()'.

System.MissingMethodException : Method not found: 'Void System.Text.Json.JsonSerializerOptions.set_Encoder(System.Text.Encodings.Web.JavaScriptEncoder)'.

System.MissingMethodException : Method not found: 'Void Microsoft.AspNetCore.Diagnostics.HealthChecks.HealthCheckOptions.set_Predicate(System.Func`2<Microsoft.Extensions.Diagnostics.HealthChecks.HealthCheckRegistration,Boolean>)'.

etc, where the only change is NUnit3TestAdapter 4.3.1 being updated to 4.4.0

This certainly affects .NET 6.0 projects, and may also affect other target frameworks.

[OsirisTerje]

@ghelyar Understand, but please give us a small repro project. Our own test projects works. I don't doubt you all have found something, but we need a repro.

[ghelyar]

I'm working to get a simple repro now.

It looks like it may only happen on Linux, as I can repro in CI and in WSL but not on Windows so far.

It also looks like it might be something to do with tests for asp.net core projects and framework references to asp.net core (e.g. project under test has <FrameworkReference Include="Microsoft.AspNetCore.App" />), but I'm still checking.

[Merlijnv]

We are also referencing a asp.net project and running Linux pipeline in Azure Devops. Maybe @OsirisTerje could reproduce it that way?

[OsirisTerje]

I have added a repro project using Wiremock.net (sample from wiremock.net), see https://github.com/nunit/nunit3-vs-adapter.issues/tree/master/Issue1065/wiremocktests

This repro works, on my Windows machine.
It does not include the <FrameworkReference Include="Microsoft.AspNetCore.App" /> , and I have not tested it on Linux. So, the smallest repro that you see fail would be appreciated. Please also confirm it works on Windows, but on Linux (or none of these ofc.)

I am also using 4.4.0 on a work project with asp.net core and have no issues there.

Please also be aware that the adapter have no connections to asp.net core at all, so if it is affected by that, it has to be some sideffects of something.

I can confirm we have the same issues here as well, our error message is different though:

OneTimeSetUp: System.BadImageFormatException : Could not load file or assembly 'System.Transactions.Local, Version=6.0.0.0, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51'. Reference assemblies should not be loaded for execution.  They can only be loaded in the Reflection-only loader context. (0x80131058)
  ----> System.BadImageFormatException : Could not load file or assembly 'System.Transactions.Local, Version=6.0.0.0, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51, processorArchitecture=MSIL'. Reference assemblies should not be loaded for execution.  They can only be loaded in the Reflection-only loader context. (0x80131058)
  ----> System.BadImageFormatException : Cannot load a reference assembly for execution.

[OsirisTerje]

Checked the wiremock repro I have - on WSL, still works, so it is not Linux alone.

[OsirisTerje]

@martin-shields-sage Repro ? And, can you check this using the NUnit.Console ? Also, Windows or Linux?

I am using WSL (Ubuntu), just debugging through now to see why it is happening exactly

[ghelyar]

Here's a simple repro of one of the cases I have seen:
https://gist.github.com/ghelyar/2c85b4d264a586602fdd357c8723b193

replace underscores in the file names with slashes for the directory structure.

run dotnet test tests/tests.csproj from Linux (e.g. WSL) with .NET 6+ installed (tested with SDKs 6.0.406 and 7.0.201)

works with 4.3.1, fails with 4.4.0 on Linux

works with both 4.3.1 and 4.4.0 on Windows

It's also possible that rather than OS it's actually which SDKs are installed etc, but I have not been able to narrow that down yet.