Potential test flakiness

[Evangelink]

azure-pipelines
/ microsoft.testfx (Build Linux Release)
test/Utilities/Microsoft.Testing.TestInfrastructure/DotnetCli.cs#L176

test/Utilities/Microsoft.Testing.TestInfrastructure/DotnetCli.cs(176,1): error : [DiscoverTests_ShowsWarningsForTestsThatFailedToDiscover ("net10.0")] [net11.0] Class Initialization method MSTest.Acceptance.IntegrationTests.TestDiscoveryWarningsTests.ClassInitialize threw exception. System.InvalidOperationException: Command 'dotnet build /mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass -c Release -p:MSBuildTreatWarningsAsErrors=true -p:TreatWarningsAsErrors=true -p:SuppressNETCoreSdkPreviewMessage=true -bl:"/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/TestDiscoveryWarningsBaseClass-118.binlog"' failed.

StandardOutput:
Telemetry is: Disabled
  Determining projects to restore...
  Restored /mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj (in 592 ms).
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018: The "GenerateDepsFile" task failed unexpectedly. [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018: System.IO.IOException: The process cannot access the file '/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/bin/Release/net10.0/TestDiscoveryWarningsBaseClass.deps.json' because it is being used by another process. [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at Microsoft.Win32.SafeHandles.SafeFileHandle.Init(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Int64& fileLength, UnixFileMode& filePermissions) [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func`4 createOpenException) [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode) [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at System.IO.File.Create(String path) [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at Microsoft.NET.Build.Tasks.GenerateDepsFile.WriteDepsFile(String depsFilePath) [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at Microsoft.NET.Build.Tasks.TaskBase.Execute() [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at Microsoft.Build.BackEnd.TaskExecutionHost.Execute() [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at Microsoft.Build.BackEnd.TaskBuilder.ExecuteInstantiatedTask(TaskExecutionHost taskExecutionHost, TaskLoggingContext taskLoggingContext, TaskHost taskHost, ItemBucket bucket, TaskExecutionMode howToExecuteTask) [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
Build FAILED.
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018: The "GenerateDepsFile" task failed unexpectedly. [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018: System.IO.IOException: The process cannot access the file '/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/bin/Release/net10.0/TestDiscoveryWarningsBaseClass.deps.json' because it is being used by another process. [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at Microsoft.Win32.SafeHandles.SafeFileHandle.Init(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Int64& fileLength, UnixFileMode& filePermissions) [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func`4 createOpenException) [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode) [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at System.IO.File.Create(String path) [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at Microsoft.NET.Build.Tasks.GenerateDepsFile.WriteDepsFile(String depsFilePath) [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at Microsoft.NET.Build.Tasks.TaskBase.Execute() [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at Microsoft.Build.BackEnd.TaskExecutionHost.Execute() [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
/mnt/vss/_work/1/s/.dotnet/sdk/11.0.100-preview.1.26104.118/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(308,5): error MSB4018:    at Microsoft.Build.BackEnd.TaskBuilder.ExecuteInstantiatedTask(TaskExecutionHost taskExecutionHost, TaskLoggingContext taskLoggingContext, TaskHost taskHost, ItemBucket bucket, TaskExecutionMode howToExecuteTask) [/mnt/vss/_work/1/s/artifacts/tmp/Release/testsuite/gzIt8/TestDiscoveryWarningsBaseClass/TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
    0 Warning(s)
    1 Error(s)
Time Elapsed 00:00:05.24
StandardError:

[MihuBot]

I'm a bot. Here are possible related and/or duplicate issues (I may be wrong):

• GenerateDepsFile: The process cannot access the file '...\MyProject.deps.json' because it is being used by another process. dotnet/sdk#2902
• GenerateDepsFile should not dump stack when failing to access a file in the build dotnet/sdk#14980

[Youssef1313]

Indeed, this particular test is flaky. There must be a race somewhere, and when it fails it's not always GenerateDepsFile. It fails at random different points of the build, but always with similar error about a file being used already.

[Evangelink]

Also happening on windows it seems:

azure-pipelines
/ microsoft.testfx (Build Windows Debug)
test/Utilities/Microsoft.Testing.TestInfrastructure/DotnetCli.cs#L176

test/Utilities/Microsoft.Testing.TestInfrastructure/DotnetCli.cs(176,1): error : [DiscoverTests_ShowsWarningsForTestsThatFailedToDiscover ("net10.0")] [net11.0] Class Initialization method MSTest.Acceptance.IntegrationTests.TestDiscoveryWarningsTests.ClassInitialize threw exception. System.InvalidOperationException: Command 'dotnet build D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\bkFK8\TestDiscoveryWarningsBaseClass -c Release -p:MSBuildTreatWarningsAsErrors=true -p:TreatWarningsAsErrors=true -p:SuppressNETCoreSdkPreviewMessage=true -bl:"D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\TestDiscoveryWarningsBaseClass-178.binlog"' failed.

StandardOutput:
Telemetry is: Disabled
  Determining projects to restore...
  Restored D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\bkFK8\TestDiscoveryWarningsBaseClass\TestDiscoveryWarningsBaseClass.csproj (in 280 ms).
  TestDiscoveryWarningsBaseClass -> D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\bkFK8\TestDiscoveryWarningsBaseClass\bin\Release\net462\TestDiscoveryWarningsBaseClass.dll
CSC : error CS2012: Cannot open 'D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\bkFK8\TestDiscoveryWarningsBaseClass\obj\Release\net10.0\TestDiscoveryWarningsBaseClass.dll' for writing -- The process cannot access the file 'D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\bkFK8\TestDiscoveryWarningsBaseClass\obj\Release\net10.0\TestDiscoveryWarningsBaseClass.dll' because it is being used by another process. [D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\bkFK8\TestDiscoveryWarningsBaseClass\TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
Build FAILED.
CSC : error CS2012: Cannot open 'D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\bkFK8\TestDiscoveryWarningsBaseClass\obj\Release\net10.0\TestDiscoveryWarningsBaseClass.dll' for writing -- The process cannot access the file 'D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\bkFK8\TestDiscoveryWarningsBaseClass\obj\Release\net10.0\TestDiscoveryWarningsBaseClass.dll' because it is being used by another process. [D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\bkFK8\TestDiscoveryWarningsBaseClass\TestDiscoveryWarningsBaseClass.csproj::TargetFramework=net10.0]
    0 Warning(s)
    1 Error(s)
Time Elapsed 00:00:13.89
StandardError: