You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
We are trying to reduce the time of our CI by splitting the execution between multiple runners.
Describe the solution you'd like
Similar to what we can do in Playwright, I think that implementing sharding in the dotnet test CLI would greatly benefit many projects. One possible API could be based on the previous example:
# The first runner could execute this, running the first fifth of the tests in MyTests.dll
dotnet test"MyTests.dll" --shard 1/5
# Run the second fifth of the tests in MyTests.dll
dotnet test"MyTests.dll" --shard 2/5
# ...
dotnet test"MyTests.dll" --shard 3/5
dotnet test"MyTests.dll" --shard 4/5
dotnet test"MyTests.dll" --shard 5/5
Additional context
We already tried these two solutions that does not completely satisfy us:
Work around the issue by splitting our tests in multiple projects
We can have multiple test projects and configure our CI to split the projects to run between multiple runners. This is not ideal as it forces an architecture upon us, multiplying the projects count for no other purpose than the tests execution.
Keep a single test project and split the tests to run manually
We also tried to implement our own "sharding" by:
Listing all of the tests with the dotnet test --list-tests command;
Split the result in shards in a bash script;
Have one CI runner per shard.
The return of the dotnet test --list-tests command forces us to manipulate it multiple times, removing the headers that cannot be muted and manage the parameterized tests that appears multiple times. Those manipulations are tedious and seem hacky, compared to a native solution provided by the SDK.
Is your feature request related to a problem? Please describe.
We are trying to reduce the time of our CI by splitting the execution between multiple runners.
Describe the solution you'd like
Similar to what we can do in Playwright, I think that implementing sharding in the
dotnet test
CLI would greatly benefit many projects. One possible API could be based on the previous example:Additional context
We already tried these two solutions that does not completely satisfy us:
Work around the issue by splitting our tests in multiple projects
We can have multiple test projects and configure our CI to split the projects to run between multiple runners. This is not ideal as it forces an architecture upon us, multiplying the projects count for no other purpose than the tests execution.
Keep a single test project and split the tests to run manually
We also tried to implement our own "sharding" by:
dotnet test --list-tests
command;The return of the
dotnet test --list-tests
command forces us to manipulate it multiple times, removing the headers that cannot be muted and manage the parameterized tests that appears multiple times. Those manipulations are tedious and seem hacky, compared to a native solution provided by the SDK.Opened by @ThomasFerroAgicap in dotnet/sdk#42986 (comment)
The text was updated successfully, but these errors were encountered: