Test sequence random ordering about knapsack HOT 8 CLOSED

@aabrook Thanks for the nice idea. I think randomize test ordering on each node sounds doable. Randomize them across nodes might be more problematic because we want to run specific tests on the particular node.

from knapsack.

I can definitely appreciate the difficulty across nodes just due to ensuring that execution times are uniform. Maybe a stretch goal where test balancing can be within a time frame to jumble. I suspect only possible in the pro version to track what's going on between nodes.

from knapsack.

Are you using the pro version https://github.com/KnapsackPro/knapsack_pro-ruby so you could try testing cross node randomization?

from knapsack.

Currently using just this version. Reviewed the pro but, due to the lack of https, we chose to continue with this version.

from knapsack.

I added https to pro version recently. Feel free to try it.

from knapsack.

@aabrook BTW currently you can randomize your rspec tests by adding in .rspec file the line

--order rand

Thanks to that you would have randomize tests per node. Rspec will randomize them no matter the order of given test files.

from knapsack.

Here is example how to pass argument to knapsack command:

$ bundle exec rake "knapsack:rspec[--order rand]"

another way is to set order in spec_helper.rb:

# spec/spec_helper.rb
RSpec.configure do |config|
  # Run specs in random order to surface order dependencies. If you find an
  # order dependency and want to debug it, you can fix the order by providing
  # the seed, which is printed after each run.
  #     --seed 1234
  config.order = :random
end

from knapsack.

Great thank you

from knapsack.