custom stopping criteria for tests about qcheck HOT 1 OPEN

Here's a couple of half-baked ideas to achieve something like that:

• By raising a suitable exception upon meeting the criteria and wrapping a try-catch of around Test.check_* to catch the test error
• By expressing the criteria as a precondition with assume (or ==> - but beware it evaluates both sides eagerly in CBV OCaml). This approach will have the drawback of repeatedly trying to satisfy the criteria before finally giving up.

Interface-wise, rather than an impure function unit -> bool I suppose one could also extend QCheck with a dedicated exception Stop_criteria_met and a handler and message for that particular exception in the test driver loop. That should be mostly free for QCheck users who don't use the feature.

From 10.000 ft, If I'm interested in maximizing coverage, rather than extending a blackbox PBT framework, I would probably recommend a "graybox" PBT framework such as Crowbar: https://github.com/stedolan/crowbar. It has a similar QuickCheck-like interface, but underneath the hood the AFL fuzz engine takes coverage into account when generating input test data.
As such, I would prefer to better understand a concrete QCheck use case first 🤔

from qcheck.