Strange results number (always 0 successful, additional 2 errors) about cats HOT 2 CLOSED

Hi @qarmin. There is indeed a small issue, due to the fact the CheckDeletedResourcesNotAvailable fails due a path parsing issue (which will be fixed in the next release), but I also would like to clarify how those 2 arguments are working:

• -b or --blackbox means that CATS will ignore all errors reported by its fuzzers as long as the response code received is 2xx and 4xx (and soon also 501). Which means that errors are reported for 5xx. If you run just with -b but without -k you will all tests being reported
• -k or --skipReportingForIgnoredCodes will skip reporting for any http response code supplied by -b or through the dedicated --ignoreResponseCodes argument. Which means that there won't be any reporting done for those skipped codes, and only report if there are any errors.

So if you run with both -b and -k CATS will ignore all non-5xx responses and won't do any reporting unless your service will actually return a 500 for example.

from cats.

I'll close this for now. Please let me know @qarmin if something is not clear.

from cats.