[💡 Feature]: [spec-reporter] Do not report a failed test as a failure if it passed on a subsequent retry about webdriverio HOT 3 OPEN

Thanks for reporting!

We greatly appreciate any contributions that help resolve the bug. While we understand that active contributors have their own priorities, we kindly request your assistance if you rely on this bug being fixed. We encourage you to take a look at our contribution guidelines or join our friendly Discord development server, where you can ask any questions you may have. Thank you for your support, and cheers!

from webdriverio.

Does anyone know if there is an existing bug which is the reason why retried tests are still being reported as "failures"? Based on this comment I wondered if the reporter is just not working as intended today: https://github.com/webdriverio/webdriverio/blob/main/packages/wdio-spec-reporter/src/index.ts#L301-L305

Generate a report that shows all tests except those that failed but passed on retry, and only display failed hooks.

from webdriverio.

@conkur there is some logic in the spec reporter where we try to group failures that have the same message, so this might be rather a bug where in this scenario this logic doesn't work.

from webdriverio.