[SQA] [Access-Control-Cluster] Facing issue while executing all ACL test case combinedly about matter-test-scripts HOT 8 OPEN

@Survensa We will fix this in upcoming PR.

from matter-test-scripts.

@Survensa fixed in PR 25712 please verify it and close the ticket.

from matter-test-scripts.

@manjunath-grl @kvikrambhat

Verified with latest released image(Version: v2.8-official Sha: 3a3e9b3).

Issue is not resolved. When all the semi-automated test case in Access-Control-cluster is executed using PICS below mentioned test case fails.

TC-ACL-2.4
TC-ACL-2.7
TC-ACL-2.8
TC-ACL-2.9
TC-ACL-2.10

Scenario 1:
Executing all semi-automated test-cases at same time :TC-ACL-2.4, TC-ACL-2.10 gets failed and TC-ACL-2.7 in UI got stuck.

Logs: ACL_All semi-automated.txt,
Report: ACL_All semi-automated.pdf,

Scenario 2:
Executing all other semi-automated test-cases except TC-ACL-2.7 at same time :TC-ACL-2.4, TC-ACL-2.10 gets failed and TC-ACL-2.8 in UI got stuck.

Logs: ACL_without 2.7.txt
Report: ACL_without 2.7.pdf

Scenario 3:
Executing all other test cases except TC-ACL-2.7 and TC-ACL-2.8 the above one : TC-ACL-2.10 and TC-ACL-2.9 are failed.

Logs: ACL_without 2.7 and 2.8.txt
Report: ACL_without 2.7 and 2.8.pdf

Note: TC-ACL-2.7, TC-ACL-2.8 and TC-ACL-2.10 gets failed even when the test case is executed individually or combined raised issue for the same
Issue link for TC-ACL-2.7 and TC-ACL-2.7: https://github.com/CHIP-Specifications/chip-certification-tool/issues/771
Issue link for TC-ACL-2.10: https://github.com/CHIP-Specifications/chip-certification-tool/issues/768

from matter-test-scripts.

@raul-marquez-csa did you get a chance to look into this ?

from matter-test-scripts.

Verified with latest released image(Version: TH Fall2023 Sha: 22538eb7).

Issue is not resolved. When all the semi-automated test case in Access-Control-cluster is executed using PICS below mentioned test case fails.

• TC-ACL-2.6
• TC-ACL-2.7
• TC-ACL-2.8

Logs: ACL_Semi-automated_2023_09_06_14_58_29.log
Report: ACL_SEMI-AUTOMATED.pdf

from matter-test-scripts.

Verified with latest released image(Version: TH Fall2023 Sha: 3f84bff5).

Issue is not resolved. When all the semi-automated test case in Access-Control-cluster is executed using PICS below mentioned test case fails.

• TC-ACL-2.7
• TC-ACL-2.8

Logs: ACL_all-semi-automated_2023_10_19_13_03_00.log
Report: ACL_ALL_SEMI-AUTOMATED.pdf
PICS XML file used: PICS for ACL.zip

from matter-test-scripts.

@raul-marquez-csa Can you take a look at this please ? Looks like I forgot to tag you after I moved it to the open-source repo

from matter-test-scripts.

@raju-apple raised an SDK issue, once it is fixed we will fix the script project-chip/connectedhomeip#30170

from matter-test-scripts.