PyTorch Hugging Face Models do not have ACL calls for Docker versions > 23.05 about tool-solutions HOT 3 OPEN

Hi @abhishek-rn
Thanks for the report. This transition from 23.05 to 23.06 marks the move from PyTorch 1.x to 2.x, so it looks like we may have lost some functionality at this stage.
Would you be able to confirm if the same behaviour is present if you use the pip installed pytorch packages for 1.3 and 2.0 on AArch64, and also on x86?

from tool-solutions.

Hi @nSircombe
The Docker tag read r23.05-torch-2.0.0-onednn-acl.
So, I thought that would mean torch-2.0.0.
However, I ran the pip installed pytorch 2.0.0 and 1.13 and PFB the logs:
ARM_PyT_1.13_Bert_Verbose.txt
ARM_PyT_2.0.0_Bert_Verbose.txt

And the results there show that PyT 1.13 has no ACL calls but PyT 2.0.0 has.

x86_PyT_1.13_Bert_Verbose.txt
x86_PyT_2.0.0_Bert_Verbose.txt

Also, x86 PyTorch do not have oneDNN calls for Matmuls as seen in the above logs

from tool-solutions.

Yes you're right, the version is 2.0. The tag is correct - matches the version in the Dockerfile. The mistake is in the README for the 23.05 increment here which still has 1.3.

from tool-solutions.