AimetTensorQuantizer error about aimet HOT 5 OPEN

@quic-akhobare, could you help answer this?

from aimet.

Hi @zkdfbb - This problem happens due to the mismatch in pybind, libpython versions from what I remember. To give you a clue of how this was resolved before.

What version of PyTorch are you compiling against?

from aimet.

Hi @zkdfbb - This problem happens due to the mismatch in pybind, libpython versions from what I remember. To give you a clue of how this was resolved before.

What version of PyTorch are you compiling against?

Hi@quic-akhobare , the pytorch version is 2.0.0, based on https://docs.nvidia.com/deeplearning/frameworks/pytorch-release-notes/rel-23-05.html

from aimet.

Hi @zkdfbb - This problem happens due to the mismatch in pybind, libpython versions from what I remember. To give you a clue of how this was resolved before.
What version of PyTorch are you compiling against?

Hi@quic-akhobare , the pytorch version is 2.0.0, based on https://docs.nvidia.com/deeplearning/frameworks/pytorch-release-notes/rel-23-05.html

Apologies for the late response. We have not yet tested AIMET against PyTorch 2.0 - so kinda hard to guide you specifically. But I believe this likely boils down to a version mismatch in pybind or libpython..

Possible for you to use PyTorch 1.13 for the short-term because we know that works against AIMET? The AIMET team should start looking at adding/testing support for PyTorch 2.0 but I don't have a firm ETA yet.

from aimet.

Hi @zkdfbb - This problem happens due to the mismatch in pybind, libpython versions from what I remember. To give you a clue of how this was resolved before.
What version of PyTorch are you compiling against?

Hi@quic-akhobare , the pytorch version is 2.0.0, based on https://docs.nvidia.com/deeplearning/frameworks/pytorch-release-notes/rel-23-05.html

Apologies for the late response. We have not yet tested AIMET against PyTorch 2.0 - so kinda hard to guide you specifically. But I believe this likely boils down to a version mismatch in pybind or libpython..

Possible for you to use PyTorch 1.13 for the short-term because we know that works against AIMET? The AIMET team should start looking at adding/testing support for PyTorch 2.0 but I don't have a firm ETA yet.

Thanks for your advise, I will try and waiting for your testing result.

from aimet.