ImportError: cannot import name 'neuron_xla_compile' from 'libneuronxla' about transformers-neuronx HOT 3 CLOSED

You need to update to torch-neuronx-1.13.1.1.10.0

from transformers-neuronx.

Thanks @yogendra-yatnalkar. @dacorvo is correct. For the latest transformers-neuronx 0.6 in release 2.13, please use release 2.13 torch-neuronx version 1.13.1.1.10.1. As mentioned in transformers-neuronx release notes, in transformers-neuronx 0.6 we added the Neuron Persistent Cache for compilation to automatically load pre-compiled model artifacts. We will update documentation to make it clearer.

from transformers-neuronx.

Hi @dacorvo thanks, this helped a lot. @jeffhataws understood, thanks for the explanation, adding this in documentation will surely help.

For future readers facing this, just adding some extra information:

I was using the Pytorch 1.11 (AL2) DLAMI earlier, but in that, I was never able to update the torch-neuronx to the required version.
When I switched to Pytorch 1.13 (AL2) DLAMI, I was easily able to update the drivers and things worked out of box.

from transformers-neuronx.