Getting garbage generation with OPT-1.3B about transformers-neuronx HOT 4 CLOSED

[
    "</s>Hello, I am a  all I the,ly):,) A for\n in and) a,, A: and to: to to Ay,.\n on, To and in, A, ]\n.\n A\n,). A,,,*\n?..",
    "</s>When did the Queen die robot the�, by- A I in in, A of,\n. that to\n:,, is To to�, A is., is A A to A A A that A, A,:s,), the A: to to A\n can A,."
  ]

(aws_neuron_venv_pytorch) ubuntu@ip-10-0-10-149:~$ python opt.py 
/home/ubuntu/aws_neuron_venv_pytorch/lib/python3.8/site-packages/transformers_neuronx/opt/model.py:37: UserWarning: torch_dtype=torch.float32 ignored in favor of amp=f32
  warnings.warn(f'torch_dtype={config.torch_dtype} ignored in favor of amp={amp}')
..
Compiler status PASS
..
Compiler status PASS
..
Compiler status PASS
..
Compiler status PASS
..
Compiler status PASS
["</s>The quick brown fox jumps over the lazy dog.   I just can't stop laughing at the image of a fox jumping over a lazy dog...\nI don't see what's funny about it.  It's just a fox jumping over a lazy dog.</s>"]

['</s>The quick brown fox jumps over the lazy dog.\nThe lazy dog jumps over the quick brown fox.  FTFY</s>']

(aws_neuron_venv_pytorch) ubuntu@ip-10-0-10-149:~$ pip list | grep neuron
aws-neuronx-runtime-discovery 2.9
libneuronxla                  0.5.391
neuronx-cc                    2.8.0.25+a3ad0f342
neuronx-distributed           0.1.0
neuronx-hwm                   2.8.0.3+2b7c6da39
torch-neuronx                 1.13.1.1.9.0
torch-xla                     1.13.1+torchneuron8
transformers-neuronx          0.5.58