Can't load StarCoder2-3B about starcoder2 HOT 4 CLOSED

Thank you! I have them installed globally but still get the same error. It works when I made new .venv and installed all requirements again.

from starcoder2.

Can you share screenshot of Error?

from starcoder2.

That's the whole thing.

from starcoder2.

#6
ImportError with bitsandbytes
This error indicates that your environment lacks the necessary accelerate and updated bitsandbytes packages required for 8-bit quantization in the Transformers library.

To fix this, you need to install or update these packages. Run the following commands in your terminal.

pip install -U accelerate
pip install -U -i https://pypi.org/simple/ bitsandbytes

This will install the latest versions of accelerate and bitsandbytes, ensuring compatibility with the 8-bit quantization feature used in your script.

This may solve problems.

from starcoder2.