Torch not compiled with CUDA enabled about tooncrafter HOT 6 OPEN

I encountered the same bug while reinstalling xformers, which consistently conflicted with torch, torchaudio, and torchvision. To resolve this, I used the following command:

pip install xformers==0.0.22.post2 --index-url https://download.pytorch.org/whl/cu118

I also reinstalled torch, torchaudio, and torchvision, or they might have been installed during the xformers installation. I can't recall precisely. For reference, here is the final combination that worked for me (though it still has errors while generating videos, but at least it runs):

• torch: 2.1.0+cu118i
• torchaudio: 2.0.2+cu118
• torchvision: 0.15.2+cu118
• xformers: 0.0.22.post2+cu118

from tooncrafter.

I dont know why but xformers dont work for me, so i kill it, and i see the ToonCrafter decode uses xformers and thats why i prefer to use the implementation for comfy ui.
https://github.com/kijai/ComfyUI-DynamiCrafterWrapper

#28

from tooncrafter.

You need to install the GPU version of pytorch. This is a common issue with pytorch, and reinstalling pytorch on the gpu instead of the cpu will likely resolve this specific issue.

Reading from https://pytorch.org/, you are on windows, so you can probably run (not tested):

python -m pip install torch=2.0.0 torchvision --index-url https://download.pytorch.org/whl/cu118

You might need to find the version for torchvision as well, I don't remember which version was compatible with torch==2.0.0 on python 3.8.

That being said, I think you'll have an easier time running the pipeline on linux (or wsl).

from tooncrafter.

I am trying on the same... but something doesn't add up for me.

this will give you the torch with cuda

pip install torch==2.0.0+cu117 torchvision==0.15.0+cu117 torchaudio==2.0.0+cu117 -f https://download.pytorch.org/whl/cu117/torch_stable.html

pip install transformers==4.25.1
AND
pip install -U xformers --index-url https://download.pytorch.org/whl/cu20

That completes the setup BUT every time I run the generate my PC freezes and I need to hard reboot.

I suspect 2 reasons, but can't confirm yet: Nvidia driver 555.85 and potentially Windows (because Triton, which is another GPU optimizer, that doesn't support Windows )

I will try on WSL.

from tooncrafter.

wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh && bash Miniconda3-latest-Linux-x86_64.sh

eval "$(/home/YOUR-USERNAME/miniconda3/bin/conda shell.bash hook)" && conda init && source ~/.bashrc

conda create -n tooncrafter python=3.8.5 && conda activate tooncrafter

sudo apt update && sudo apt install nvidia-cuda-toolkit

git clone https://github.com/ToonCrafter/ToonCrafter.git && cd ToonCrafter

pip install -r requirements.txt

python gradio_app.py

from tooncrafter.

Also ...
Keep in mind, I just saw - A100 is required with the default model...

#28

from tooncrafter.