Add cuBLAS or cuDNN support about cudarc HOT 5 CLOSED

from what i've seen is that cudnn is great for RNN and CONVs, but i would have to dive deeper into the docs to understand their api

from cudarc.

but we could start with cublas, as it is most likely easier

Edit: I'll have a look into this

from cudarc.

I checked out cuDNN; there are so many functions! can you maybe give me a list of relevant functions? since cuDNN requires very "special" settings, cuDNN would most likely have to be a seperate device/have a different kind of tensor?

This is my cudnn branch: https://github.com/M1ngXU/cudarc/tree/cudnn

from cudarc.

I really like the idea of cuDNN being a different device, that definitely aligns with the device refactor I'm planning for dfdx. Thanks for sharing your code that'll def be useful

from cudarc.

cublas support was added. will add another issue for cudnn

from cudarc.