This is a collective a script(s) that I am working on to interact with ollama more easily.

I am testing on my personal computer, which uses an AMD RX 7600XT. Thus, I will be interacting with docker/ollama using the AMD-appropriate commands. Mainly the following

docker run -d --device /dev/kfd --device /dev/dri -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama:rocm

which can just be replaced with the following for NVIDIA (as of 2024-03-24).

sudo docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama

This is only tested on my personal computer, which uses Arch Linux. It is not tested for any other operating system.

Known dependencies:

• ollama
• docker
• jq