This guide walks through a self-hosted installation of Ollama.
For Docker installation, see Docker.
docker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
Requires NVIDIA Container Toolkit installed.
docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
docker run -d --device /dev/kfd --device /dev/dri -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama:rocm
Prefer automation? See Ollama Ansible Setup for an example playbook with GPU support.
Prefer containers? See Ollama Docker Setup for detailed Docker and Docker Compose instructions.
Any questions?
Feel free to contact us. Find all contact information on our contact page.