This guide walks through a self-hosted installation of Moltis, a Rust-based AI gateway distributed as a single binary (~44 MB standard, ~3.4 MB lightweight).
For Docker installation, see Docker.
Moltis offers multiple installation options:
curl -fsSL https://www.moltis.org/install.sh | sh
docker run -d \
--name moltis \
-p 13131:13131 \
-p 1455:1455 \
-v moltis-config:/home/moltis/.config/moltis \
-v moltis-data:/home/moltis/.moltis \
-v /var/run/docker.sock:/var/run/docker.sock \
ghcr.io/moltis-org/moltis:latest
Access: http://localhost:13131
brew install moltis-org/tap/moltis
| Distribution | Command |
|---|---|
| Debian/Ubuntu | sudo dpkg -i moltis_*_amd64.deb |
| Fedora/RHEL | sudo dnf install moltis-*.x86_64.rpm |
| Arch Linux | sudo pacman -U moltis-*-x86_64.pkg.tar.zst |
| Snap | sudo snap install moltis |
cargo install moltis --git https://github.com/moltis-org/moltis
Moltis uses TOML configuration files (not environment variables):
~/.config/moltis/moltis.toml~/.moltis/Key configuration sections:
[server] - Bind address, HTTPS settings[sandbox] - Runtime selection (docker, podman, apple)[providers] - LLM API keys and endpoints[mcp] - Model Context Protocol servers[channels] - Messaging integrations (Telegram, Discord, etc.)For detailed configuration, see Moltis Configuration.
Add your LLM provider credentials to moltis.toml:
[providers.openai]
api_key = "sk-..."
[providers.anthropic]
api_key = "sk-ant-..."
[providers.ollama]
endpoint = "http://localhost:11434"
Moltis supports 10+ providers: Anthropic, OpenAI, Gemini, DeepSeek, Mistral, Groq, xAI, OpenRouter, Ollama, and local models.
Enable Model Context Protocol servers for extended capabilities:
[[mcp.servers]]
name = "filesystem"
command = "npx"
args = ["-y", "@modelcontextprotocol/server-filesystem", "/path/to/data"]
Before exposing Moltis publicly:
MOLTIS_PASSWORD environment variable for authenticationFor detailed security guidance, see Moltis Security.
Prefer automation? See Moltis Ansible Setup for a complete playbook.
Detailed Docker deployment with Compose: See Moltis Docker Setup.
Any questions?
Feel free to contact us. Find all contact information on our contact page.