Containerized LLM toolkit to run backends, APIs, and frontends.
- Self-hosted GenAI workflows
- Local or private model support
- API and UI access
- Private LLM apps and RAG
- Research assistants and agents
- Internal knowledge search
- Open-source and self-hosted
- Documentation: https://github.com/LLM-Harbor/llm-harbor
- Source Code: https://github.com/LLM-Harbor/llm-harbor
LLM Harbor Setup