Video tutorial coming soon.
Deploy AnythingLLM on Ubuntu with Docker — a fully private ChatGPT-like platform that chats with your documents. Connect local Ollama models or cloud APIs. Multi-user workspaces, RAG pipelines, and complete data privacy.
Grab the automated bash script from GitHub to follow along with the video.
wget https://raw.githubusercontent.com/mhmdali94/Docker/main/ai/anythingllm/anythingllm-ubuntu.sh
chmod +x anythingllm-ubuntu.sh
sudo bash anythingllm-ubuntu.shThe script installs Docker and deploys AnythingLLM. Make sure Ollama is already running on port 11434 if you want local models.
wget https://raw.githubusercontent.com/mhmdali94/Docker/main/ai/anythingllm/anythingllm-ubuntu.sh
chmod +x anythingllm-ubuntu.sh
sudo bash anythingllm-ubuntu.shOpen your browser and navigate to AnythingLLM. Follow the setup wizard to choose your LLM provider and create an admin account:
http://<your-server-ip>:3001In Settings → LLM Preference, select Ollama and enter your server address. For cloud models, enter your OpenAI or Anthropic API key.
Create a workspace, upload your PDFs, Word docs, or text files, then start chatting. AnythingLLM automatically indexes and embeds your documents for accurate retrieval.
| Port | Purpose |
|---|---|
| 3001 | AnythingLLM Web UI |