ollama大语言模型工具搭建

## 安装框架:
```
curl -fsSL https://ollama.com/install.sh | sh
```

![](/media/202410/2024-10-31_092828_3579630.6479139421907032.png)

![](/media/202410/2024-10-31_092906_1349750.9448562497839038.png)

手动安装 :
```
https://github.com/ollama/ollama/releases
在github上下载:ollama-linux-amd64.tgz 
```

![](/media/202410/2024-10-31_122650_3549890.8373754328993009.png)
```
解压:
tar -C /usr -xzf ollama-linux-amd64.tgz
```
Start Ollama:
```
ollama serve
```

In another terminal, verify that Ollama is running:

```
ollama -v
```
做成service启动:
Create a service file in /etc/systemd/system/ollama.service:
```
[Unit]
Description=Ollama Service
After=network-online.target

[Service]
ExecStart=/usr/bin/ollama serve
User=ollama
Group=ollama
Restart=always
RestartSec=3
Environment="PATH=$PATH"

[Install]
WantedBy=default.target
```
```
Then start the service:
sudo systemctl daemon-reload
sudo systemctl enable ollama

Start Ollama and verify it is running:
sudo systemctl start ollama
sudo systemctl status ollama

To view logs of Ollama running as a startup service, run:

journalctl -e -u ollama
```
## 安装Dify
```
用VPN
git clone https://github.com/langgenius/dify.git
cd dify/docker
cp .env.example .env
docker compose up -d
```

![](/media/202410/2024-10-31_142122_0712130.5993457532259951.png)
最后检查是否所有容器都正常运行：
```
docker compose ps
```
在这个输出中，你应该可以看到包括 3 个业务服务 api / worker / web，以及 6 个基础组件 weaviate / db / redis / nginx / ssrf_proxy / sandbox 。

## reference
```
https://www.bilibili.com/read/cv39350144/

https://www.cnblogs.com/ting1/p/18358286

https://ollama.com/

https://www.bilibili.com/video/BV1vux5eWEAE/?vd_source=e0fbf808daf708898f8321d140319908

解决ollama下载慢的问题:
https://defagi.com/ai-case/ollama-installation-guide-china/

下载很慢 ，手动安装  ：
https://github.com/ollama/ollama/blob/main/docs/linux.md
安装 dify
https://docs.dify.ai/zh-hans/getting-started/install-self-hosted/docker-compose

```