164 lines
2.8 KiB
Markdown
164 lines
2.8 KiB
Markdown
|
# 部署指南
|
|||
|
|
|
|||
|
|
## 目标节点
|
|||
|
|
|
|||
|
|
**OMV (Open Media Vault) on NAS / Proxmox**
|
|||
|
|
|
|||
|
|
推荐直接跑在 Nas 上，不强制 Docker，直接 Python 运行。
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
## 步骤 1 — 环境准备
|
|||
|
|
|
|||
|
|
### 检查 Python 版本
|
|||
|
|
```bash
|
|||
|
|
python3 --version # 需要 >= 3.9
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
### 创建用户（可选，推荐）
|
|||
|
|
```bash
|
|||
|
|
useradd -m -s /bin/bash litellm
|
|||
|
|
su - litellm
|
|||
|
|
mkdir -p ~/litellm-gateway
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
## 步骤 2 — 安装依赖
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
pip install litellm
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
可选：
|
|||
|
|
```bash
|
|||
|
|
pip install uvicorn[standard] # ASGI 服务器（生产推荐）
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
## 步骤 3 — 配置
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
cd ~/litellm-gateway
|
|||
|
|
|
|||
|
|
# 复制环境变量模板
|
|||
|
|
cp .env.example .env
|
|||
|
|
|
|||
|
|
# 编辑 .env，填入真实值
|
|||
|
|
nano .env
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
**必须设置的值：**
|
|||
|
|
- `MINIMAX_API_KEY` — MiniMax 真实 API Key
|
|||
|
|
- `LITELLM_MASTER_KEY` — 管理员 key（以 `sk-` 开头）
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
## 步骤 4 — 启动
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
chmod +x run.sh
|
|||
|
|
./run.sh
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
**后台运行（生产）：**
|
|||
|
|
```bash
|
|||
|
|
# nohup
|
|||
|
|
nohup ./run.sh > logs/litellm.log 2>&1 &
|
|||
|
|
|
|||
|
|
# 或用 systemd（见下方）
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
## 步骤 5 — 验证
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
# 健康检查
|
|||
|
|
curl http://localhost:4000/health
|
|||
|
|
|
|||
|
|
# 测试 chat completions
|
|||
|
|
curl -X POST http://localhost:4000/v1/chat/completions \
|
|||
|
|
-H "Authorization: Bearer sk-your-master-key" \
|
|||
|
|
-H "Content-Type: application/json" \
|
|||
|
|
-d '{
|
|||
|
|
"model": "MiniMax-M2.7",
|
|||
|
|
"messages": [{"role": "user", "content": "Hello"}]
|
|||
|
|
}'
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
## 步骤 6 — OpenClaw 接入
|
|||
|
|
|
|||
|
|
在 `~/.openclaw/openclaw.json` 中修改 MiniMax provider：
|
|||
|
|
|
|||
|
|
```json
|
|||
|
|
{
|
|||
|
|
"providers": {
|
|||
|
|
"minimax": {
|
|||
|
|
"apiKey": "sk-your-minimax-api-key"
|
|||
|
|
},
|
|||
|
|
"minimax-portal": {
|
|||
|
|
"apiKey": "sk-your-litellm-key",
|
|||
|
|
"baseURL": "http://<your-server>:4000/v1"
|
|||
|
|
}
|
|||
|
|
}
|
|||
|
|
}
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
> ⚠️ 注意：LiteLLM 使用 OpenAI 兼容接口，所以 OpenClaw 的 `minimax-portal` provider 可以直接指向 LiteLLM 的 `/v1` 端点。
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
## systemd 服务（OMV 持久化）
|
|||
|
|
|
|||
|
|
```ini
|
|||
|
|
# /etc/systemd/system/litellm.service
|
|||
|
|
[Unit]
|
|||
|
|
Description=LiteLLM Gateway
|
|||
|
|
After=network.target
|
|||
|
|
|
|||
|
|
[Service]
|
|||
|
|
Type=simple
|
|||
|
|
User=litellm
|
|||
|
|
WorkingDirectory=/home/litellm/litellm-gateway
|
|||
|
|
ExecStart=/home/litellm/litellm-gateway/run.sh
|
|||
|
|
Restart=always
|
|||
|
|
RestartSec=5
|
|||
|
|
|
|||
|
|
[Install]
|
|||
|
|
WantedBy=multi-user.target
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
sudo systemctl daemon-reload
|
|||
|
|
sudo systemctl enable litellm
|
|||
|
|
sudo systemctl start litellm
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
## 网络访问控制
|
|||
|
|
|
|||
|
|
### 仅内网访问（推荐）
|
|||
|
|
确保 LiteLLM 的端口 `:4000` 不暴露到公网。
|
|||
|
|
|
|||
|
|
### Tailscale / ZeroTier 组网（推荐）
|
|||
|
|
```bash
|
|||
|
|
# 在服务器上安装 Tailscale
|
|||
|
|
curl -fsSL https://tailscale.com/install.sh | sh
|
|||
|
|
tailscale up --accept-routes
|
|||
|
|
|
|||
|
|
# OpenClaw 节点也加入同一网络
|
|||
|
|
# 然后 LiteLLM 只监听 Tailscale IP（如 100.64.x.x:4000）
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
### 防火墙规则（OMV）
|
|||
|
|
```bash
|
|||
|
|
# 只允许内网段访问 4000
|
|||
|
|
iptables -A INPUT -p tcp -s 192.168.1.0/24 --dport 4000 -j ACCEPT
|
|||
|
|
iptables -A INPUT -p tcp --dport 4000 -j DROP
|
|||
|
|
```
|