Compare commits
86 Commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
0e34cee3d8 | ||
|
|
b35971f43c | ||
|
|
285b01922d | ||
|
|
aa3b8585f9 | ||
|
|
25c7c47c96 | ||
|
|
b567531a7d | ||
|
|
1b0fc06bf7 | ||
|
|
f5b5455989 | ||
|
|
14f22f9128 | ||
|
|
76eb9c689b | ||
|
|
7032235923 | ||
|
|
f870779146 | ||
|
|
81eb99691d | ||
|
|
32e7240287 | ||
|
|
a041a6f01d | ||
|
|
eeb9c295f5 | ||
|
|
df86034ae5 | ||
|
|
be66667890 | ||
|
|
667338368a | ||
|
|
5cfd0ad3ee | ||
|
|
1cc70e439e | ||
|
|
0e99233417 | ||
|
|
000f92ffd1 | ||
|
|
4c3c9bd553 | ||
|
|
22db03dcea | ||
|
|
26c25520fa | ||
|
|
c2a8cdef4f | ||
|
|
7e8f42212a | ||
|
|
5af4c235d5 | ||
|
|
1d9451f071 | ||
|
|
4825b45511 | ||
|
|
5bd21e156d | ||
|
|
689d1e61a0 | ||
|
|
c8fd405d74 | ||
|
|
5f8d998c65 | ||
|
|
b5b3c55573 | ||
|
|
1d3ed2f8aa | ||
|
|
215f3170cd | ||
|
|
0700de36f5 | ||
|
|
14130eac8b | ||
|
|
bad6da4488 | ||
|
|
1126f84a3a | ||
|
|
24d644dc8b | ||
|
|
d0ac53320e | ||
|
|
853bb50854 | ||
|
|
dfb6a1707c | ||
|
|
9098b28ba6 | ||
|
|
b5e5052146 | ||
|
|
e88b8411b5 | ||
|
|
d1b406b1ee | ||
|
|
10432c1db6 | ||
|
|
440049c974 | ||
|
|
afb5a38f15 | ||
|
|
1ea7e87e6f | ||
|
|
e6b4455428 | ||
|
|
6aacf9aed8 | ||
|
|
1f6fdfba1a | ||
|
|
4d466af99e | ||
|
|
c1b19cf937 | ||
|
|
4d3f4a082e | ||
|
|
ba7dd4d064 | ||
|
|
78b147da47 | ||
|
|
f9ecbad0a7 | ||
|
|
53fbaabc63 | ||
|
|
97f92ea26c | ||
|
|
d7b273dfae | ||
|
|
4c56289bfe | ||
|
|
cf3376eb31 | ||
|
|
312ecb041a | ||
|
|
a5c5e41cc4 | ||
|
|
f0e5c93a48 | ||
|
|
2582920e2c | ||
|
|
50ee23db1c | ||
|
|
6cbd1f5d17 | ||
|
|
eba01b540b | ||
|
|
0434d069ce | ||
|
|
443d67ad78 | ||
|
|
4463960447 | ||
|
|
595c44b437 | ||
|
|
00606ef73e | ||
|
|
d4fe64819f | ||
|
|
32c8c30c05 | ||
|
|
e2d4960c4c | ||
|
|
42ffc1e2e8 | ||
|
|
cdd6b9985c | ||
|
|
dbc8fa9c36 |
1
.gitignore
vendored
@@ -15,6 +15,7 @@ go.work.sum
|
||||
.env
|
||||
.env.local
|
||||
.env.*.local
|
||||
!web/.env
|
||||
web/.output/
|
||||
|
||||
# IDE
|
||||
|
||||
19
CHANGELOG.md
@@ -2,7 +2,16 @@
|
||||
|
||||
本项目遵循 [语义化版本](https://semver.org/lang/zh-CN/) 规范。
|
||||
|
||||
## [未发布]
|
||||
## [v1.1.0]
|
||||
|
||||
1. 新增违禁词功能
|
||||
2. 管理后台体验优化
|
||||
3. bug修复
|
||||
|
||||
## [v1.0.0]
|
||||
|
||||
1. 自动转存
|
||||
2. 自动资源处理
|
||||
|
||||
### 新增
|
||||
- 项目开源准备
|
||||
@@ -76,10 +85,4 @@
|
||||
1. 在提交代码时使用规范的提交信息2. 在Pull Request中描述您的更改
|
||||
3. 遵循项目的贡献指南
|
||||
|
||||
---
|
||||
|
||||
## 链接
|
||||
|
||||
- [项目主页](https://github.com/your-username/l9pan)
|
||||
- [问题反馈](https://github.com/your-username/l9pan/issues)
|
||||
- [讨论区](https://github.com/your-username/l9
|
||||
---
|
||||
29
Dockerfile
@@ -2,28 +2,23 @@
|
||||
FROM node:20-slim AS frontend-builder
|
||||
|
||||
# 安装pnpm
|
||||
RUN npm install -g pnpm
|
||||
ENV NODE_ENV=production
|
||||
|
||||
WORKDIR /app/web
|
||||
COPY web/package*.json ./
|
||||
COPY web/pnpm-lock.yaml ./
|
||||
RUN pnpm install --frozen-lockfile
|
||||
|
||||
COPY web/ ./
|
||||
RUN pnpm run build
|
||||
RUN npm install --frozen-lockfile
|
||||
ARG NUXT_PUBLIC_API_SERVER=http://backend:8080/api
|
||||
ARG NUXT_PUBLIC_API_CLIENT=/api
|
||||
RUN npm run build
|
||||
|
||||
# 前端运行阶段
|
||||
FROM node:18-alpine AS frontend
|
||||
FROM node:20-alpine AS frontend
|
||||
|
||||
RUN npm install -g pnpm
|
||||
# RUN npm install -g pnpm
|
||||
ENV NODE_ENV=production
|
||||
|
||||
WORKDIR /app
|
||||
COPY --from=frontend-builder /app/web/.output ./.output
|
||||
COPY --from=frontend-builder /app/web/package*.json ./
|
||||
|
||||
EXPOSE 3000
|
||||
|
||||
CMD ["node", ".output/server/index.mjs"]
|
||||
|
||||
# 后端构建阶段
|
||||
@@ -33,12 +28,18 @@ WORKDIR /app
|
||||
COPY go.mod go.sum ./
|
||||
RUN go mod download
|
||||
|
||||
# 先复制VERSION文件,确保构建时能正确读取版本号
|
||||
COPY VERSION ./
|
||||
|
||||
COPY . .
|
||||
RUN CGO_ENABLED=0 GOOS=linux go build -a -installsuffix cgo -o main .
|
||||
|
||||
# 后端运行阶段
|
||||
FROM alpine:latest AS backend
|
||||
|
||||
# 安装时区数据
|
||||
RUN apk add --no-cache tzdata
|
||||
|
||||
WORKDIR /root/
|
||||
|
||||
# 复制后端二进制文件
|
||||
@@ -47,6 +48,10 @@ COPY --from=backend-builder /app/main .
|
||||
# 创建uploads目录
|
||||
RUN mkdir -p uploads
|
||||
|
||||
# 设置环境变量
|
||||
ENV GIN_MODE=release
|
||||
ENV TZ=Asia/Shanghai
|
||||
|
||||
# 暴露端口
|
||||
EXPOSE 8080
|
||||
|
||||
|
||||
62
README.md
@@ -10,7 +10,7 @@
|
||||
|
||||
**一个现代化的网盘资源数据库,支持多网盘自动化转存分享,支持百度网盘,阿里云盘,夸克网盘, 天翼云盘,迅雷云盘,123云盘,115网盘,UC网盘 **
|
||||
|
||||
🌐 [在线演示](#) | 📖 [文档](#) | 🐛 [问题反馈](#) | ⭐ [给个星标](#)
|
||||
🌐 [在线演示](https://pan.l9.lc) | 📖 [文档](https://ecn5khs4t956.feishu.cn/wiki/PsnDwtxghiP0mLkTiruczKtxnwd?from=from_copylink) | 🐛 [问题反馈](https://github.com/ctwj/urldb/issues) | ⭐ [给个星标](https://github.com/ctwj/urldb)
|
||||
|
||||
### 支持的网盘平台
|
||||
|
||||
@@ -31,13 +31,30 @@
|
||||
|
||||
## 🔔 温馨提示
|
||||
|
||||
📌 **本项目仅供技术交流与学习使用**,自身不存储或提供任何资源文件及下载链接。
|
||||
- [文档说明](https://ecn5khs4t956.feishu.cn/wiki/PsnDwtxghiP0mLkTiruczKtxnwd?from=from_copylink)
|
||||
- [服务器要求](https://ecn5khs4t956.feishu.cn/wiki/W8YBww1Mmiu4Cdkp5W4c8pFNnMf?from=from_copylink)
|
||||
- [QQ机器人](https://github.com/ctwj/astrbot_plugin_urldb)
|
||||
|
||||
📌 **请勿将本项目用于任何违法用途**,否则后果自负。
|
||||
---
|
||||
|
||||
📌 如有任何问题或建议,欢迎交流探讨! 😊
|
||||
## 📸 项目截图
|
||||
|
||||
> **免责声明**:本项目由 Trae AI 辅助编写。由于时间有限,仅在空闲时维护。如遇使用问题,请优先自行排查,感谢理解!
|
||||
|
||||
|
||||
### 🏠 首页
|
||||

|
||||
|
||||
### 🔧 后台管理
|
||||

|
||||
|
||||
### ⚙️ 系统配置
|
||||

|
||||
|
||||
### 🔍 批量转存
|
||||

|
||||
|
||||
### 👤 多账号管理
|
||||

|
||||
|
||||
---
|
||||
|
||||
@@ -68,6 +85,7 @@
|
||||
|
||||
---
|
||||
|
||||
|
||||
## 🚀 快速开始
|
||||
|
||||
### 环境要求
|
||||
@@ -175,35 +193,6 @@ l9pan/
|
||||
|
||||
## 🔧 配置说明
|
||||
|
||||
### 版本管理
|
||||
|
||||
项目使用GitHub进行版本管理,支持自动创建Release和标签。
|
||||
|
||||
#### 版本管理脚本
|
||||
|
||||
```bash
|
||||
# 显示当前版本信息
|
||||
./scripts/version.sh show
|
||||
|
||||
# 更新版本号
|
||||
./scripts/version.sh patch # 修订版本 1.0.7)
|
||||
./scripts/version.sh minor # 次版本 1.0.7)
|
||||
./scripts/version.sh major # 主版本 1.0.7)
|
||||
|
||||
# 发布版本到GitHub
|
||||
./scripts/version.sh release
|
||||
|
||||
# 生成版本信息文件
|
||||
./scripts/version.sh update
|
||||
|
||||
# 查看帮助
|
||||
./scripts/version.sh help
|
||||
```
|
||||
|
||||
#### 详细文档
|
||||
|
||||
查看 [GitHub版本管理指南](docs/github-version-management.md) 了解完整的版本管理流程。
|
||||
|
||||
### 环境变量配置
|
||||
|
||||
```bash
|
||||
@@ -216,6 +205,9 @@ DB_NAME=url_db
|
||||
|
||||
# 服务器配置
|
||||
PORT=8080
|
||||
|
||||
# 时区配置
|
||||
TIMEZONE=Asia/Shanghai
|
||||
```
|
||||
|
||||
### Docker 服务说明
|
||||
@@ -242,7 +234,7 @@ docker push ctwj/urldb-backend:1.0.7
|
||||
|
||||
提供,批量入库和搜索api,通过 apiToken 授权
|
||||
|
||||
> 📖 完整API文档请访问:`http://p.l9.lc/doc.html`
|
||||
> 📖 完整API文档请访问:`http://doc.l9.lc/`
|
||||
|
||||
## 🤝 贡献指南
|
||||
|
||||
|
||||
@@ -3,11 +3,12 @@ package pan
|
||||
import (
|
||||
"encoding/json"
|
||||
"fmt"
|
||||
"log"
|
||||
"os"
|
||||
"path/filepath"
|
||||
"sync"
|
||||
"time"
|
||||
|
||||
"github.com/ctwj/urldb/utils"
|
||||
)
|
||||
|
||||
// AlipanService 阿里云盘服务
|
||||
@@ -84,7 +85,7 @@ func (a *AlipanService) Transfer(shareID string) (*TransferResult, error) {
|
||||
config := a.config
|
||||
a.configMutex.RUnlock()
|
||||
|
||||
log.Printf("开始处理阿里云盘分享: %s", shareID)
|
||||
fmt.Printf("开始处理阿里云盘分享: %s", shareID)
|
||||
|
||||
// 获取access token
|
||||
accessToken, err := a.manageAccessToken()
|
||||
@@ -429,7 +430,7 @@ func (a *AlipanService) manageAccessToken() (string, error) {
|
||||
}
|
||||
|
||||
// 检查token是否过期
|
||||
if time.Now().After(tokenInfo.ExpiresAt) {
|
||||
if utils.GetCurrentTime().After(tokenInfo.ExpiresAt) {
|
||||
return a.getNewAccessToken()
|
||||
}
|
||||
|
||||
|
||||
@@ -16,6 +16,10 @@ const (
|
||||
BaiduPan
|
||||
UC
|
||||
NotFound
|
||||
Xunlei
|
||||
Tianyi
|
||||
Pan123
|
||||
Pan115
|
||||
)
|
||||
|
||||
// String 返回服务类型的字符串表示
|
||||
@@ -29,6 +33,14 @@ func (s ServiceType) String() string {
|
||||
return "baidu"
|
||||
case UC:
|
||||
return "uc"
|
||||
case Xunlei:
|
||||
return "xunlei"
|
||||
case Tianyi:
|
||||
return "tianyi"
|
||||
case Pan123:
|
||||
return "123pan"
|
||||
case Pan115:
|
||||
return "115"
|
||||
default:
|
||||
return "unknown"
|
||||
}
|
||||
@@ -42,6 +54,7 @@ type PanConfig struct {
|
||||
ExpiredType int `json:"expiredType"` // 1: 分享永久, 2: 临时
|
||||
AdFid string `json:"adFid"` // 夸克专用 - 分享时带上这个文件的fid
|
||||
Stoken string `json:"stoken"`
|
||||
Cookie string `json:"cookie"`
|
||||
}
|
||||
|
||||
// TransferResult 转存结果
|
||||
@@ -132,6 +145,10 @@ func (f *PanFactory) CreatePanServiceByType(serviceType ServiceType, config *Pan
|
||||
return NewBaiduPanService(config), nil
|
||||
case UC:
|
||||
return NewUCService(config), nil
|
||||
// case Xunlei:
|
||||
// return NewXunleiService(config), nil
|
||||
// case Tianyi:
|
||||
// return NewTianyiService(config), nil
|
||||
default:
|
||||
return nil, fmt.Errorf("不支持的服务类型: %d", serviceType)
|
||||
}
|
||||
@@ -165,6 +182,11 @@ func (f *PanFactory) GetUCService(config *PanConfig) PanService {
|
||||
func ExtractServiceType(url string) ServiceType {
|
||||
url = strings.ToLower(url)
|
||||
|
||||
// "https://www.123pan.com/s/i4uaTd-WHn0", // 公开分享
|
||||
// "https://www.123912.com/s/U8f2Td-ZeOX",
|
||||
// "https://www.123684.coms/u9izjv-k3uWv",
|
||||
// "https://www.123pan.com/s/A6cA-AKH11", // 外链不存在
|
||||
|
||||
patterns := map[string]ServiceType{
|
||||
"pan.quark.cn": Quark,
|
||||
"www.alipan.com": Alipan,
|
||||
@@ -172,6 +194,14 @@ func ExtractServiceType(url string) ServiceType {
|
||||
"pan.baidu.com": BaiduPan,
|
||||
"drive.uc.cn": UC,
|
||||
"fast.uc.cn": UC,
|
||||
"pan.xunlei.com": Xunlei,
|
||||
"cloud.189.cn": Tianyi,
|
||||
"www.123pan.com": Pan123,
|
||||
"www.123912.com": Pan123,
|
||||
"www.123684.com": Pan123,
|
||||
"115cdn.com": Pan115,
|
||||
"anxia.com": Pan115,
|
||||
"115.com/": Pan115,
|
||||
}
|
||||
|
||||
for pattern, serviceType := range patterns {
|
||||
@@ -191,12 +221,24 @@ func ExtractShareId(url string) (string, ServiceType) {
|
||||
}
|
||||
|
||||
// 提取分享ID
|
||||
substring := strings.Index(url, "/s/")
|
||||
shareID := ""
|
||||
substring := -1
|
||||
|
||||
if index := strings.Index(url, "/s/"); index != -1 {
|
||||
substring = index + 3
|
||||
} else if index := strings.Index(url, "/t/"); index != -1 {
|
||||
substring = index + 3
|
||||
} else if index := strings.Index(url, "/web/share?code="); index != -1 {
|
||||
substring = index + 16
|
||||
} else if index := strings.Index(url, "/p/"); index != -1 {
|
||||
substring = index + 3
|
||||
}
|
||||
|
||||
if substring == -1 {
|
||||
return "", NotFound
|
||||
}
|
||||
|
||||
shareID := url[substring+3:] // 去除 '/s/' 部分
|
||||
shareID = url[substring:]
|
||||
|
||||
// 去除可能的锚点
|
||||
if hashIndex := strings.Index(shareID, "#"); hashIndex != -1 {
|
||||
|
||||
@@ -4,9 +4,13 @@ import (
|
||||
"encoding/json"
|
||||
"fmt"
|
||||
"log"
|
||||
"math/rand"
|
||||
"strconv"
|
||||
"strings"
|
||||
"sync"
|
||||
"time"
|
||||
|
||||
"github.com/ctwj/urldb/utils"
|
||||
)
|
||||
|
||||
// QuarkPanService 夸克网盘服务
|
||||
@@ -42,6 +46,7 @@ func NewQuarkPanService(config *PanConfig) *QuarkPanService {
|
||||
"Referer": "https://pan.quark.cn/",
|
||||
"Referrer-Policy": "strict-origin-when-cross-origin",
|
||||
"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36",
|
||||
"Cookie": config.Cookie,
|
||||
})
|
||||
})
|
||||
|
||||
@@ -66,6 +71,25 @@ func (q *QuarkPanService) UpdateConfig(config *PanConfig) {
|
||||
defer q.configMutex.Unlock()
|
||||
|
||||
q.config = config
|
||||
// 设置Cookie到header
|
||||
if config.Cookie != "" {
|
||||
q.SetHeader("Cookie", config.Cookie)
|
||||
}
|
||||
}
|
||||
|
||||
// SetCookie 设置Cookie
|
||||
func (q *QuarkPanService) SetCookie(cookie string) {
|
||||
q.SetHeader("Cookie", cookie)
|
||||
q.configMutex.Lock()
|
||||
if q.config != nil {
|
||||
q.config.Cookie = cookie
|
||||
}
|
||||
q.configMutex.Unlock()
|
||||
}
|
||||
|
||||
// GetCookie 获取当前Cookie
|
||||
func (q *QuarkPanService) GetCookie() string {
|
||||
return q.GetHeader("Cookie")
|
||||
}
|
||||
|
||||
// GetServiceType 获取服务类型
|
||||
@@ -166,6 +190,11 @@ func (q *QuarkPanService) Transfer(shareID string) (*TransferResult, error) {
|
||||
log.Printf("删除广告文件失败: %v", err)
|
||||
}
|
||||
|
||||
// 添加个人自定义广告
|
||||
if err := q.addAd(myData.SaveAs.SaveAsTopFids[0]); err != nil {
|
||||
log.Printf("添加广告文件失败: %v", err)
|
||||
}
|
||||
|
||||
// 分享资源
|
||||
shareBtnResult, err := q.getShareBtn(myData.SaveAs.SaveAsTopFids, title)
|
||||
if err != nil {
|
||||
@@ -383,11 +412,23 @@ func (q *QuarkPanService) getShareSave(shareID, stoken string, fidList, fidToken
|
||||
return &response.Data, nil
|
||||
}
|
||||
|
||||
// 生成指定长度的时间戳
|
||||
func (q *QuarkPanService) generateTimestamp(length int) int64 {
|
||||
timestamp := utils.GetCurrentTime().UnixNano() / int64(time.Millisecond)
|
||||
timestampStr := strconv.FormatInt(timestamp, 10)
|
||||
if len(timestampStr) > length {
|
||||
timestampStr = timestampStr[:length]
|
||||
}
|
||||
timestamp, _ = strconv.ParseInt(timestampStr, 10, 64)
|
||||
return timestamp
|
||||
}
|
||||
|
||||
// getShareBtn 分享按钮
|
||||
func (q *QuarkPanService) getShareBtn(fidList []string, title string) (*ShareBtnResult, error) {
|
||||
data := map[string]interface{}{
|
||||
"fid_list": fidList,
|
||||
"title": title,
|
||||
"url_type": 1,
|
||||
"expired_type": 1, // 永久分享
|
||||
}
|
||||
|
||||
@@ -397,7 +438,7 @@ func (q *QuarkPanService) getShareBtn(fidList []string, title string) (*ShareBtn
|
||||
"uc_param_str": "",
|
||||
}
|
||||
|
||||
respData, err := q.HTTPPost("https://drive-pc.quark.cn/1/clouddrive/share/create", data, queryParams)
|
||||
respData, err := q.HTTPPost("https://drive-pc.quark.cn/1/clouddrive/share", data, queryParams)
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
@@ -427,9 +468,11 @@ func (q *QuarkPanService) getShareTask(taskID string, retryIndex int) (*TaskResu
|
||||
"uc_param_str": "",
|
||||
"task_id": taskID,
|
||||
"retry_index": fmt.Sprintf("%d", retryIndex),
|
||||
"__dt": "21192",
|
||||
"__t": fmt.Sprintf("%d", q.generateTimestamp(13)),
|
||||
}
|
||||
|
||||
respData, err := q.HTTPGet("https://drive-pc.quark.cn/1/clouddrive/share/sharepage/task", queryParams)
|
||||
respData, err := q.HTTPGet("https://drive-pc.quark.cn/1/clouddrive/task", queryParams)
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
@@ -457,10 +500,13 @@ func (q *QuarkPanService) getSharePassword(shareID string) (*PasswordResult, err
|
||||
"pr": "ucpro",
|
||||
"fr": "pc",
|
||||
"uc_param_str": "",
|
||||
"share_id": shareID,
|
||||
}
|
||||
|
||||
respData, err := q.HTTPGet("https://drive-pc.quark.cn/1/clouddrive/share/sharepage/password", queryParams)
|
||||
data := map[string]interface{}{
|
||||
"share_id": shareID,
|
||||
}
|
||||
|
||||
respData, err := q.HTTPPost("https://drive-pc.quark.cn/1/clouddrive/share/password", data, queryParams)
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
@@ -508,8 +554,139 @@ func (q *QuarkPanService) waitForTask(taskID string) (*TaskResult, error) {
|
||||
|
||||
// deleteAdFiles 删除广告文件
|
||||
func (q *QuarkPanService) deleteAdFiles(pdirFid string) error {
|
||||
// 这里可以添加广告文件删除逻辑
|
||||
// 需要从配置中读取禁止的关键词列表
|
||||
log.Printf("开始删除广告文件,目录ID: %s", pdirFid)
|
||||
|
||||
// 获取目录文件列表
|
||||
fileList, err := q.getDirFile(pdirFid)
|
||||
if err != nil {
|
||||
log.Printf("获取目录文件失败: %v", err)
|
||||
return err
|
||||
}
|
||||
|
||||
if fileList == nil || len(fileList) == 0 {
|
||||
log.Printf("目录为空,无需删除广告文件")
|
||||
return nil
|
||||
}
|
||||
|
||||
// 删除包含广告关键词的文件
|
||||
for _, file := range fileList {
|
||||
if fileName, ok := file["file_name"].(string); ok {
|
||||
log.Printf("检查文件: %s", fileName)
|
||||
if q.containsAdKeywords(fileName) {
|
||||
if fid, ok := file["fid"].(string); ok {
|
||||
log.Printf("删除广告文件: %s (FID: %s)", fileName, fid)
|
||||
_, err := q.DeleteFiles([]string{fid})
|
||||
if err != nil {
|
||||
log.Printf("删除广告文件失败: %v", err)
|
||||
} else {
|
||||
log.Printf("成功删除广告文件: %s", fileName)
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
return nil
|
||||
}
|
||||
|
||||
// containsAdKeywords 检查文件名是否包含广告关键词
|
||||
func (q *QuarkPanService) containsAdKeywords(filename string) bool {
|
||||
// 默认广告关键词列表
|
||||
defaultAdKeywords := []string{
|
||||
"微信", "独家", "V信", "v信", "威信", "胖狗资源",
|
||||
"加微", "会员群", "q群", "v群", "公众号",
|
||||
"广告", "特价", "最后机会", "不要错过", "立减",
|
||||
"立得", "赚", "省", "回扣", "抽奖",
|
||||
"失效", "年会员", "空间容量", "微信群", "群文件", "全网资源", "影视资源", "扫码", "最新资源",
|
||||
"IMG_", "资源汇总", "緑铯粢源", ".url", "网盘推广", "大额优惠券",
|
||||
"资源文档", "dy8.xyz", "妙妙屋", "资源合集", "kkdm", "赚收益",
|
||||
}
|
||||
|
||||
// 尝试从系统配置中获取广告关键词
|
||||
adKeywords := defaultAdKeywords
|
||||
|
||||
// 这里可以添加从系统配置读取广告关键词的逻辑
|
||||
// 例如:从数据库或配置文件中读取自定义的广告关键词
|
||||
|
||||
return q.checkKeywordsInFilename(filename, adKeywords)
|
||||
}
|
||||
|
||||
// checkKeywordsInFilename 检查文件名是否包含指定关键词
|
||||
func (q *QuarkPanService) checkKeywordsInFilename(filename string, keywords []string) bool {
|
||||
// 转为小写进行比较
|
||||
lowercaseFilename := strings.ToLower(filename)
|
||||
|
||||
for _, keyword := range keywords {
|
||||
if strings.Contains(lowercaseFilename, strings.ToLower(keyword)) {
|
||||
log.Printf("文件 %s 包含广告关键词: %s", filename, keyword)
|
||||
return true
|
||||
}
|
||||
}
|
||||
|
||||
return false
|
||||
}
|
||||
|
||||
// addAd 添加个人自定义广告
|
||||
func (q *QuarkPanService) addAd(dirID string) error {
|
||||
log.Printf("开始添加个人自定义广告到目录: %s", dirID)
|
||||
|
||||
// 这里可以从配置中读取广告文件ID列表
|
||||
// 暂时使用硬编码的广告文件ID,后续可以从系统配置中读取
|
||||
adFileIDs := []string{
|
||||
// 可以配置多个广告文件ID
|
||||
// "4c0381f2d1ca", // 示例广告文件ID
|
||||
}
|
||||
|
||||
if len(adFileIDs) == 0 {
|
||||
log.Printf("没有配置广告文件,跳过广告插入")
|
||||
return nil
|
||||
}
|
||||
|
||||
// 随机选择一个广告文件
|
||||
rand.Seed(time.Now().UnixNano())
|
||||
selectedAdID := adFileIDs[rand.Intn(len(adFileIDs))]
|
||||
|
||||
log.Printf("选择广告文件ID: %s", selectedAdID)
|
||||
|
||||
// 获取广告文件的stoken
|
||||
stokenResult, err := q.getStoken(selectedAdID)
|
||||
if err != nil {
|
||||
log.Printf("获取广告文件stoken失败: %v", err)
|
||||
return err
|
||||
}
|
||||
|
||||
// 获取广告文件详情
|
||||
adDetail, err := q.getShare(selectedAdID, stokenResult.Stoken)
|
||||
if err != nil {
|
||||
log.Printf("获取广告文件详情失败: %v", err)
|
||||
return err
|
||||
}
|
||||
|
||||
if len(adDetail.List) == 0 {
|
||||
log.Printf("广告文件详情为空")
|
||||
return fmt.Errorf("广告文件详情为空")
|
||||
}
|
||||
|
||||
// 获取第一个广告文件的信息
|
||||
adFile := adDetail.List[0]
|
||||
fid := adFile.Fid
|
||||
shareFidToken := adFile.ShareFidToken
|
||||
|
||||
// 保存广告文件到目标目录
|
||||
saveResult, err := q.getShareSave(selectedAdID, stokenResult.Stoken, []string{fid}, []string{shareFidToken})
|
||||
if err != nil {
|
||||
log.Printf("保存广告文件失败: %v", err)
|
||||
return err
|
||||
}
|
||||
|
||||
// 等待保存完成
|
||||
_, err = q.waitForTask(saveResult.TaskID)
|
||||
if err != nil {
|
||||
log.Printf("等待广告文件保存完成失败: %v", err)
|
||||
return err
|
||||
}
|
||||
|
||||
log.Printf("广告文件添加成功")
|
||||
return nil
|
||||
}
|
||||
|
||||
|
||||
138
db/connection.go
@@ -17,19 +17,16 @@ var DB *gorm.DB
|
||||
// InitDB 初始化数据库连接
|
||||
func InitDB() error {
|
||||
host := os.Getenv("DB_HOST")
|
||||
fmt.Printf("DB_HOST=%s\n", host)
|
||||
if host == "" {
|
||||
host = "localhost"
|
||||
}
|
||||
|
||||
port := os.Getenv("DB_PORT")
|
||||
fmt.Printf("DB_HOST=%s\n", port)
|
||||
if port == "" {
|
||||
port = "5432"
|
||||
}
|
||||
|
||||
user := os.Getenv("DB_USER")
|
||||
fmt.Printf("DB_HOST=%s\n", user)
|
||||
if user == "" {
|
||||
user = "postgres"
|
||||
}
|
||||
@@ -66,26 +63,37 @@ func InitDB() error {
|
||||
sqlDB.SetMaxOpenConns(100) // 最大打开连接数
|
||||
sqlDB.SetConnMaxLifetime(time.Hour) // 连接最大生命周期
|
||||
|
||||
// 自动迁移数据库表结构
|
||||
err = DB.AutoMigrate(
|
||||
&entity.User{},
|
||||
&entity.Category{},
|
||||
&entity.Pan{},
|
||||
&entity.Cks{},
|
||||
&entity.Tag{},
|
||||
&entity.Resource{},
|
||||
&entity.ResourceTag{},
|
||||
&entity.ReadyResource{},
|
||||
&entity.SearchStat{},
|
||||
&entity.SystemConfig{},
|
||||
&entity.HotDrama{},
|
||||
)
|
||||
if err != nil {
|
||||
utils.Fatal("数据库迁移失败: %v", err)
|
||||
// 检查是否需要迁移(只在开发环境或首次启动时)
|
||||
if shouldRunMigration() {
|
||||
utils.Info("开始数据库迁移...")
|
||||
err = DB.AutoMigrate(
|
||||
&entity.User{},
|
||||
&entity.Category{},
|
||||
&entity.Pan{},
|
||||
&entity.Cks{},
|
||||
&entity.Tag{},
|
||||
&entity.Resource{},
|
||||
&entity.ResourceTag{},
|
||||
&entity.ReadyResource{},
|
||||
&entity.SearchStat{},
|
||||
&entity.SystemConfig{},
|
||||
&entity.HotDrama{},
|
||||
&entity.ResourceView{},
|
||||
&entity.Task{},
|
||||
&entity.TaskItem{},
|
||||
)
|
||||
if err != nil {
|
||||
utils.Fatal("数据库迁移失败: %v", err)
|
||||
}
|
||||
utils.Info("数据库迁移完成")
|
||||
} else {
|
||||
utils.Info("跳过数据库迁移(表结构已是最新)")
|
||||
}
|
||||
|
||||
// 创建索引以提高查询性能
|
||||
createIndexes(DB)
|
||||
// 创建索引以提高查询性能(只在需要迁移时)
|
||||
if shouldRunMigration() {
|
||||
createIndexes(DB)
|
||||
}
|
||||
|
||||
// 插入默认数据(只在数据库为空时)
|
||||
if err := insertDefaultDataIfEmpty(); err != nil {
|
||||
@@ -96,9 +104,36 @@ func InitDB() error {
|
||||
return nil
|
||||
}
|
||||
|
||||
// shouldRunMigration 检查是否需要运行数据库迁移
|
||||
func shouldRunMigration() bool {
|
||||
// 通过环境变量控制是否运行迁移
|
||||
skipMigration := os.Getenv("SKIP_MIGRATION")
|
||||
if skipMigration == "true" {
|
||||
return false
|
||||
}
|
||||
|
||||
// 检查环境变量
|
||||
env := os.Getenv("ENV")
|
||||
if env == "production" {
|
||||
// 生产环境:检查是否有迁移标记
|
||||
var count int64
|
||||
DB.Raw("SELECT COUNT(*) FROM information_schema.tables WHERE table_name = 'schema_migrations'").Count(&count)
|
||||
if count == 0 {
|
||||
// 没有迁移表,说明是首次部署
|
||||
return true
|
||||
}
|
||||
// 有迁移表,检查是否需要迁移(这里可以添加更复杂的逻辑)
|
||||
return false
|
||||
}
|
||||
|
||||
// 开发环境:总是运行迁移
|
||||
return true
|
||||
}
|
||||
|
||||
// autoMigrate 自动迁移表结构
|
||||
func autoMigrate() error {
|
||||
return DB.AutoMigrate(
|
||||
&entity.SystemConfig{}, // 系统配置表(独立表,先创建)
|
||||
&entity.Pan{},
|
||||
&entity.Cks{},
|
||||
&entity.Category{},
|
||||
@@ -108,16 +143,13 @@ func autoMigrate() error {
|
||||
&entity.ReadyResource{},
|
||||
&entity.User{},
|
||||
&entity.SearchStat{},
|
||||
&entity.SystemConfig{},
|
||||
&entity.HotDrama{},
|
||||
)
|
||||
}
|
||||
|
||||
// createIndexes 创建数据库索引以提高查询性能
|
||||
func createIndexes(db *gorm.DB) {
|
||||
// 资源表索引
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_resources_title ON resources USING gin(to_tsvector('chinese', title))")
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_resources_description ON resources USING gin(to_tsvector('chinese', description))")
|
||||
// 资源表索引(移除全文搜索索引,使用Meilisearch替代)
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_resources_category_id ON resources(category_id)")
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_resources_pan_id ON resources(pan_id)")
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_resources_created_at ON resources(created_at DESC)")
|
||||
@@ -125,8 +157,17 @@ func createIndexes(db *gorm.DB) {
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_resources_is_valid ON resources(is_valid)")
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_resources_is_public ON resources(is_public)")
|
||||
|
||||
// 为Meilisearch准备的基础文本索引(用于精确匹配)
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_resources_title ON resources(title)")
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_resources_description ON resources(description)")
|
||||
|
||||
// 待处理资源表索引
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_ready_resource_key ON ready_resource(key)")
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_ready_resource_url ON ready_resource(url)")
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_ready_resource_create_time ON ready_resource(create_time DESC)")
|
||||
|
||||
// 搜索统计表索引
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_search_stats_query ON search_stats(query)")
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_search_stats_keyword ON search_stats(keyword)")
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_search_stats_created_at ON search_stats(created_at DESC)")
|
||||
|
||||
// 热播剧表索引
|
||||
@@ -138,7 +179,7 @@ func createIndexes(db *gorm.DB) {
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_resource_tags_resource_id ON resource_tags(resource_id)")
|
||||
db.Exec("CREATE INDEX IF NOT EXISTS idx_resource_tags_tag_id ON resource_tags(tag_id)")
|
||||
|
||||
utils.Info("数据库索引创建完成")
|
||||
utils.Info("数据库索引创建完成(已移除全文搜索索引,准备使用Meilisearch)")
|
||||
}
|
||||
|
||||
// insertDefaultDataIfEmpty 只在数据库为空时插入默认数据
|
||||
@@ -159,11 +200,18 @@ func insertDefaultDataIfEmpty() error {
|
||||
|
||||
// 插入默认分类(使用FirstOrCreate避免重复)
|
||||
defaultCategories := []entity.Category{
|
||||
{Name: "文档", Description: "各种文档资料"},
|
||||
{Name: "软件", Description: "软件工具"},
|
||||
{Name: "视频", Description: "视频教程"},
|
||||
{Name: "图片", Description: "图片资源"},
|
||||
{Name: "音频", Description: "音频文件"},
|
||||
{Name: "电影", Description: "电影"},
|
||||
{Name: "电视剧", Description: "电视剧"},
|
||||
{Name: "短剧", Description: "短剧"},
|
||||
{Name: "综艺", Description: "综艺"},
|
||||
{Name: "动漫", Description: "动漫"},
|
||||
{Name: "纪录片", Description: "纪录片"},
|
||||
{Name: "视频教程", Description: "视频教程"},
|
||||
{Name: "学习资料", Description: "学习资料"},
|
||||
{Name: "游戏", Description: "其他游戏资源"},
|
||||
{Name: "软件", Description: "软件"},
|
||||
{Name: "APP", Description: "APP"},
|
||||
{Name: "AI", Description: "AI"},
|
||||
{Name: "其他", Description: "其他资源"},
|
||||
}
|
||||
|
||||
@@ -194,6 +242,32 @@ func insertDefaultDataIfEmpty() error {
|
||||
}
|
||||
}
|
||||
|
||||
// 插入默认系统配置
|
||||
defaultSystemConfigs := []entity.SystemConfig{
|
||||
{Key: entity.ConfigKeySiteTitle, Value: entity.ConfigDefaultSiteTitle, Type: entity.ConfigTypeString},
|
||||
{Key: entity.ConfigKeySiteDescription, Value: entity.ConfigDefaultSiteDescription, Type: entity.ConfigTypeString},
|
||||
{Key: entity.ConfigKeyKeywords, Value: entity.ConfigDefaultKeywords, Type: entity.ConfigTypeString},
|
||||
{Key: entity.ConfigKeyAuthor, Value: entity.ConfigDefaultAuthor, Type: entity.ConfigTypeString},
|
||||
{Key: entity.ConfigKeyCopyright, Value: entity.ConfigDefaultCopyright, Type: entity.ConfigTypeString},
|
||||
{Key: entity.ConfigKeyAutoProcessReadyResources, Value: entity.ConfigDefaultAutoProcessReadyResources, Type: entity.ConfigTypeBool},
|
||||
{Key: entity.ConfigKeyAutoProcessInterval, Value: entity.ConfigDefaultAutoProcessInterval, Type: entity.ConfigTypeInt},
|
||||
{Key: entity.ConfigKeyAutoTransferEnabled, Value: entity.ConfigDefaultAutoTransferEnabled, Type: entity.ConfigTypeBool},
|
||||
{Key: entity.ConfigKeyAutoTransferLimitDays, Value: entity.ConfigDefaultAutoTransferLimitDays, Type: entity.ConfigTypeInt},
|
||||
{Key: entity.ConfigKeyAutoTransferMinSpace, Value: entity.ConfigDefaultAutoTransferMinSpace, Type: entity.ConfigTypeInt},
|
||||
{Key: entity.ConfigKeyAutoFetchHotDramaEnabled, Value: entity.ConfigDefaultAutoFetchHotDramaEnabled, Type: entity.ConfigTypeBool},
|
||||
{Key: entity.ConfigKeyApiToken, Value: entity.ConfigDefaultApiToken, Type: entity.ConfigTypeString},
|
||||
{Key: entity.ConfigKeyForbiddenWords, Value: entity.ConfigDefaultForbiddenWords, Type: entity.ConfigTypeString},
|
||||
{Key: entity.ConfigKeyPageSize, Value: entity.ConfigDefaultPageSize, Type: entity.ConfigTypeInt},
|
||||
{Key: entity.ConfigKeyMaintenanceMode, Value: entity.ConfigDefaultMaintenanceMode, Type: entity.ConfigTypeBool},
|
||||
}
|
||||
|
||||
for _, config := range defaultSystemConfigs {
|
||||
if err := DB.Where("key = ?", config.Key).FirstOrCreate(&config).Error; err != nil {
|
||||
utils.Error("插入系统配置 %s 失败: %v", config.Key, err)
|
||||
// 继续执行,不因为单个配置失败而停止
|
||||
}
|
||||
}
|
||||
|
||||
// 插入默认管理员用户
|
||||
defaultAdmin := entity.User{
|
||||
Username: "admin",
|
||||
|
||||
@@ -1,9 +1,10 @@
|
||||
package converter
|
||||
|
||||
import (
|
||||
"time"
|
||||
|
||||
"github.com/ctwj/urldb/db/dto"
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/gin-gonic/gin"
|
||||
)
|
||||
|
||||
// ToResourceResponse 将Resource实体转换为ResourceResponse
|
||||
@@ -14,7 +15,7 @@ func ToResourceResponse(resource *entity.Resource) dto.ResourceResponse {
|
||||
Description: resource.Description,
|
||||
URL: resource.URL,
|
||||
PanID: resource.PanID,
|
||||
QuarkURL: resource.QuarkURL,
|
||||
SaveURL: resource.SaveURL,
|
||||
FileSize: resource.FileSize,
|
||||
CategoryID: resource.CategoryID,
|
||||
ViewCount: resource.ViewCount,
|
||||
@@ -170,17 +171,28 @@ func ToCksResponseList(cksList []entity.Cks) []dto.CksResponse {
|
||||
|
||||
// ToReadyResourceResponse 将ReadyResource实体转换为ReadyResourceResponse
|
||||
func ToReadyResourceResponse(resource *entity.ReadyResource) dto.ReadyResourceResponse {
|
||||
isDeleted := !resource.DeletedAt.Time.IsZero()
|
||||
var deletedAt *time.Time
|
||||
if isDeleted {
|
||||
deletedAt = &resource.DeletedAt.Time
|
||||
}
|
||||
|
||||
return dto.ReadyResourceResponse{
|
||||
ID: resource.ID,
|
||||
Title: resource.Title,
|
||||
URL: resource.URL,
|
||||
Category: resource.Category,
|
||||
Tags: resource.Tags,
|
||||
Img: resource.Img,
|
||||
Source: resource.Source,
|
||||
Extra: resource.Extra,
|
||||
CreateTime: resource.CreateTime,
|
||||
IP: resource.IP,
|
||||
ID: resource.ID,
|
||||
Title: resource.Title,
|
||||
Description: resource.Description,
|
||||
URL: resource.URL,
|
||||
Category: resource.Category,
|
||||
Tags: resource.Tags,
|
||||
Img: resource.Img,
|
||||
Source: resource.Source,
|
||||
Extra: resource.Extra,
|
||||
Key: resource.Key,
|
||||
ErrorMsg: resource.ErrorMsg,
|
||||
CreateTime: resource.CreateTime,
|
||||
IP: resource.IP,
|
||||
DeletedAt: deletedAt,
|
||||
IsDeleted: isDeleted,
|
||||
}
|
||||
}
|
||||
|
||||
@@ -194,41 +206,20 @@ func ToReadyResourceResponseList(resources []entity.ReadyResource) []dto.ReadyRe
|
||||
}
|
||||
|
||||
// RequestToReadyResource 将ReadyResourceRequest转换为ReadyResource实体
|
||||
func RequestToReadyResource(req *dto.ReadyResourceRequest) *entity.ReadyResource {
|
||||
if req == nil {
|
||||
return nil
|
||||
}
|
||||
// func RequestToReadyResource(req *dto.ReadyResourceRequest) *entity.ReadyResource {
|
||||
// if req == nil {
|
||||
// return nil
|
||||
// }
|
||||
|
||||
return &entity.ReadyResource{
|
||||
Title: &req.Title,
|
||||
Description: req.Description,
|
||||
URL: req.Url,
|
||||
Category: req.Category,
|
||||
Tags: req.Tags,
|
||||
Img: req.Img,
|
||||
Source: req.Source,
|
||||
Extra: req.Extra,
|
||||
}
|
||||
}
|
||||
|
||||
// SystemConfigToPublicResponse 返回不含 api_token 的系统配置响应
|
||||
func SystemConfigToPublicResponse(config *entity.SystemConfig) gin.H {
|
||||
return gin.H{
|
||||
"id": config.ID,
|
||||
"created_at": config.CreatedAt.Format("2006-01-02 15:04:05"),
|
||||
"updated_at": config.UpdatedAt.Format("2006-01-02 15:04:05"),
|
||||
"site_title": config.SiteTitle,
|
||||
"site_description": config.SiteDescription,
|
||||
"keywords": config.Keywords,
|
||||
"author": config.Author,
|
||||
"copyright": config.Copyright,
|
||||
"auto_process_ready_resources": config.AutoProcessReadyResources,
|
||||
"auto_process_interval": config.AutoProcessInterval,
|
||||
"auto_transfer_enabled": config.AutoTransferEnabled,
|
||||
"auto_transfer_limit_days": config.AutoTransferLimitDays,
|
||||
"auto_transfer_min_space": config.AutoTransferMinSpace,
|
||||
"auto_fetch_hot_drama_enabled": config.AutoFetchHotDramaEnabled,
|
||||
"page_size": config.PageSize,
|
||||
"maintenance_mode": config.MaintenanceMode,
|
||||
}
|
||||
}
|
||||
// return &entity.ReadyResource{
|
||||
// Title: &req.Title,
|
||||
// Description: req.Description,
|
||||
// URL: req.Url,
|
||||
// Category: req.Category,
|
||||
// Tags: req.Tags,
|
||||
// Img: req.Img,
|
||||
// Source: req.Source,
|
||||
// Extra: req.Extra,
|
||||
// Key: req.Key,
|
||||
// }
|
||||
// }
|
||||
|
||||
@@ -1,74 +1,250 @@
|
||||
package converter
|
||||
|
||||
import (
|
||||
"strconv"
|
||||
"time"
|
||||
|
||||
"github.com/ctwj/urldb/db/dto"
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
)
|
||||
|
||||
// SystemConfigToResponse 将系统配置实体转换为响应DTO
|
||||
func SystemConfigToResponse(config *entity.SystemConfig) *dto.SystemConfigResponse {
|
||||
if config == nil {
|
||||
return nil
|
||||
// SystemConfigToResponse 将系统配置实体列表转换为响应DTO
|
||||
func SystemConfigToResponse(configs []entity.SystemConfig) *dto.SystemConfigResponse {
|
||||
if len(configs) == 0 {
|
||||
return getDefaultConfigResponse()
|
||||
}
|
||||
|
||||
return &dto.SystemConfigResponse{
|
||||
ID: config.ID,
|
||||
CreatedAt: config.CreatedAt.Format(time.RFC3339),
|
||||
UpdatedAt: config.UpdatedAt.Format(time.RFC3339),
|
||||
response := getDefaultConfigResponse()
|
||||
|
||||
// SEO 配置
|
||||
SiteTitle: config.SiteTitle,
|
||||
SiteDescription: config.SiteDescription,
|
||||
Keywords: config.Keywords,
|
||||
Author: config.Author,
|
||||
Copyright: config.Copyright,
|
||||
|
||||
// 自动处理配置组
|
||||
AutoProcessReadyResources: config.AutoProcessReadyResources,
|
||||
AutoProcessInterval: config.AutoProcessInterval,
|
||||
AutoTransferEnabled: config.AutoTransferEnabled,
|
||||
AutoTransferLimitDays: config.AutoTransferLimitDays,
|
||||
AutoTransferMinSpace: config.AutoTransferMinSpace,
|
||||
AutoFetchHotDramaEnabled: config.AutoFetchHotDramaEnabled,
|
||||
|
||||
// API配置
|
||||
ApiToken: config.ApiToken,
|
||||
|
||||
// 其他配置
|
||||
PageSize: config.PageSize,
|
||||
MaintenanceMode: config.MaintenanceMode,
|
||||
// 将键值对转换为结构体
|
||||
for _, config := range configs {
|
||||
switch config.Key {
|
||||
case entity.ConfigKeySiteTitle:
|
||||
response.SiteTitle = config.Value
|
||||
case entity.ConfigKeySiteDescription:
|
||||
response.SiteDescription = config.Value
|
||||
case entity.ConfigKeyKeywords:
|
||||
response.Keywords = config.Value
|
||||
case entity.ConfigKeyAuthor:
|
||||
response.Author = config.Value
|
||||
case entity.ConfigKeyCopyright:
|
||||
response.Copyright = config.Value
|
||||
case entity.ConfigKeyAutoProcessReadyResources:
|
||||
if val, err := strconv.ParseBool(config.Value); err == nil {
|
||||
response.AutoProcessReadyResources = val
|
||||
}
|
||||
case entity.ConfigKeyAutoProcessInterval:
|
||||
if val, err := strconv.Atoi(config.Value); err == nil {
|
||||
response.AutoProcessInterval = val
|
||||
}
|
||||
case entity.ConfigKeyAutoTransferEnabled:
|
||||
if val, err := strconv.ParseBool(config.Value); err == nil {
|
||||
response.AutoTransferEnabled = val
|
||||
}
|
||||
case entity.ConfigKeyAutoTransferLimitDays:
|
||||
if val, err := strconv.Atoi(config.Value); err == nil {
|
||||
response.AutoTransferLimitDays = val
|
||||
}
|
||||
case entity.ConfigKeyAutoTransferMinSpace:
|
||||
if val, err := strconv.Atoi(config.Value); err == nil {
|
||||
response.AutoTransferMinSpace = val
|
||||
}
|
||||
case entity.ConfigKeyAutoFetchHotDramaEnabled:
|
||||
if val, err := strconv.ParseBool(config.Value); err == nil {
|
||||
response.AutoFetchHotDramaEnabled = val
|
||||
}
|
||||
case entity.ConfigKeyApiToken:
|
||||
response.ApiToken = config.Value
|
||||
case entity.ConfigKeyForbiddenWords:
|
||||
response.ForbiddenWords = config.Value
|
||||
case entity.ConfigKeyPageSize:
|
||||
if val, err := strconv.Atoi(config.Value); err == nil {
|
||||
response.PageSize = val
|
||||
}
|
||||
case entity.ConfigKeyMaintenanceMode:
|
||||
if val, err := strconv.ParseBool(config.Value); err == nil {
|
||||
response.MaintenanceMode = val
|
||||
}
|
||||
case entity.ConfigKeyEnableRegister:
|
||||
if val, err := strconv.ParseBool(config.Value); err == nil {
|
||||
response.EnableRegister = val
|
||||
}
|
||||
case entity.ConfigKeyThirdPartyStatsCode:
|
||||
response.ThirdPartyStatsCode = config.Value
|
||||
}
|
||||
}
|
||||
|
||||
// 设置时间戳(使用第一个配置的时间)
|
||||
if len(configs) > 0 {
|
||||
response.CreatedAt = configs[0].CreatedAt.Format(time.RFC3339)
|
||||
response.UpdatedAt = configs[0].UpdatedAt.Format(time.RFC3339)
|
||||
}
|
||||
|
||||
return response
|
||||
}
|
||||
|
||||
// RequestToSystemConfig 将请求DTO转换为系统配置实体
|
||||
func RequestToSystemConfig(req *dto.SystemConfigRequest) *entity.SystemConfig {
|
||||
// RequestToSystemConfig 将请求DTO转换为系统配置实体列表
|
||||
func RequestToSystemConfig(req *dto.SystemConfigRequest) []entity.SystemConfig {
|
||||
if req == nil {
|
||||
return nil
|
||||
}
|
||||
|
||||
return &entity.SystemConfig{
|
||||
// SEO 配置
|
||||
SiteTitle: req.SiteTitle,
|
||||
SiteDescription: req.SiteDescription,
|
||||
Keywords: req.Keywords,
|
||||
Author: req.Author,
|
||||
Copyright: req.Copyright,
|
||||
var configs []entity.SystemConfig
|
||||
|
||||
// 自动处理配置组
|
||||
AutoProcessReadyResources: req.AutoProcessReadyResources,
|
||||
AutoProcessInterval: req.AutoProcessInterval,
|
||||
AutoTransferEnabled: req.AutoTransferEnabled,
|
||||
AutoTransferLimitDays: req.AutoTransferLimitDays,
|
||||
AutoTransferMinSpace: req.AutoTransferMinSpace,
|
||||
AutoFetchHotDramaEnabled: req.AutoFetchHotDramaEnabled,
|
||||
// 只添加有值的字段
|
||||
if req.SiteTitle != "" {
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeySiteTitle, Value: req.SiteTitle, Type: entity.ConfigTypeString})
|
||||
}
|
||||
if req.SiteDescription != "" {
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeySiteDescription, Value: req.SiteDescription, Type: entity.ConfigTypeString})
|
||||
}
|
||||
if req.Keywords != "" {
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyKeywords, Value: req.Keywords, Type: entity.ConfigTypeString})
|
||||
}
|
||||
if req.Author != "" {
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyAuthor, Value: req.Author, Type: entity.ConfigTypeString})
|
||||
}
|
||||
if req.Copyright != "" {
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyCopyright, Value: req.Copyright, Type: entity.ConfigTypeString})
|
||||
}
|
||||
if req.ApiToken != "" {
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyApiToken, Value: req.ApiToken, Type: entity.ConfigTypeString})
|
||||
}
|
||||
if req.ForbiddenWords != "" {
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyForbiddenWords, Value: req.ForbiddenWords, Type: entity.ConfigTypeString})
|
||||
}
|
||||
|
||||
// API配置
|
||||
ApiToken: req.ApiToken,
|
||||
// 布尔值字段 - 只处理实际提交的字段
|
||||
// 注意:由于 Go 的零值机制,我们需要通过其他方式判断字段是否被提交
|
||||
// 这里暂时保持原样,但建议前端只提交有变化的字段
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyAutoProcessReadyResources, Value: strconv.FormatBool(req.AutoProcessReadyResources), Type: entity.ConfigTypeBool})
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyAutoTransferEnabled, Value: strconv.FormatBool(req.AutoTransferEnabled), Type: entity.ConfigTypeBool})
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyAutoFetchHotDramaEnabled, Value: strconv.FormatBool(req.AutoFetchHotDramaEnabled), Type: entity.ConfigTypeBool})
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyMaintenanceMode, Value: strconv.FormatBool(req.MaintenanceMode), Type: entity.ConfigTypeBool})
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyEnableRegister, Value: strconv.FormatBool(req.EnableRegister), Type: entity.ConfigTypeBool})
|
||||
|
||||
// 其他配置
|
||||
PageSize: req.PageSize,
|
||||
MaintenanceMode: req.MaintenanceMode,
|
||||
// 整数字段 - 添加所有提交的字段,包括0值
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyAutoProcessInterval, Value: strconv.Itoa(req.AutoProcessInterval), Type: entity.ConfigTypeInt})
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyAutoTransferLimitDays, Value: strconv.Itoa(req.AutoTransferLimitDays), Type: entity.ConfigTypeInt})
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyAutoTransferMinSpace, Value: strconv.Itoa(req.AutoTransferMinSpace), Type: entity.ConfigTypeInt})
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyPageSize, Value: strconv.Itoa(req.PageSize), Type: entity.ConfigTypeInt})
|
||||
|
||||
// 三方统计配置
|
||||
if req.ThirdPartyStatsCode != "" {
|
||||
configs = append(configs, entity.SystemConfig{Key: entity.ConfigKeyThirdPartyStatsCode, Value: req.ThirdPartyStatsCode, Type: entity.ConfigTypeString})
|
||||
}
|
||||
|
||||
return configs
|
||||
}
|
||||
|
||||
// SystemConfigToPublicResponse 返回不含 api_token 的系统配置响应
|
||||
func SystemConfigToPublicResponse(configs []entity.SystemConfig) map[string]interface{} {
|
||||
response := map[string]interface{}{
|
||||
entity.ConfigResponseFieldID: 0,
|
||||
entity.ConfigResponseFieldCreatedAt: utils.GetCurrentTimeString(),
|
||||
entity.ConfigResponseFieldUpdatedAt: utils.GetCurrentTimeString(),
|
||||
entity.ConfigResponseFieldSiteTitle: entity.ConfigDefaultSiteTitle,
|
||||
entity.ConfigResponseFieldSiteDescription: entity.ConfigDefaultSiteDescription,
|
||||
entity.ConfigResponseFieldKeywords: entity.ConfigDefaultKeywords,
|
||||
entity.ConfigResponseFieldAuthor: entity.ConfigDefaultAuthor,
|
||||
entity.ConfigResponseFieldCopyright: entity.ConfigDefaultCopyright,
|
||||
entity.ConfigResponseFieldAutoProcessReadyResources: false,
|
||||
entity.ConfigResponseFieldAutoProcessInterval: 30,
|
||||
entity.ConfigResponseFieldAutoTransferEnabled: false,
|
||||
entity.ConfigResponseFieldAutoTransferLimitDays: 0,
|
||||
entity.ConfigResponseFieldAutoTransferMinSpace: 100,
|
||||
entity.ConfigResponseFieldAutoFetchHotDramaEnabled: false,
|
||||
entity.ConfigResponseFieldForbiddenWords: "",
|
||||
entity.ConfigResponseFieldPageSize: 100,
|
||||
entity.ConfigResponseFieldMaintenanceMode: false,
|
||||
entity.ConfigResponseFieldEnableRegister: true, // 默认开启注册功能
|
||||
}
|
||||
|
||||
// 将键值对转换为map
|
||||
for _, config := range configs {
|
||||
switch config.Key {
|
||||
case entity.ConfigKeySiteTitle:
|
||||
response[entity.ConfigResponseFieldSiteTitle] = config.Value
|
||||
case entity.ConfigKeySiteDescription:
|
||||
response[entity.ConfigResponseFieldSiteDescription] = config.Value
|
||||
case entity.ConfigKeyKeywords:
|
||||
response[entity.ConfigResponseFieldKeywords] = config.Value
|
||||
case entity.ConfigKeyAuthor:
|
||||
response[entity.ConfigResponseFieldAuthor] = config.Value
|
||||
case entity.ConfigKeyCopyright:
|
||||
response[entity.ConfigResponseFieldCopyright] = config.Value
|
||||
case entity.ConfigKeyAutoProcessReadyResources:
|
||||
if val, err := strconv.ParseBool(config.Value); err == nil {
|
||||
response[entity.ConfigResponseFieldAutoProcessReadyResources] = val
|
||||
}
|
||||
case entity.ConfigKeyAutoProcessInterval:
|
||||
if val, err := strconv.Atoi(config.Value); err == nil {
|
||||
response[entity.ConfigResponseFieldAutoProcessInterval] = val
|
||||
}
|
||||
case entity.ConfigKeyAutoTransferEnabled:
|
||||
if val, err := strconv.ParseBool(config.Value); err == nil {
|
||||
response[entity.ConfigResponseFieldAutoTransferEnabled] = val
|
||||
}
|
||||
case entity.ConfigKeyAutoTransferLimitDays:
|
||||
if val, err := strconv.Atoi(config.Value); err == nil {
|
||||
response[entity.ConfigResponseFieldAutoTransferLimitDays] = val
|
||||
}
|
||||
case entity.ConfigKeyAutoTransferMinSpace:
|
||||
if val, err := strconv.Atoi(config.Value); err == nil {
|
||||
response[entity.ConfigResponseFieldAutoTransferMinSpace] = val
|
||||
}
|
||||
case entity.ConfigKeyAutoFetchHotDramaEnabled:
|
||||
if val, err := strconv.ParseBool(config.Value); err == nil {
|
||||
response[entity.ConfigResponseFieldAutoFetchHotDramaEnabled] = val
|
||||
}
|
||||
case entity.ConfigKeyForbiddenWords:
|
||||
response[entity.ConfigResponseFieldForbiddenWords] = config.Value
|
||||
case entity.ConfigKeyPageSize:
|
||||
if val, err := strconv.Atoi(config.Value); err == nil {
|
||||
response[entity.ConfigResponseFieldPageSize] = val
|
||||
}
|
||||
case entity.ConfigKeyMaintenanceMode:
|
||||
if val, err := strconv.ParseBool(config.Value); err == nil {
|
||||
response[entity.ConfigResponseFieldMaintenanceMode] = val
|
||||
}
|
||||
case entity.ConfigKeyEnableRegister:
|
||||
if val, err := strconv.ParseBool(config.Value); err == nil {
|
||||
response[entity.ConfigResponseFieldEnableRegister] = val
|
||||
}
|
||||
case entity.ConfigKeyThirdPartyStatsCode:
|
||||
response[entity.ConfigResponseFieldThirdPartyStatsCode] = config.Value
|
||||
}
|
||||
}
|
||||
|
||||
// 设置时间戳(使用第一个配置的时间)
|
||||
if len(configs) > 0 {
|
||||
response[entity.ConfigResponseFieldCreatedAt] = configs[0].CreatedAt.Format(utils.TimeFormatDateTime)
|
||||
response[entity.ConfigResponseFieldUpdatedAt] = configs[0].UpdatedAt.Format(utils.TimeFormatDateTime)
|
||||
}
|
||||
|
||||
return response
|
||||
}
|
||||
|
||||
// getDefaultConfigResponse 获取默认配置响应
|
||||
func getDefaultConfigResponse() *dto.SystemConfigResponse {
|
||||
return &dto.SystemConfigResponse{
|
||||
SiteTitle: entity.ConfigDefaultSiteTitle,
|
||||
SiteDescription: entity.ConfigDefaultSiteDescription,
|
||||
Keywords: entity.ConfigDefaultKeywords,
|
||||
Author: entity.ConfigDefaultAuthor,
|
||||
Copyright: entity.ConfigDefaultCopyright,
|
||||
AutoProcessReadyResources: false,
|
||||
AutoProcessInterval: 30,
|
||||
AutoTransferEnabled: false,
|
||||
AutoTransferLimitDays: 0,
|
||||
AutoTransferMinSpace: 100,
|
||||
AutoFetchHotDramaEnabled: false,
|
||||
ApiToken: entity.ConfigDefaultApiToken,
|
||||
ForbiddenWords: entity.ConfigDefaultForbiddenWords,
|
||||
PageSize: 100,
|
||||
MaintenanceMode: false,
|
||||
EnableRegister: true, // 默认开启注册功能
|
||||
ThirdPartyStatsCode: entity.ConfigDefaultThirdPartyStatsCode,
|
||||
}
|
||||
}
|
||||
|
||||
@@ -2,14 +2,15 @@ package dto
|
||||
|
||||
// ReadyResourceRequest 待处理资源请求
|
||||
type ReadyResourceRequest struct {
|
||||
Title string `json:"title" validate:"required" example:"示例资源标题"`
|
||||
Description string `json:"description" example:"这是一个示例资源描述"`
|
||||
Url string `json:"url" validate:"required" example:"https://example.com/resource"`
|
||||
Category string `json:"category" example:"示例分类"`
|
||||
Tags string `json:"tags" example:"标签1,标签2"`
|
||||
Img string `json:"img" example:"https://example.com/image.jpg"`
|
||||
Source string `json:"source" example:"数据来源"`
|
||||
Extra string `json:"extra" example:"额外信息"`
|
||||
Title string `json:"title" validate:"required" example:"示例资源标题"`
|
||||
Description string `json:"description" example:"这是一个示例资源描述"`
|
||||
Url []string `json:"url" validate:"required" example:"https://example.com/resource"`
|
||||
Category string `json:"category" example:"示例分类"`
|
||||
Tags string `json:"tags" example:"标签1,标签2"`
|
||||
Img string `json:"img" example:"https://example.com/image.jpg"`
|
||||
Source string `json:"source" example:"数据来源"`
|
||||
Extra string `json:"extra" example:"额外信息"`
|
||||
ErrorMsg string `json:"error_msg" example:"错误信息"`
|
||||
}
|
||||
|
||||
// BatchReadyResourceRequest 批量待处理资源请求
|
||||
|
||||
@@ -52,7 +52,7 @@ type CreateResourceRequest struct {
|
||||
Description string `json:"description"`
|
||||
URL string `json:"url"`
|
||||
PanID *uint `json:"pan_id"`
|
||||
QuarkURL string `json:"quark_url"`
|
||||
SaveURL string `json:"save_url"`
|
||||
FileSize string `json:"file_size"`
|
||||
CategoryID *uint `json:"category_id"`
|
||||
IsValid bool `json:"is_valid"`
|
||||
@@ -69,7 +69,7 @@ type UpdateResourceRequest struct {
|
||||
Description string `json:"description"`
|
||||
URL string `json:"url"`
|
||||
PanID *uint `json:"pan_id"`
|
||||
QuarkURL string `json:"quark_url"`
|
||||
SaveURL string `json:"save_url"`
|
||||
FileSize string `json:"file_size"`
|
||||
CategoryID *uint `json:"category_id"`
|
||||
IsValid bool `json:"is_valid"`
|
||||
@@ -108,15 +108,16 @@ type UpdateTagRequest struct {
|
||||
|
||||
// CreateReadyResourceRequest 创建待处理资源请求
|
||||
type CreateReadyResourceRequest struct {
|
||||
Title *string `json:"title"`
|
||||
Description string `json:"description"`
|
||||
URL string `json:"url" binding:"required"`
|
||||
Category string `json:"category"`
|
||||
Tags string `json:"tags"`
|
||||
Img string `json:"img"`
|
||||
Source string `json:"source"`
|
||||
Extra string `json:"extra"`
|
||||
IP *string `json:"ip"`
|
||||
Title *string `json:"title"`
|
||||
Description string `json:"description"`
|
||||
URL []string `json:"url" binding:"required"`
|
||||
Category string `json:"category"`
|
||||
Tags string `json:"tags"`
|
||||
Img string `json:"img"`
|
||||
Source string `json:"source"`
|
||||
Extra string `json:"extra"`
|
||||
IP *string `json:"ip"`
|
||||
Key string `json:"key"`
|
||||
}
|
||||
|
||||
// BatchCreateReadyResourceRequest 批量创建待处理资源请求
|
||||
|
||||
@@ -17,7 +17,7 @@ type ResourceResponse struct {
|
||||
Description string `json:"description"`
|
||||
URL string `json:"url"`
|
||||
PanID *uint `json:"pan_id"`
|
||||
QuarkURL string `json:"quark_url"`
|
||||
SaveURL string `json:"save_url"`
|
||||
FileSize string `json:"file_size"`
|
||||
CategoryID *uint `json:"category_id"`
|
||||
CategoryName string `json:"category_name"`
|
||||
@@ -79,17 +79,21 @@ type CksResponse struct {
|
||||
|
||||
// ReadyResourceResponse 待处理资源响应
|
||||
type ReadyResourceResponse struct {
|
||||
ID uint `json:"id"`
|
||||
Title *string `json:"title"`
|
||||
Description string `json:"description"`
|
||||
URL string `json:"url"`
|
||||
Category string `json:"category"`
|
||||
Tags string `json:"tags"`
|
||||
Img string `json:"img"`
|
||||
Source string `json:"source"`
|
||||
Extra string `json:"extra"`
|
||||
CreateTime time.Time `json:"create_time"`
|
||||
IP *string `json:"ip"`
|
||||
ID uint `json:"id"`
|
||||
Title *string `json:"title"`
|
||||
Description string `json:"description"`
|
||||
URL string `json:"url"`
|
||||
Category string `json:"category"`
|
||||
Tags string `json:"tags"`
|
||||
Img string `json:"img"`
|
||||
Source string `json:"source"`
|
||||
Extra string `json:"extra"`
|
||||
Key string `json:"key"`
|
||||
ErrorMsg string `json:"error_msg"`
|
||||
CreateTime time.Time `json:"create_time"`
|
||||
IP *string `json:"ip"`
|
||||
DeletedAt *time.Time `json:"deleted_at,omitempty"`
|
||||
IsDeleted bool `json:"is_deleted"`
|
||||
}
|
||||
|
||||
// Stats 统计信息
|
||||
|
||||
@@ -3,26 +3,33 @@ package dto
|
||||
// SystemConfigRequest 系统配置请求
|
||||
type SystemConfigRequest struct {
|
||||
// SEO 配置
|
||||
SiteTitle string `json:"site_title" validate:"required"`
|
||||
SiteTitle string `json:"site_title"`
|
||||
SiteDescription string `json:"site_description"`
|
||||
Keywords string `json:"keywords"`
|
||||
Author string `json:"author"`
|
||||
Copyright string `json:"copyright"`
|
||||
|
||||
// 自动处理配置组
|
||||
AutoProcessReadyResources bool `json:"auto_process_ready_resources"` // 自动处理待处理资源
|
||||
AutoProcessInterval int `json:"auto_process_interval" validate:"min=1,max=1440"` // 自动处理间隔(分钟)
|
||||
AutoTransferEnabled bool `json:"auto_transfer_enabled"` // 开启自动转存
|
||||
AutoTransferLimitDays int `json:"auto_transfer_limit_days" validate:"min=0,max=365"` // 自动转存限制天数(0表示不限制)
|
||||
AutoTransferMinSpace int `json:"auto_transfer_min_space" validate:"min=100,max=1024"` // 最小存储空间(GB)
|
||||
AutoFetchHotDramaEnabled bool `json:"auto_fetch_hot_drama_enabled"` // 自动拉取热播剧名字
|
||||
AutoProcessReadyResources bool `json:"auto_process_ready_resources"` // 自动处理待处理资源
|
||||
AutoProcessInterval int `json:"auto_process_interval"` // 自动处理间隔(分钟)
|
||||
AutoTransferEnabled bool `json:"auto_transfer_enabled"` // 开启自动转存
|
||||
AutoTransferLimitDays int `json:"auto_transfer_limit_days"` // 自动转存限制天数(0表示不限制)
|
||||
AutoTransferMinSpace int `json:"auto_transfer_min_space"` // 最小存储空间(GB)
|
||||
AutoFetchHotDramaEnabled bool `json:"auto_fetch_hot_drama_enabled"` // 自动拉取热播剧名字
|
||||
|
||||
// API配置
|
||||
ApiToken string `json:"api_token"` // 公开API访问令牌
|
||||
|
||||
// 违禁词配置
|
||||
ForbiddenWords string `json:"forbidden_words"` // 违禁词列表,用逗号分隔
|
||||
|
||||
// 其他配置
|
||||
PageSize int `json:"page_size" validate:"min=10,max=500"`
|
||||
PageSize int `json:"page_size"`
|
||||
MaintenanceMode bool `json:"maintenance_mode"`
|
||||
EnableRegister bool `json:"enable_register"` // 开启注册功能
|
||||
|
||||
// 三方统计配置
|
||||
ThirdPartyStatsCode string `json:"third_party_stats_code"` // 三方统计代码
|
||||
}
|
||||
|
||||
// SystemConfigResponse 系统配置响应
|
||||
@@ -49,7 +56,26 @@ type SystemConfigResponse struct {
|
||||
// API配置
|
||||
ApiToken string `json:"api_token"` // 公开API访问令牌
|
||||
|
||||
// 违禁词配置
|
||||
ForbiddenWords string `json:"forbidden_words"` // 违禁词列表,用逗号分隔
|
||||
|
||||
// 其他配置
|
||||
PageSize int `json:"page_size"`
|
||||
MaintenanceMode bool `json:"maintenance_mode"`
|
||||
EnableRegister bool `json:"enable_register"` // 开启注册功能
|
||||
|
||||
// 三方统计配置
|
||||
ThirdPartyStatsCode string `json:"third_party_stats_code"` // 三方统计代码
|
||||
}
|
||||
|
||||
// SystemConfigItem 单个配置项
|
||||
type SystemConfigItem struct {
|
||||
Key string `json:"key"`
|
||||
Value string `json:"value"`
|
||||
Type string `json:"type"`
|
||||
}
|
||||
|
||||
// SystemConfigListResponse 配置列表响应
|
||||
type SystemConfigListResponse struct {
|
||||
Configs []SystemConfigItem `json:"configs"`
|
||||
}
|
||||
|
||||
55
db/dto/task_config.go
Normal file
@@ -0,0 +1,55 @@
|
||||
package dto
|
||||
|
||||
import "fmt"
|
||||
|
||||
// BatchTransferTaskConfig 批量转存任务配置
|
||||
type BatchTransferTaskConfig struct {
|
||||
CategoryID *uint `json:"category_id"` // 默认分类ID
|
||||
TagIDs []uint `json:"tag_ids"` // 默认标签ID列表
|
||||
}
|
||||
|
||||
// TaskConfig 通用任务配置接口
|
||||
type TaskConfig interface {
|
||||
// Validate 验证配置有效性
|
||||
Validate() error
|
||||
}
|
||||
|
||||
// Validate 验证批量转存任务配置
|
||||
func (config BatchTransferTaskConfig) Validate() error {
|
||||
// 这里可以添加配置验证逻辑
|
||||
return nil
|
||||
}
|
||||
|
||||
// 示例:未来可能的其他任务类型配置
|
||||
|
||||
// DataSyncTaskConfig 数据同步任务配置(示例)
|
||||
type DataSyncTaskConfig struct {
|
||||
SourceType string `json:"source_type"` // 数据源类型
|
||||
TargetType string `json:"target_type"` // 目标类型
|
||||
SyncMode string `json:"sync_mode"` // 同步模式
|
||||
}
|
||||
|
||||
// Validate 验证数据同步任务配置
|
||||
func (config DataSyncTaskConfig) Validate() error {
|
||||
if config.SourceType == "" {
|
||||
return fmt.Errorf("数据源类型不能为空")
|
||||
}
|
||||
if config.TargetType == "" {
|
||||
return fmt.Errorf("目标类型不能为空")
|
||||
}
|
||||
return nil
|
||||
}
|
||||
|
||||
// CleanupTaskConfig 清理任务配置(示例)
|
||||
type CleanupTaskConfig struct {
|
||||
RetentionDays int `json:"retention_days"` // 保留天数
|
||||
CleanupType string `json:"cleanup_type"` // 清理类型
|
||||
}
|
||||
|
||||
// Validate 验证清理任务配置
|
||||
func (config CleanupTaskConfig) Validate() error {
|
||||
if config.RetentionDays < 0 {
|
||||
return fmt.Errorf("保留天数不能为负数")
|
||||
}
|
||||
return nil
|
||||
}
|
||||
56
db/dto/task_data.go
Normal file
@@ -0,0 +1,56 @@
|
||||
package dto
|
||||
|
||||
import "fmt"
|
||||
|
||||
// BatchTransferInputData 批量转存任务的输入数据
|
||||
type BatchTransferInputData struct {
|
||||
Title string `json:"title"` // 资源标题
|
||||
URL string `json:"url"` // 资源链接
|
||||
CategoryID *uint `json:"category_id"` // 分类ID
|
||||
TagIDs []uint `json:"tag_ids"` // 标签ID列表
|
||||
}
|
||||
|
||||
// BatchTransferOutputData 批量转存任务的输出数据
|
||||
type BatchTransferOutputData struct {
|
||||
ResourceID uint `json:"resource_id"` // 创建的资源ID
|
||||
SaveURL string `json:"save_url"` // 转存后的链接
|
||||
PlatformID uint `json:"platform_id"` // 平台ID
|
||||
}
|
||||
|
||||
// TaskItemData 通用任务项数据接口
|
||||
type TaskItemData interface {
|
||||
// GetDisplayName 获取显示名称(用于前端显示)
|
||||
GetDisplayName() string
|
||||
// Validate 验证数据有效性
|
||||
Validate() error
|
||||
}
|
||||
|
||||
// GetDisplayName 实现TaskItemData接口
|
||||
func (data BatchTransferInputData) GetDisplayName() string {
|
||||
return data.Title
|
||||
}
|
||||
|
||||
// Validate 验证批量转存输入数据
|
||||
func (data BatchTransferInputData) Validate() error {
|
||||
if data.Title == "" {
|
||||
return fmt.Errorf("标题不能为空")
|
||||
}
|
||||
if data.URL == "" {
|
||||
return fmt.Errorf("链接不能为空")
|
||||
}
|
||||
// 这里可以添加URL格式验证
|
||||
return nil
|
||||
}
|
||||
|
||||
// GetDisplayName 实现TaskItemData接口
|
||||
func (data BatchTransferOutputData) GetDisplayName() string {
|
||||
return fmt.Sprintf("ResourceID: %d", data.ResourceID)
|
||||
}
|
||||
|
||||
// Validate 验证批量转存输出数据
|
||||
func (data BatchTransferOutputData) Validate() error {
|
||||
if data.ResourceID == 0 {
|
||||
return fmt.Errorf("资源ID不能为空")
|
||||
}
|
||||
return nil
|
||||
}
|
||||
@@ -17,6 +17,8 @@ type ReadyResource struct {
|
||||
Img string `json:"img" gorm:"size:500;comment:封面链接"`
|
||||
Source string `json:"source" gorm:"size:100;comment:数据来源"`
|
||||
Extra string `json:"extra" gorm:"type:text;comment:额外附加数据"`
|
||||
Key string `json:"key" gorm:"size:64;index;comment:资源组标识,相同key表示同一组资源"`
|
||||
ErrorMsg string `json:"error_msg" gorm:"type:text;comment:处理失败时的错误信息"`
|
||||
CreateTime time.Time `json:"create_time" gorm:"default:CURRENT_TIMESTAMP"`
|
||||
IP *string `json:"ip" gorm:"size:45;comment:IP地址"`
|
||||
CreatedAt time.Time `json:"created_at"`
|
||||
|
||||
@@ -13,7 +13,7 @@ type Resource struct {
|
||||
Description string `json:"description" gorm:"type:text;comment:资源描述"`
|
||||
URL string `json:"url" gorm:"size:128;comment:资源链接"`
|
||||
PanID *uint `json:"pan_id" gorm:"comment:平台ID"`
|
||||
QuarkURL string `json:"quark_url" gorm:"size:500;comment:夸克链接"`
|
||||
SaveURL string `json:"save_url" gorm:"size:500;comment:转存后的链接"`
|
||||
FileSize string `json:"file_size" gorm:"size:100;comment:文件大小"`
|
||||
CategoryID *uint `json:"category_id" gorm:"comment:分类ID"`
|
||||
ViewCount int `json:"view_count" gorm:"default:0;comment:浏览次数"`
|
||||
@@ -25,6 +25,9 @@ type Resource struct {
|
||||
Cover string `json:"cover" gorm:"size:500;comment:封面"`
|
||||
Author string `json:"author" gorm:"size:100;comment:作者"`
|
||||
ErrorMsg string `json:"error_msg" gorm:"size:255;comment:转存失败原因"`
|
||||
CkID *uint `json:"ck_id" gorm:"comment:账号ID"`
|
||||
Fid string `json:"fid" gorm:"size:128;comment:网盘文件ID"`
|
||||
Key string `json:"key" gorm:"size:64;index;comment:资源组标识,相同key表示同一组资源"`
|
||||
|
||||
// 关联关系
|
||||
Category Category `json:"category" gorm:"foreignKey:CategoryID"`
|
||||
|
||||
25
db/entity/resource_view.go
Normal file
@@ -0,0 +1,25 @@
|
||||
package entity
|
||||
|
||||
import (
|
||||
"time"
|
||||
"gorm.io/gorm"
|
||||
)
|
||||
|
||||
// ResourceView 资源访问记录
|
||||
type ResourceView struct {
|
||||
ID uint `json:"id" gorm:"primaryKey;autoIncrement"`
|
||||
ResourceID uint `json:"resource_id" gorm:"not null;index;comment:资源ID"`
|
||||
IPAddress string `json:"ip_address" gorm:"size:45;comment:访问者IP地址"`
|
||||
UserAgent string `json:"user_agent" gorm:"type:text;comment:用户代理"`
|
||||
CreatedAt time.Time `json:"created_at" gorm:"autoCreateTime;comment:访问时间"`
|
||||
UpdatedAt time.Time `json:"updated_at" gorm:"autoUpdateTime"`
|
||||
DeletedAt gorm.DeletedAt `json:"deleted_at" gorm:"index"`
|
||||
|
||||
// 关联关系
|
||||
Resource Resource `json:"resource" gorm:"foreignKey:ResourceID"`
|
||||
}
|
||||
|
||||
// TableName 指定表名
|
||||
func (ResourceView) TableName() string {
|
||||
return "resource_views"
|
||||
}
|
||||
@@ -4,33 +4,16 @@ import (
|
||||
"time"
|
||||
)
|
||||
|
||||
// SystemConfig 系统配置实体
|
||||
// SystemConfig 系统配置实体(键值对形式)
|
||||
type SystemConfig struct {
|
||||
ID uint `json:"id" gorm:"primaryKey"`
|
||||
CreatedAt time.Time `json:"created_at"`
|
||||
UpdatedAt time.Time `json:"updated_at"`
|
||||
|
||||
// SEO 配置
|
||||
SiteTitle string `json:"site_title" gorm:"size:200;not null;default:'老九网盘资源数据库'"`
|
||||
SiteDescription string `json:"site_description" gorm:"size:500"`
|
||||
Keywords string `json:"keywords" gorm:"size:500"`
|
||||
Author string `json:"author" gorm:"size:100"`
|
||||
Copyright string `json:"copyright" gorm:"size:200"`
|
||||
|
||||
// 自动处理配置组
|
||||
AutoProcessReadyResources bool `json:"auto_process_ready_resources" gorm:"default:false"` // 自动处理待处理资源
|
||||
AutoProcessInterval int `json:"auto_process_interval" gorm:"default:30"` // 自动处理间隔(分钟)
|
||||
AutoTransferEnabled bool `json:"auto_transfer_enabled" gorm:"default:false"` // 开启自动转存
|
||||
AutoTransferLimitDays int `json:"auto_transfer_limit_days" gorm:"default:0"` // 自动转存限制天数(0表示不限制)
|
||||
AutoTransferMinSpace int `json:"auto_transfer_min_space" gorm:"default:100"` // 最小存储空间(GB)
|
||||
AutoFetchHotDramaEnabled bool `json:"auto_fetch_hot_drama_enabled" gorm:"default:false"` // 自动拉取热播剧名字
|
||||
|
||||
// API配置
|
||||
ApiToken string `json:"api_token" gorm:"size:100;uniqueIndex"` // 公开API访问令牌
|
||||
|
||||
// 其他配置
|
||||
PageSize int `json:"page_size" gorm:"default:100"`
|
||||
MaintenanceMode bool `json:"maintenance_mode" gorm:"default:false"`
|
||||
// 键值对配置
|
||||
Key string `json:"key" gorm:"size:100;not null;unique;comment:配置键"`
|
||||
Value string `json:"value" gorm:"type:text"`
|
||||
Type string `json:"type" gorm:"size:20;default:'string'"` // string, int, bool, json
|
||||
}
|
||||
|
||||
// TableName 指定表名
|
||||
|
||||
110
db/entity/system_config_constants.go
Normal file
@@ -0,0 +1,110 @@
|
||||
package entity
|
||||
|
||||
// ConfigKey 配置键常量
|
||||
const (
|
||||
// SEO 配置
|
||||
ConfigKeySiteTitle = "site_title"
|
||||
ConfigKeySiteDescription = "site_description"
|
||||
ConfigKeyKeywords = "keywords"
|
||||
ConfigKeyAuthor = "author"
|
||||
ConfigKeyCopyright = "copyright"
|
||||
|
||||
// 自动处理配置组
|
||||
ConfigKeyAutoProcessReadyResources = "auto_process_ready_resources"
|
||||
ConfigKeyAutoProcessInterval = "auto_process_interval"
|
||||
ConfigKeyAutoTransferEnabled = "auto_transfer_enabled"
|
||||
ConfigKeyAutoTransferLimitDays = "auto_transfer_limit_days"
|
||||
ConfigKeyAutoTransferMinSpace = "auto_transfer_min_space"
|
||||
ConfigKeyAutoFetchHotDramaEnabled = "auto_fetch_hot_drama_enabled"
|
||||
|
||||
// API配置
|
||||
ConfigKeyApiToken = "api_token"
|
||||
|
||||
// 违禁词配置
|
||||
ConfigKeyForbiddenWords = "forbidden_words"
|
||||
|
||||
// 其他配置
|
||||
ConfigKeyPageSize = "page_size"
|
||||
ConfigKeyMaintenanceMode = "maintenance_mode"
|
||||
ConfigKeyEnableRegister = "enable_register"
|
||||
|
||||
// 三方统计配置
|
||||
ConfigKeyThirdPartyStatsCode = "third_party_stats_code"
|
||||
)
|
||||
|
||||
// ConfigType 配置类型常量
|
||||
const (
|
||||
ConfigTypeString = "string"
|
||||
ConfigTypeInt = "int"
|
||||
ConfigTypeBool = "bool"
|
||||
ConfigTypeJSON = "json"
|
||||
)
|
||||
|
||||
// ConfigResponseField API响应字段名常量
|
||||
const (
|
||||
// 基础字段
|
||||
ConfigResponseFieldID = "id"
|
||||
ConfigResponseFieldCreatedAt = "created_at"
|
||||
ConfigResponseFieldUpdatedAt = "updated_at"
|
||||
|
||||
// SEO 配置字段
|
||||
ConfigResponseFieldSiteTitle = "site_title"
|
||||
ConfigResponseFieldSiteDescription = "site_description"
|
||||
ConfigResponseFieldKeywords = "keywords"
|
||||
ConfigResponseFieldAuthor = "author"
|
||||
ConfigResponseFieldCopyright = "copyright"
|
||||
|
||||
// 自动处理配置字段
|
||||
ConfigResponseFieldAutoProcessReadyResources = "auto_process_ready_resources"
|
||||
ConfigResponseFieldAutoProcessInterval = "auto_process_interval"
|
||||
ConfigResponseFieldAutoTransferEnabled = "auto_transfer_enabled"
|
||||
ConfigResponseFieldAutoTransferLimitDays = "auto_transfer_limit_days"
|
||||
ConfigResponseFieldAutoTransferMinSpace = "auto_transfer_min_space"
|
||||
ConfigResponseFieldAutoFetchHotDramaEnabled = "auto_fetch_hot_drama_enabled"
|
||||
|
||||
// API配置字段
|
||||
ConfigResponseFieldApiToken = "api_token"
|
||||
|
||||
// 违禁词配置字段
|
||||
ConfigResponseFieldForbiddenWords = "forbidden_words"
|
||||
|
||||
// 其他配置字段
|
||||
ConfigResponseFieldPageSize = "page_size"
|
||||
ConfigResponseFieldMaintenanceMode = "maintenance_mode"
|
||||
ConfigResponseFieldEnableRegister = "enable_register"
|
||||
|
||||
// 三方统计配置字段
|
||||
ConfigResponseFieldThirdPartyStatsCode = "third_party_stats_code"
|
||||
)
|
||||
|
||||
// ConfigDefaultValue 配置默认值常量
|
||||
const (
|
||||
// SEO 配置默认值
|
||||
ConfigDefaultSiteTitle = "老九网盘资源数据库"
|
||||
ConfigDefaultSiteDescription = "专业的老九网盘资源数据库"
|
||||
ConfigDefaultKeywords = "网盘,资源管理,文件分享"
|
||||
ConfigDefaultAuthor = "系统管理员"
|
||||
ConfigDefaultCopyright = "© 2024 老九网盘资源数据库"
|
||||
|
||||
// 自动处理配置默认值
|
||||
ConfigDefaultAutoProcessReadyResources = "false"
|
||||
ConfigDefaultAutoProcessInterval = "30"
|
||||
ConfigDefaultAutoTransferEnabled = "false"
|
||||
ConfigDefaultAutoTransferLimitDays = "0"
|
||||
ConfigDefaultAutoTransferMinSpace = "100"
|
||||
ConfigDefaultAutoFetchHotDramaEnabled = "false"
|
||||
|
||||
// API配置默认值
|
||||
ConfigDefaultApiToken = ""
|
||||
|
||||
// 违禁词配置默认值
|
||||
ConfigDefaultForbiddenWords = ""
|
||||
|
||||
// 其他配置默认值
|
||||
ConfigDefaultPageSize = "100"
|
||||
ConfigDefaultMaintenanceMode = "false"
|
||||
ConfigDefaultEnableRegister = "true"
|
||||
|
||||
// 三方统计配置默认值
|
||||
ConfigDefaultThirdPartyStatsCode = ""
|
||||
)
|
||||
62
db/entity/task.go
Normal file
@@ -0,0 +1,62 @@
|
||||
package entity
|
||||
|
||||
import (
|
||||
"time"
|
||||
|
||||
"gorm.io/gorm"
|
||||
)
|
||||
|
||||
// TaskStatus 任务状态
|
||||
type TaskStatus string
|
||||
|
||||
const (
|
||||
TaskStatusPending TaskStatus = "pending" // 等待中
|
||||
TaskStatusRunning TaskStatus = "running" // 运行中
|
||||
TaskStatusPaused TaskStatus = "paused" // 已暂停
|
||||
TaskStatusCompleted TaskStatus = "completed" // 已完成
|
||||
TaskStatusFailed TaskStatus = "failed" // 失败
|
||||
TaskStatusCancelled TaskStatus = "cancelled" // 已取消
|
||||
)
|
||||
|
||||
// TaskType 任务类型
|
||||
type TaskType string
|
||||
|
||||
const (
|
||||
TaskTypeBatchTransfer TaskType = "batch_transfer" // 批量转存
|
||||
)
|
||||
|
||||
// Task 任务表
|
||||
type Task struct {
|
||||
ID uint `json:"id" gorm:"primaryKey;autoIncrement"`
|
||||
Title string `json:"title" gorm:"size:255;not null;comment:任务标题"`
|
||||
Type TaskType `json:"type" gorm:"size:50;not null;comment:任务类型"`
|
||||
Status TaskStatus `json:"status" gorm:"size:20;not null;default:pending;comment:任务状态"`
|
||||
Description string `json:"description" gorm:"type:text;comment:任务描述"`
|
||||
|
||||
// 进度信息
|
||||
TotalItems int `json:"total_items" gorm:"not null;default:0;comment:总项目数"`
|
||||
ProcessedItems int `json:"processed_items" gorm:"not null;default:0;comment:已处理项目数"`
|
||||
SuccessItems int `json:"success_items" gorm:"not null;default:0;comment:成功项目数"`
|
||||
FailedItems int `json:"failed_items" gorm:"not null;default:0;comment:失败项目数"`
|
||||
|
||||
// 任务配置 (JSON格式存储)
|
||||
Config string `json:"config" gorm:"type:text;comment:任务配置"`
|
||||
|
||||
// 任务消息
|
||||
Message string `json:"message" gorm:"type:text;comment:任务消息"`
|
||||
|
||||
// 时间信息
|
||||
StartedAt *time.Time `json:"started_at" gorm:"comment:开始时间"`
|
||||
CompletedAt *time.Time `json:"completed_at" gorm:"comment:完成时间"`
|
||||
CreatedAt time.Time `json:"created_at" gorm:"autoCreateTime"`
|
||||
UpdatedAt time.Time `json:"updated_at" gorm:"autoUpdateTime"`
|
||||
DeletedAt gorm.DeletedAt `json:"deleted_at" gorm:"index"`
|
||||
|
||||
// 关联关系
|
||||
TaskItems []TaskItem `json:"task_items" gorm:"foreignKey:TaskID"`
|
||||
}
|
||||
|
||||
// TableName 指定表名
|
||||
func (Task) TableName() string {
|
||||
return "tasks"
|
||||
}
|
||||
51
db/entity/task_item.go
Normal file
@@ -0,0 +1,51 @@
|
||||
package entity
|
||||
|
||||
import (
|
||||
"time"
|
||||
|
||||
"gorm.io/gorm"
|
||||
)
|
||||
|
||||
// TaskItemStatus 任务项状态
|
||||
type TaskItemStatus string
|
||||
|
||||
const (
|
||||
TaskItemStatusPending TaskItemStatus = "pending" // 等待处理
|
||||
TaskItemStatusProcessing TaskItemStatus = "processing" // 处理中
|
||||
TaskItemStatusSuccess TaskItemStatus = "success" // 成功
|
||||
TaskItemStatusFailed TaskItemStatus = "failed" // 失败
|
||||
TaskItemStatusSkipped TaskItemStatus = "skipped" // 跳过
|
||||
)
|
||||
|
||||
// TaskItem 任务项表(任务的详细记录)
|
||||
type TaskItem struct {
|
||||
ID uint `json:"id" gorm:"primaryKey;autoIncrement"`
|
||||
TaskID uint `json:"task_id" gorm:"not null;index;comment:任务ID"`
|
||||
|
||||
// 通用任务项信息
|
||||
Status TaskItemStatus `json:"status" gorm:"size:20;not null;default:pending;comment:处理状态"`
|
||||
ErrorMessage string `json:"error_message" gorm:"type:text;comment:错误信息"`
|
||||
|
||||
// 输入数据 (JSON格式存储,支持不同任务类型的不同数据结构)
|
||||
InputData string `json:"input_data" gorm:"type:text;not null;comment:输入数据(JSON格式)"`
|
||||
|
||||
// 输出数据 (JSON格式存储,支持不同任务类型的不同结果数据)
|
||||
OutputData string `json:"output_data" gorm:"type:text;comment:输出数据(JSON格式)"`
|
||||
|
||||
// 处理日志 (可选,用于记录详细的处理过程)
|
||||
ProcessLog string `json:"process_log" gorm:"type:text;comment:处理日志"`
|
||||
|
||||
// 时间信息
|
||||
ProcessedAt *time.Time `json:"processed_at" gorm:"comment:处理时间"`
|
||||
CreatedAt time.Time `json:"created_at" gorm:"autoCreateTime"`
|
||||
UpdatedAt time.Time `json:"updated_at" gorm:"autoUpdateTime"`
|
||||
DeletedAt gorm.DeletedAt `json:"deleted_at" gorm:"index"`
|
||||
|
||||
// 关联关系
|
||||
Task Task `json:"task" gorm:"foreignKey:TaskID"`
|
||||
}
|
||||
|
||||
// TableName 指定表名
|
||||
func (TaskItem) TableName() string {
|
||||
return "task_items"
|
||||
}
|
||||
104
db/entity/task_item_helpers.go
Normal file
@@ -0,0 +1,104 @@
|
||||
package entity
|
||||
|
||||
import (
|
||||
"encoding/json"
|
||||
"fmt"
|
||||
|
||||
"github.com/ctwj/urldb/db/dto"
|
||||
)
|
||||
|
||||
// SetInputData 设置输入数据(将结构体转换为JSON字符串)
|
||||
func (item *TaskItem) SetInputData(data interface{}) error {
|
||||
jsonData, err := json.Marshal(data)
|
||||
if err != nil {
|
||||
return fmt.Errorf("序列化输入数据失败: %v", err)
|
||||
}
|
||||
item.InputData = string(jsonData)
|
||||
return nil
|
||||
}
|
||||
|
||||
// GetInputData 获取输入数据(根据任务类型解析JSON)
|
||||
func (item *TaskItem) GetInputData(taskType TaskType) (interface{}, error) {
|
||||
if item.InputData == "" {
|
||||
return nil, fmt.Errorf("输入数据为空")
|
||||
}
|
||||
|
||||
switch taskType {
|
||||
case TaskTypeBatchTransfer:
|
||||
var data dto.BatchTransferInputData
|
||||
err := json.Unmarshal([]byte(item.InputData), &data)
|
||||
if err != nil {
|
||||
return nil, fmt.Errorf("解析批量转存输入数据失败: %v", err)
|
||||
}
|
||||
return data, nil
|
||||
default:
|
||||
// 对于未知任务类型,返回原始JSON数据
|
||||
var data map[string]interface{}
|
||||
err := json.Unmarshal([]byte(item.InputData), &data)
|
||||
if err != nil {
|
||||
return nil, fmt.Errorf("解析输入数据失败: %v", err)
|
||||
}
|
||||
return data, nil
|
||||
}
|
||||
}
|
||||
|
||||
// SetOutputData 设置输出数据(将结构体转换为JSON字符串)
|
||||
func (item *TaskItem) SetOutputData(data interface{}) error {
|
||||
jsonData, err := json.Marshal(data)
|
||||
if err != nil {
|
||||
return fmt.Errorf("序列化输出数据失败: %v", err)
|
||||
}
|
||||
item.OutputData = string(jsonData)
|
||||
return nil
|
||||
}
|
||||
|
||||
// GetOutputData 获取输出数据(根据任务类型解析JSON)
|
||||
func (item *TaskItem) GetOutputData(taskType TaskType) (interface{}, error) {
|
||||
if item.OutputData == "" {
|
||||
return nil, fmt.Errorf("输出数据为空")
|
||||
}
|
||||
|
||||
switch taskType {
|
||||
case TaskTypeBatchTransfer:
|
||||
var data dto.BatchTransferOutputData
|
||||
err := json.Unmarshal([]byte(item.OutputData), &data)
|
||||
if err != nil {
|
||||
return nil, fmt.Errorf("解析批量转存输出数据失败: %v", err)
|
||||
}
|
||||
return data, nil
|
||||
default:
|
||||
// 对于未知任务类型,返回原始JSON数据
|
||||
var data map[string]interface{}
|
||||
err := json.Unmarshal([]byte(item.OutputData), &data)
|
||||
if err != nil {
|
||||
return nil, fmt.Errorf("解析输出数据失败: %v", err)
|
||||
}
|
||||
return data, nil
|
||||
}
|
||||
}
|
||||
|
||||
// GetDisplayName 获取显示名称(用于前端显示)
|
||||
func (item *TaskItem) GetDisplayName(taskType TaskType) string {
|
||||
inputData, err := item.GetInputData(taskType)
|
||||
if err != nil {
|
||||
return fmt.Sprintf("TaskItem#%d", item.ID)
|
||||
}
|
||||
|
||||
switch taskType {
|
||||
case TaskTypeBatchTransfer:
|
||||
if data, ok := inputData.(dto.BatchTransferInputData); ok {
|
||||
return data.Title
|
||||
}
|
||||
}
|
||||
|
||||
return fmt.Sprintf("TaskItem#%d", item.ID)
|
||||
}
|
||||
|
||||
// AddProcessLog 添加处理日志
|
||||
func (item *TaskItem) AddProcessLog(message string) {
|
||||
if item.ProcessLog == "" {
|
||||
item.ProcessLog = message
|
||||
} else {
|
||||
item.ProcessLog += "\n" + message
|
||||
}
|
||||
}
|
||||
1302
db/forbidden.txt
Normal file
@@ -10,6 +10,7 @@ import (
|
||||
type CategoryRepository interface {
|
||||
BaseRepository[entity.Category]
|
||||
FindByName(name string) (*entity.Category, error)
|
||||
FindByNameIncludingDeleted(name string) (*entity.Category, error)
|
||||
FindWithResources() ([]entity.Category, error)
|
||||
FindWithTags() ([]entity.Category, error)
|
||||
GetResourceCount(categoryID uint) (int64, error)
|
||||
@@ -17,6 +18,7 @@ type CategoryRepository interface {
|
||||
GetTagNames(categoryID uint) ([]string, error)
|
||||
FindWithPagination(page, pageSize int) ([]entity.Category, int64, error)
|
||||
Search(query string, page, pageSize int) ([]entity.Category, int64, error)
|
||||
RestoreDeletedCategory(id uint) error
|
||||
}
|
||||
|
||||
// CategoryRepositoryImpl Category的Repository实现
|
||||
@@ -41,6 +43,21 @@ func (r *CategoryRepositoryImpl) FindByName(name string) (*entity.Category, erro
|
||||
return &category, nil
|
||||
}
|
||||
|
||||
// FindByNameIncludingDeleted 根据名称查找(包括已删除的记录)
|
||||
func (r *CategoryRepositoryImpl) FindByNameIncludingDeleted(name string) (*entity.Category, error) {
|
||||
var category entity.Category
|
||||
err := r.db.Unscoped().Where("name = ?", name).First(&category).Error
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
return &category, nil
|
||||
}
|
||||
|
||||
// RestoreDeletedCategory 恢复已删除的分类
|
||||
func (r *CategoryRepositoryImpl) RestoreDeletedCategory(id uint) error {
|
||||
return r.db.Unscoped().Model(&entity.Category{}).Where("id = ?", id).Update("deleted_at", nil).Error
|
||||
}
|
||||
|
||||
// FindWithResources 查找包含资源的分类
|
||||
func (r *CategoryRepositoryImpl) FindWithResources() ([]entity.Category, error) {
|
||||
var categories []entity.Category
|
||||
|
||||
@@ -16,6 +16,9 @@ type RepositoryManager struct {
|
||||
SearchStatRepository SearchStatRepository
|
||||
SystemConfigRepository SystemConfigRepository
|
||||
HotDramaRepository HotDramaRepository
|
||||
ResourceViewRepository ResourceViewRepository
|
||||
TaskRepository TaskRepository
|
||||
TaskItemRepository TaskItemRepository
|
||||
}
|
||||
|
||||
// NewRepositoryManager 创建Repository管理器
|
||||
@@ -31,5 +34,8 @@ func NewRepositoryManager(db *gorm.DB) *RepositoryManager {
|
||||
SearchStatRepository: NewSearchStatRepository(db),
|
||||
SystemConfigRepository: NewSystemConfigRepository(db),
|
||||
HotDramaRepository: NewHotDramaRepository(db),
|
||||
ResourceViewRepository: NewResourceViewRepository(db),
|
||||
TaskRepository: NewTaskRepository(db),
|
||||
TaskItemRepository: NewTaskItemRepository(db),
|
||||
}
|
||||
}
|
||||
|
||||
@@ -5,6 +5,7 @@ import (
|
||||
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
|
||||
gonanoid "github.com/matoous/go-nanoid/v2"
|
||||
"gorm.io/gorm"
|
||||
)
|
||||
|
||||
@@ -13,10 +14,22 @@ type ReadyResourceRepository interface {
|
||||
BaseRepository[entity.ReadyResource]
|
||||
FindByURL(url string) (*entity.ReadyResource, error)
|
||||
FindByIP(ip string) ([]entity.ReadyResource, error)
|
||||
FindByKey(key string) ([]entity.ReadyResource, error)
|
||||
BatchCreate(resources []entity.ReadyResource) error
|
||||
DeleteByURL(url string) error
|
||||
DeleteByKey(key string) error
|
||||
FindAllWithinDays(days int) ([]entity.ReadyResource, error)
|
||||
BatchFindByURLs(urls []string) ([]entity.ReadyResource, error)
|
||||
GenerateUniqueKey() (string, error)
|
||||
FindWithErrors() ([]entity.ReadyResource, error)
|
||||
FindWithErrorsPaginated(page, limit int) ([]entity.ReadyResource, int64, error)
|
||||
FindWithErrorsIncludingDeleted() ([]entity.ReadyResource, error)
|
||||
FindWithErrorsPaginatedIncludingDeleted(page, limit int, errorFilter string) ([]entity.ReadyResource, int64, error)
|
||||
FindWithErrorsByQuery(errorFilter string) ([]entity.ReadyResource, error)
|
||||
FindWithoutErrors() ([]entity.ReadyResource, error)
|
||||
ClearErrorMsg(id uint) error
|
||||
ClearErrorMsgAndRestore(id uint) error
|
||||
ClearAllErrorsByQuery(errorFilter string) (int64, error) // 批量清除错误信息并真正删除资源
|
||||
}
|
||||
|
||||
// ReadyResourceRepositoryImpl ReadyResource的Repository实现
|
||||
@@ -78,3 +91,139 @@ func (r *ReadyResourceRepositoryImpl) BatchFindByURLs(urls []string) ([]entity.R
|
||||
err := r.db.Where("url IN ?", urls).Find(&resources).Error
|
||||
return resources, err
|
||||
}
|
||||
|
||||
// FindByKey 根据Key查找
|
||||
func (r *ReadyResourceRepositoryImpl) FindByKey(key string) ([]entity.ReadyResource, error) {
|
||||
var resources []entity.ReadyResource
|
||||
err := r.db.Where("key = ?", key).Find(&resources).Error
|
||||
return resources, err
|
||||
}
|
||||
|
||||
// DeleteByKey 根据Key删除
|
||||
func (r *ReadyResourceRepositoryImpl) DeleteByKey(key string) error {
|
||||
return r.db.Where("key = ?", key).Delete(&entity.ReadyResource{}).Error
|
||||
}
|
||||
|
||||
// GenerateUniqueKey 生成唯一的6位Base62 key
|
||||
func (r *ReadyResourceRepositoryImpl) GenerateUniqueKey() (string, error) {
|
||||
for i := 0; i < 20; i++ {
|
||||
key, err := gonanoid.Generate("0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ", 6)
|
||||
if err != nil {
|
||||
return "", err
|
||||
}
|
||||
var count int64
|
||||
err = r.db.Model(&entity.ReadyResource{}).Where("key = ?", key).Count(&count).Error
|
||||
if err != nil {
|
||||
return "", err
|
||||
}
|
||||
if count == 0 {
|
||||
return key, nil
|
||||
}
|
||||
}
|
||||
return "", gorm.ErrInvalidData
|
||||
}
|
||||
|
||||
// FindWithErrors 查找有错误信息的资源(包括软删除的)
|
||||
func (r *ReadyResourceRepositoryImpl) FindWithErrors() ([]entity.ReadyResource, error) {
|
||||
var resources []entity.ReadyResource
|
||||
err := r.db.Unscoped().Where("error_msg != '' AND error_msg IS NOT NULL").Find(&resources).Error
|
||||
return resources, err
|
||||
}
|
||||
|
||||
// FindWithErrorsPaginated 分页查找有错误信息的资源(包括软删除的)
|
||||
func (r *ReadyResourceRepositoryImpl) FindWithErrorsPaginated(page, limit int) ([]entity.ReadyResource, int64, error) {
|
||||
var resources []entity.ReadyResource
|
||||
var total int64
|
||||
|
||||
offset := (page - 1) * limit
|
||||
db := r.db.Model(&entity.ReadyResource{}).Unscoped().Where("error_msg != '' AND error_msg IS NOT NULL")
|
||||
|
||||
// 获取总数
|
||||
if err := db.Count(&total).Error; err != nil {
|
||||
return nil, 0, err
|
||||
}
|
||||
|
||||
// 获取分页数据
|
||||
err := db.Offset(offset).Limit(limit).Order("created_at DESC").Find(&resources).Error
|
||||
return resources, total, err
|
||||
}
|
||||
|
||||
// FindWithoutErrors 查找没有错误信息的资源
|
||||
func (r *ReadyResourceRepositoryImpl) FindWithoutErrors() ([]entity.ReadyResource, error) {
|
||||
var resources []entity.ReadyResource
|
||||
err := r.db.Where("error_msg = '' OR error_msg IS NULL").Find(&resources).Error
|
||||
return resources, err
|
||||
}
|
||||
|
||||
// FindWithErrorsIncludingDeleted 查找有错误信息的资源(包括软删除的,用于管理页面)
|
||||
func (r *ReadyResourceRepositoryImpl) FindWithErrorsIncludingDeleted() ([]entity.ReadyResource, error) {
|
||||
var resources []entity.ReadyResource
|
||||
err := r.db.Unscoped().Where("error_msg != '' AND error_msg IS NOT NULL").Find(&resources).Error
|
||||
return resources, err
|
||||
}
|
||||
|
||||
// FindWithErrorsPaginatedIncludingDeleted 分页查找有错误信息的资源(包括软删除的,用于管理页面)
|
||||
func (r *ReadyResourceRepositoryImpl) FindWithErrorsPaginatedIncludingDeleted(page, limit int, errorFilter string) ([]entity.ReadyResource, int64, error) {
|
||||
var resources []entity.ReadyResource
|
||||
var total int64
|
||||
|
||||
offset := (page - 1) * limit
|
||||
db := r.db.Model(&entity.ReadyResource{}).Unscoped().Where("error_msg != '' AND error_msg IS NOT NULL")
|
||||
|
||||
// 如果有错误过滤条件,添加到查询中
|
||||
if errorFilter != "" {
|
||||
db = db.Where("error_msg ILIKE ?", "%"+errorFilter+"%")
|
||||
}
|
||||
|
||||
// 获取总数
|
||||
if err := db.Count(&total).Error; err != nil {
|
||||
return nil, 0, err
|
||||
}
|
||||
|
||||
// 获取分页数据
|
||||
err := db.Offset(offset).Limit(limit).Order("created_at DESC").Find(&resources).Error
|
||||
return resources, total, err
|
||||
}
|
||||
|
||||
// ClearErrorMsg 清除指定资源的错误信息
|
||||
func (r *ReadyResourceRepositoryImpl) ClearErrorMsg(id uint) error {
|
||||
return r.db.Model(&entity.ReadyResource{}).Where("id = ?", id).Update("error_msg", "").Update("deleted_at", nil).Error
|
||||
}
|
||||
|
||||
// ClearErrorMsgAndRestore 清除错误信息并恢复软删除的资源
|
||||
func (r *ReadyResourceRepositoryImpl) ClearErrorMsgAndRestore(id uint) error {
|
||||
return r.db.Unscoped().Model(&entity.ReadyResource{}).Where("id = ?", id).Updates(map[string]interface{}{
|
||||
"error_msg": "",
|
||||
"deleted_at": nil,
|
||||
}).Error
|
||||
}
|
||||
|
||||
// FindWithErrorsByQuery 根据查询条件查找有错误信息的资源(不分页,用于批量操作)
|
||||
func (r *ReadyResourceRepositoryImpl) FindWithErrorsByQuery(errorFilter string) ([]entity.ReadyResource, error) {
|
||||
var resources []entity.ReadyResource
|
||||
|
||||
db := r.db.Model(&entity.ReadyResource{}).Unscoped().Where("error_msg != '' AND error_msg IS NOT NULL")
|
||||
|
||||
// 如果有错误过滤条件,添加到查询中
|
||||
if errorFilter != "" {
|
||||
db = db.Where("error_msg ILIKE ?", "%"+errorFilter+"%")
|
||||
}
|
||||
|
||||
err := db.Order("created_at DESC").Find(&resources).Error
|
||||
return resources, err
|
||||
}
|
||||
|
||||
// ClearAllErrorsByQuery 根据查询条件批量清除错误信息并真正删除资源
|
||||
func (r *ReadyResourceRepositoryImpl) ClearAllErrorsByQuery(errorFilter string) (int64, error) {
|
||||
db := r.db.Unscoped().Model(&entity.ReadyResource{}).Where("error_msg != '' AND error_msg IS NOT NULL")
|
||||
|
||||
// 如果有错误过滤条件,添加到查询中
|
||||
if errorFilter != "" {
|
||||
db = db.Where("error_msg ILIKE ?", "%"+errorFilter+"%")
|
||||
}
|
||||
|
||||
// 真正删除资源(物理删除)
|
||||
result := db.Delete(&entity.ReadyResource{})
|
||||
|
||||
return result.RowsAffected, result.Error
|
||||
}
|
||||
|
||||
@@ -2,11 +2,9 @@ package repo
|
||||
|
||||
import (
|
||||
"fmt"
|
||||
|
||||
"time"
|
||||
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
|
||||
"gorm.io/gorm"
|
||||
)
|
||||
|
||||
@@ -32,6 +30,10 @@ type ResourceRepository interface {
|
||||
InvalidateCache() error
|
||||
FindExists(url string, excludeID ...uint) (bool, error)
|
||||
BatchFindByURLs(urls []string) ([]entity.Resource, error)
|
||||
GetResourcesForTransfer(panID uint, sinceTime time.Time, limit int) ([]*entity.Resource, error)
|
||||
GetByURL(url string) (*entity.Resource, error)
|
||||
UpdateSaveURL(id uint, saveURL string) error
|
||||
CreateResourceTag(resourceTag *entity.ResourceTag) error
|
||||
}
|
||||
|
||||
// ResourceRepositoryImpl Resource的Repository实现
|
||||
@@ -210,18 +212,43 @@ func (r *ResourceRepositoryImpl) SearchWithFilters(params map[string]interface{}
|
||||
var resources []entity.Resource
|
||||
var total int64
|
||||
|
||||
db := r.db.Model(&entity.Resource{})
|
||||
db := r.db.Model(&entity.Resource{}).Preload("Category").Preload("Pan").Preload("Tags")
|
||||
|
||||
// 处理参数
|
||||
for key, value := range params {
|
||||
switch key {
|
||||
case "query":
|
||||
case "search": // 添加search参数支持
|
||||
if query, ok := value.(string); ok && query != "" {
|
||||
db = db.Where("title ILIKE ? OR description ILIKE ?", "%"+query+"%", "%"+query+"%")
|
||||
}
|
||||
case "category_id":
|
||||
case "category_id": // 添加category_id参数支持
|
||||
if categoryID, ok := value.(uint); ok {
|
||||
fmt.Printf("应用分类筛选: category_id = %d\n", categoryID)
|
||||
db = db.Where("category_id = ?", categoryID)
|
||||
} else {
|
||||
fmt.Printf("分类ID类型错误: %T, value: %v\n", value, value)
|
||||
}
|
||||
case "category": // 添加category参数支持(字符串形式)
|
||||
if category, ok := value.(string); ok && category != "" {
|
||||
// 根据分类名称查找分类ID
|
||||
var categoryEntity entity.Category
|
||||
if err := r.db.Where("name ILIKE ?", "%"+category+"%").First(&categoryEntity).Error; err == nil {
|
||||
db = db.Where("category_id = ?", categoryEntity.ID)
|
||||
}
|
||||
}
|
||||
case "tag": // 添加tag参数支持
|
||||
if tag, ok := value.(string); ok && tag != "" {
|
||||
// 根据标签名称查找相关资源
|
||||
var tagEntity entity.Tag
|
||||
if err := r.db.Where("name ILIKE ?", "%"+tag+"%").First(&tagEntity).Error; err == nil {
|
||||
// 通过中间表查找包含该标签的资源
|
||||
db = db.Joins("JOIN resource_tags ON resources.id = resource_tags.resource_id").
|
||||
Where("resource_tags.tag_id = ?", tagEntity.ID)
|
||||
}
|
||||
}
|
||||
case "pan_id": // 添加pan_id参数支持
|
||||
if panID, ok := value.(uint); ok {
|
||||
db = db.Where("pan_id = ?", panID)
|
||||
}
|
||||
case "is_valid":
|
||||
if isValid, ok := value.(bool); ok {
|
||||
@@ -231,20 +258,76 @@ func (r *ResourceRepositoryImpl) SearchWithFilters(params map[string]interface{}
|
||||
if isPublic, ok := value.(bool); ok {
|
||||
db = db.Where("is_public = ?", isPublic)
|
||||
}
|
||||
case "pan_id":
|
||||
if panID, ok := value.(uint); ok {
|
||||
db = db.Where("pan_id = ?", panID)
|
||||
case "has_save_url": // 添加has_save_url参数支持
|
||||
if hasSaveURL, ok := value.(bool); ok {
|
||||
fmt.Printf("处理 has_save_url 参数: %v\n", hasSaveURL)
|
||||
if hasSaveURL {
|
||||
// 有转存链接:save_url不为空且不为空格
|
||||
db = db.Where("save_url IS NOT NULL AND save_url != '' AND TRIM(save_url) != ''")
|
||||
fmt.Printf("应用 has_save_url=true 条件: save_url IS NOT NULL AND save_url != '' AND TRIM(save_url) != ''\n")
|
||||
} else {
|
||||
// 没有转存链接:save_url为空、NULL或只有空格
|
||||
db = db.Where("(save_url IS NULL OR save_url = '' OR TRIM(save_url) = '')")
|
||||
fmt.Printf("应用 has_save_url=false 条件: (save_url IS NULL OR save_url = '' OR TRIM(save_url) = '')\n")
|
||||
}
|
||||
}
|
||||
case "no_save_url": // 添加no_save_url参数支持(与has_save_url=false相同)
|
||||
if noSaveURL, ok := value.(bool); ok && noSaveURL {
|
||||
db = db.Where("(save_url IS NULL OR save_url = '' OR TRIM(save_url) = '')")
|
||||
}
|
||||
case "pan_name": // 添加pan_name参数支持
|
||||
if panName, ok := value.(string); ok && panName != "" {
|
||||
// 根据平台名称查找平台ID
|
||||
var panEntity entity.Pan
|
||||
if err := r.db.Where("name ILIKE ?", "%"+panName+"%").First(&panEntity).Error; err == nil {
|
||||
db = db.Where("pan_id = ?", panEntity.ID)
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
// 管理后台显示所有资源,公开API才限制为有效的公开资源
|
||||
// 这里通过检查请求来源来判断是否为管理后台
|
||||
// 如果没有明确指定is_valid和is_public,则显示所有资源
|
||||
// 注意:这个逻辑可能需要根据实际需求调整
|
||||
if _, hasIsValid := params["is_valid"]; !hasIsValid {
|
||||
// 管理后台不限制is_valid
|
||||
// db = db.Where("is_valid = ?", true)
|
||||
}
|
||||
if _, hasIsPublic := params["is_public"]; !hasIsPublic {
|
||||
// 管理后台不限制is_public
|
||||
// db = db.Where("is_public = ?", true)
|
||||
}
|
||||
|
||||
// 获取总数
|
||||
if err := db.Count(&total).Error; err != nil {
|
||||
return nil, 0, err
|
||||
}
|
||||
|
||||
// 处理分页参数
|
||||
page := 1
|
||||
pageSize := 20
|
||||
|
||||
if pageVal, ok := params["page"].(int); ok && pageVal > 0 {
|
||||
page = pageVal
|
||||
}
|
||||
if pageSizeVal, ok := params["page_size"].(int); ok && pageSizeVal > 0 {
|
||||
pageSize = pageSizeVal
|
||||
fmt.Printf("原始pageSize: %d\n", pageSize)
|
||||
// 限制最大page_size为10000(管理后台需要更大的数据量)
|
||||
if pageSize > 10000 {
|
||||
pageSize = 10000
|
||||
fmt.Printf("pageSize超过10000,限制为: %d\n", pageSize)
|
||||
}
|
||||
fmt.Printf("最终pageSize: %d\n", pageSize)
|
||||
}
|
||||
|
||||
// 计算偏移量
|
||||
offset := (page - 1) * pageSize
|
||||
|
||||
// 获取分页数据,按更新时间倒序
|
||||
err := db.Order("updated_at DESC").Find(&resources).Error
|
||||
err := db.Order("updated_at DESC").Offset(offset).Limit(pageSize).Find(&resources).Error
|
||||
fmt.Printf("查询结果: 总数=%d, 当前页数据量=%d, pageSize=%d\n", total, len(resources), pageSize)
|
||||
return resources, total, err
|
||||
}
|
||||
|
||||
@@ -332,7 +415,7 @@ func (r *ResourceRepositoryImpl) InvalidateCache() error {
|
||||
// FindExists 检查是否存在相同URL的资源
|
||||
func (r *ResourceRepositoryImpl) FindExists(url string, excludeID ...uint) (bool, error) {
|
||||
var count int64
|
||||
query := r.db.Model(&entity.Resource{}).Where("url = ?", url)
|
||||
query := r.db.Model(&entity.Resource{}).Where("url = ? OR save_url = ?", url, url)
|
||||
|
||||
// 如果有排除ID,则排除该记录(用于更新时排除自己)
|
||||
if len(excludeID) > 0 {
|
||||
@@ -354,3 +437,43 @@ func (r *ResourceRepositoryImpl) BatchFindByURLs(urls []string) ([]entity.Resour
|
||||
err := r.db.Where("url IN ?", urls).Find(&resources).Error
|
||||
return resources, err
|
||||
}
|
||||
|
||||
// GetResourcesForTransfer 获取需要转存的资源
|
||||
func (r *ResourceRepositoryImpl) GetResourcesForTransfer(panID uint, sinceTime time.Time, limit int) ([]*entity.Resource, error) {
|
||||
var resources []*entity.Resource
|
||||
query := r.db.Where("pan_id = ? AND (save_url = '' OR save_url IS NULL) AND (error_msg = '' OR error_msg IS NULL)", panID)
|
||||
if !sinceTime.IsZero() {
|
||||
query = query.Where("created_at >= ?", sinceTime)
|
||||
}
|
||||
|
||||
// 添加数量限制
|
||||
if limit > 0 {
|
||||
query = query.Limit(limit)
|
||||
}
|
||||
|
||||
err := query.Order("created_at DESC").Find(&resources).Error
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
return resources, nil
|
||||
}
|
||||
|
||||
// GetByURL 根据URL获取资源
|
||||
func (r *ResourceRepositoryImpl) GetByURL(url string) (*entity.Resource, error) {
|
||||
var resource entity.Resource
|
||||
err := r.GetDB().Where("url = ?", url).First(&resource).Error
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
return &resource, nil
|
||||
}
|
||||
|
||||
// UpdateSaveURL 更新资源的转存链接
|
||||
func (r *ResourceRepositoryImpl) UpdateSaveURL(id uint, saveURL string) error {
|
||||
return r.GetDB().Model(&entity.Resource{}).Where("id = ?", id).Update("save_url", saveURL).Error
|
||||
}
|
||||
|
||||
// CreateResourceTag 创建资源与标签的关联
|
||||
func (r *ResourceRepositoryImpl) CreateResourceTag(resourceTag *entity.ResourceTag) error {
|
||||
return r.GetDB().Create(resourceTag).Error
|
||||
}
|
||||
|
||||
90
db/repo/resource_view_repository.go
Normal file
@@ -0,0 +1,90 @@
|
||||
package repo
|
||||
|
||||
import (
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
"gorm.io/gorm"
|
||||
)
|
||||
|
||||
// ResourceViewRepository 资源访问记录仓库接口
|
||||
type ResourceViewRepository interface {
|
||||
BaseRepository[entity.ResourceView]
|
||||
RecordView(resourceID uint, ipAddress, userAgent string) error
|
||||
GetTodayViews() (int64, error)
|
||||
GetViewsByDate(date string) (int64, error)
|
||||
GetViewsTrend(days int) ([]map[string]interface{}, error)
|
||||
GetResourceViews(resourceID uint, limit int) ([]entity.ResourceView, error)
|
||||
}
|
||||
|
||||
// ResourceViewRepositoryImpl 资源访问记录仓库实现
|
||||
type ResourceViewRepositoryImpl struct {
|
||||
BaseRepositoryImpl[entity.ResourceView]
|
||||
}
|
||||
|
||||
// NewResourceViewRepository 创建资源访问记录仓库
|
||||
func NewResourceViewRepository(db *gorm.DB) ResourceViewRepository {
|
||||
return &ResourceViewRepositoryImpl{
|
||||
BaseRepositoryImpl: BaseRepositoryImpl[entity.ResourceView]{db: db},
|
||||
}
|
||||
}
|
||||
|
||||
// RecordView 记录资源访问
|
||||
func (r *ResourceViewRepositoryImpl) RecordView(resourceID uint, ipAddress, userAgent string) error {
|
||||
view := &entity.ResourceView{
|
||||
ResourceID: resourceID,
|
||||
IPAddress: ipAddress,
|
||||
UserAgent: userAgent,
|
||||
}
|
||||
return r.db.Create(view).Error
|
||||
}
|
||||
|
||||
// GetTodayViews 获取今日访问量
|
||||
func (r *ResourceViewRepositoryImpl) GetTodayViews() (int64, error) {
|
||||
today := utils.GetTodayString()
|
||||
var count int64
|
||||
err := r.db.Model(&entity.ResourceView{}).
|
||||
Where("DATE(created_at) = ?", today).
|
||||
Count(&count).Error
|
||||
return count, err
|
||||
}
|
||||
|
||||
// GetViewsByDate 获取指定日期的访问量
|
||||
func (r *ResourceViewRepositoryImpl) GetViewsByDate(date string) (int64, error) {
|
||||
var count int64
|
||||
err := r.db.Model(&entity.ResourceView{}).
|
||||
Where("DATE(created_at) = ?", date).
|
||||
Count(&count).Error
|
||||
return count, err
|
||||
}
|
||||
|
||||
// GetViewsTrend 获取访问量趋势数据
|
||||
func (r *ResourceViewRepositoryImpl) GetViewsTrend(days int) ([]map[string]interface{}, error) {
|
||||
var results []map[string]interface{}
|
||||
|
||||
for i := days - 1; i >= 0; i-- {
|
||||
date := utils.GetCurrentTime().AddDate(0, 0, -i)
|
||||
dateStr := date.Format(utils.TimeFormatDate)
|
||||
|
||||
count, err := r.GetViewsByDate(dateStr)
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
|
||||
results = append(results, map[string]interface{}{
|
||||
"date": dateStr,
|
||||
"views": count,
|
||||
})
|
||||
}
|
||||
|
||||
return results, nil
|
||||
}
|
||||
|
||||
// GetResourceViews 获取指定资源的访问记录
|
||||
func (r *ResourceViewRepositoryImpl) GetResourceViews(resourceID uint, limit int) ([]entity.ResourceView, error) {
|
||||
var views []entity.ResourceView
|
||||
err := r.db.Where("resource_id = ?", resourceID).
|
||||
Order("created_at DESC").
|
||||
Limit(limit).
|
||||
Find(&views).Error
|
||||
return views, err
|
||||
}
|
||||
@@ -2,9 +2,9 @@ package repo
|
||||
|
||||
import (
|
||||
"fmt"
|
||||
"time"
|
||||
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
|
||||
"gorm.io/gorm"
|
||||
)
|
||||
@@ -37,7 +37,7 @@ func (r *SearchStatRepositoryImpl) RecordSearch(keyword, ip, userAgent string) e
|
||||
stat := entity.SearchStat{
|
||||
Keyword: keyword,
|
||||
Count: 1,
|
||||
Date: time.Now(), // 可保留 date 字段,实际用 created_at 统计
|
||||
Date: utils.GetCurrentTime(), // 可保留 date 字段,实际用 created_at 统计
|
||||
IP: ip,
|
||||
UserAgent: userAgent,
|
||||
}
|
||||
@@ -124,9 +124,9 @@ func (r *SearchStatRepositoryImpl) GetKeywordTrend(keyword string, days int) ([]
|
||||
// GetSummary 获取搜索统计汇总
|
||||
func (r *SearchStatRepositoryImpl) GetSummary() (map[string]int64, error) {
|
||||
var total, today, week, month, keywords int64
|
||||
now := time.Now()
|
||||
todayStr := now.Format("2006-01-02")
|
||||
weekStart := now.AddDate(0, 0, -int(now.Weekday())+1).Format("2006-01-02") // 周一
|
||||
now := utils.GetCurrentTime()
|
||||
todayStr := now.Format(utils.TimeFormatDate)
|
||||
weekStart := now.AddDate(0, 0, -int(now.Weekday())+1).Format(utils.TimeFormatDate) // 周一
|
||||
monthStart := now.Format("2006-01") + "-01"
|
||||
|
||||
// 总搜索次数
|
||||
|
||||
@@ -1,6 +1,9 @@
|
||||
package repo
|
||||
|
||||
import (
|
||||
"fmt"
|
||||
"sync"
|
||||
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
|
||||
"gorm.io/gorm"
|
||||
@@ -9,72 +12,280 @@ import (
|
||||
// SystemConfigRepository 系统配置Repository接口
|
||||
type SystemConfigRepository interface {
|
||||
BaseRepository[entity.SystemConfig]
|
||||
FindFirst() (*entity.SystemConfig, error)
|
||||
GetOrCreateDefault() (*entity.SystemConfig, error)
|
||||
Upsert(config *entity.SystemConfig) error
|
||||
FindAll() ([]entity.SystemConfig, error)
|
||||
FindByKey(key string) (*entity.SystemConfig, error)
|
||||
GetOrCreateDefault() ([]entity.SystemConfig, error)
|
||||
UpsertConfigs(configs []entity.SystemConfig) error
|
||||
GetConfigValue(key string) (string, error)
|
||||
GetConfigBool(key string) (bool, error)
|
||||
GetConfigInt(key string) (int, error)
|
||||
GetCachedConfigs() map[string]string
|
||||
ClearConfigCache()
|
||||
}
|
||||
|
||||
// SystemConfigRepositoryImpl 系统配置Repository实现
|
||||
type SystemConfigRepositoryImpl struct {
|
||||
BaseRepositoryImpl[entity.SystemConfig]
|
||||
|
||||
// 配置缓存
|
||||
configCache map[string]string // key -> value
|
||||
configCacheOnce sync.Once
|
||||
configCacheMutex sync.RWMutex
|
||||
}
|
||||
|
||||
// NewSystemConfigRepository 创建系统配置Repository
|
||||
func NewSystemConfigRepository(db *gorm.DB) SystemConfigRepository {
|
||||
return &SystemConfigRepositoryImpl{
|
||||
BaseRepositoryImpl: BaseRepositoryImpl[entity.SystemConfig]{db: db},
|
||||
configCache: make(map[string]string),
|
||||
}
|
||||
}
|
||||
|
||||
// FindFirst 获取第一个配置(通常只有一个配置)
|
||||
func (r *SystemConfigRepositoryImpl) FindFirst() (*entity.SystemConfig, error) {
|
||||
// FindAll 获取所有配置
|
||||
func (r *SystemConfigRepositoryImpl) FindAll() ([]entity.SystemConfig, error) {
|
||||
var configs []entity.SystemConfig
|
||||
err := r.db.Find(&configs).Error
|
||||
return configs, err
|
||||
}
|
||||
|
||||
// FindByKey 根据键查找配置
|
||||
func (r *SystemConfigRepositoryImpl) FindByKey(key string) (*entity.SystemConfig, error) {
|
||||
var config entity.SystemConfig
|
||||
err := r.db.First(&config).Error
|
||||
err := r.db.Where("key = ?", key).First(&config).Error
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
return &config, nil
|
||||
}
|
||||
|
||||
// Upsert 创建或更新系统配置
|
||||
func (r *SystemConfigRepositoryImpl) Upsert(config *entity.SystemConfig) error {
|
||||
var existingConfig entity.SystemConfig
|
||||
err := r.db.First(&existingConfig).Error
|
||||
// UpsertConfigs 批量创建或更新配置
|
||||
func (r *SystemConfigRepositoryImpl) UpsertConfigs(configs []entity.SystemConfig) error {
|
||||
for _, config := range configs {
|
||||
var existingConfig entity.SystemConfig
|
||||
err := r.db.Where("key = ?", config.Key).First(&existingConfig).Error
|
||||
|
||||
if err != nil {
|
||||
// 如果不存在,则创建
|
||||
return r.db.Create(config).Error
|
||||
} else {
|
||||
// 如果存在,则更新
|
||||
config.ID = existingConfig.ID
|
||||
return r.db.Save(config).Error
|
||||
if err != nil {
|
||||
// 如果不存在,则创建
|
||||
if err := r.db.Create(&config).Error; err != nil {
|
||||
return err
|
||||
}
|
||||
} else {
|
||||
// 如果存在,则更新
|
||||
config.ID = existingConfig.ID
|
||||
if err := r.db.Save(&config).Error; err != nil {
|
||||
return err
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
// 更新配置后刷新缓存
|
||||
r.refreshConfigCache()
|
||||
return nil
|
||||
}
|
||||
|
||||
// GetOrCreateDefault 获取配置或创建默认配置
|
||||
func (r *SystemConfigRepositoryImpl) GetOrCreateDefault() (*entity.SystemConfig, error) {
|
||||
config, err := r.FindFirst()
|
||||
func (r *SystemConfigRepositoryImpl) GetOrCreateDefault() ([]entity.SystemConfig, error) {
|
||||
configs, err := r.FindAll()
|
||||
if err != nil {
|
||||
// 创建默认配置
|
||||
defaultConfig := &entity.SystemConfig{
|
||||
SiteTitle: "老九网盘资源数据库",
|
||||
SiteDescription: "专业的老九网盘资源数据库",
|
||||
Keywords: "网盘,资源管理,文件分享",
|
||||
Author: "系统管理员",
|
||||
Copyright: "© 2024 老九网盘资源数据库",
|
||||
AutoProcessReadyResources: false,
|
||||
AutoProcessInterval: 30,
|
||||
PageSize: 100,
|
||||
MaintenanceMode: false,
|
||||
return nil, err
|
||||
}
|
||||
|
||||
// 如果没有配置,创建默认配置
|
||||
if len(configs) == 0 {
|
||||
defaultConfigs := []entity.SystemConfig{
|
||||
{Key: entity.ConfigKeySiteTitle, Value: entity.ConfigDefaultSiteTitle, Type: entity.ConfigTypeString},
|
||||
{Key: entity.ConfigKeySiteDescription, Value: entity.ConfigDefaultSiteDescription, Type: entity.ConfigTypeString},
|
||||
{Key: entity.ConfigKeyKeywords, Value: entity.ConfigDefaultKeywords, Type: entity.ConfigTypeString},
|
||||
{Key: entity.ConfigKeyAuthor, Value: entity.ConfigDefaultAuthor, Type: entity.ConfigTypeString},
|
||||
{Key: entity.ConfigKeyCopyright, Value: entity.ConfigDefaultCopyright, Type: entity.ConfigTypeString},
|
||||
{Key: entity.ConfigKeyAutoProcessReadyResources, Value: entity.ConfigDefaultAutoProcessReadyResources, Type: entity.ConfigTypeBool},
|
||||
{Key: entity.ConfigKeyAutoProcessInterval, Value: entity.ConfigDefaultAutoProcessInterval, Type: entity.ConfigTypeInt},
|
||||
{Key: entity.ConfigKeyAutoTransferEnabled, Value: entity.ConfigDefaultAutoTransferEnabled, Type: entity.ConfigTypeBool},
|
||||
{Key: entity.ConfigKeyAutoTransferLimitDays, Value: entity.ConfigDefaultAutoTransferLimitDays, Type: entity.ConfigTypeInt},
|
||||
{Key: entity.ConfigKeyAutoTransferMinSpace, Value: entity.ConfigDefaultAutoTransferMinSpace, Type: entity.ConfigTypeInt},
|
||||
{Key: entity.ConfigKeyAutoFetchHotDramaEnabled, Value: entity.ConfigDefaultAutoFetchHotDramaEnabled, Type: entity.ConfigTypeBool},
|
||||
{Key: entity.ConfigKeyApiToken, Value: entity.ConfigDefaultApiToken, Type: entity.ConfigTypeString},
|
||||
{Key: entity.ConfigKeyPageSize, Value: entity.ConfigDefaultPageSize, Type: entity.ConfigTypeInt},
|
||||
{Key: entity.ConfigKeyMaintenanceMode, Value: entity.ConfigDefaultMaintenanceMode, Type: entity.ConfigTypeBool},
|
||||
{Key: entity.ConfigKeyEnableRegister, Value: entity.ConfigDefaultEnableRegister, Type: entity.ConfigTypeBool},
|
||||
{Key: entity.ConfigKeyThirdPartyStatsCode, Value: entity.ConfigDefaultThirdPartyStatsCode, Type: entity.ConfigTypeString},
|
||||
}
|
||||
|
||||
err = r.db.Create(defaultConfig).Error
|
||||
err = r.UpsertConfigs(defaultConfigs)
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
|
||||
return defaultConfig, nil
|
||||
return defaultConfigs, nil
|
||||
}
|
||||
|
||||
return config, nil
|
||||
// 检查是否有缺失的配置项,如果有则添加
|
||||
requiredConfigs := map[string]entity.SystemConfig{
|
||||
entity.ConfigKeySiteTitle: {Key: entity.ConfigKeySiteTitle, Value: entity.ConfigDefaultSiteTitle, Type: entity.ConfigTypeString},
|
||||
entity.ConfigKeySiteDescription: {Key: entity.ConfigKeySiteDescription, Value: entity.ConfigDefaultSiteDescription, Type: entity.ConfigTypeString},
|
||||
entity.ConfigKeyKeywords: {Key: entity.ConfigKeyKeywords, Value: entity.ConfigDefaultKeywords, Type: entity.ConfigTypeString},
|
||||
entity.ConfigKeyAuthor: {Key: entity.ConfigKeyAuthor, Value: entity.ConfigDefaultAuthor, Type: entity.ConfigTypeString},
|
||||
entity.ConfigKeyCopyright: {Key: entity.ConfigKeyCopyright, Value: entity.ConfigDefaultCopyright, Type: entity.ConfigTypeString},
|
||||
entity.ConfigKeyAutoProcessReadyResources: {Key: entity.ConfigKeyAutoProcessReadyResources, Value: entity.ConfigDefaultAutoProcessReadyResources, Type: entity.ConfigTypeBool},
|
||||
entity.ConfigKeyAutoProcessInterval: {Key: entity.ConfigKeyAutoProcessInterval, Value: entity.ConfigDefaultAutoProcessInterval, Type: entity.ConfigTypeInt},
|
||||
entity.ConfigKeyAutoTransferEnabled: {Key: entity.ConfigKeyAutoTransferEnabled, Value: entity.ConfigDefaultAutoTransferEnabled, Type: entity.ConfigTypeBool},
|
||||
entity.ConfigKeyAutoTransferLimitDays: {Key: entity.ConfigKeyAutoTransferLimitDays, Value: entity.ConfigDefaultAutoTransferLimitDays, Type: entity.ConfigTypeInt},
|
||||
entity.ConfigKeyAutoTransferMinSpace: {Key: entity.ConfigKeyAutoTransferMinSpace, Value: entity.ConfigDefaultAutoTransferMinSpace, Type: entity.ConfigTypeInt},
|
||||
entity.ConfigKeyAutoFetchHotDramaEnabled: {Key: entity.ConfigKeyAutoFetchHotDramaEnabled, Value: entity.ConfigDefaultAutoFetchHotDramaEnabled, Type: entity.ConfigTypeBool},
|
||||
entity.ConfigKeyApiToken: {Key: entity.ConfigKeyApiToken, Value: entity.ConfigDefaultApiToken, Type: entity.ConfigTypeString},
|
||||
entity.ConfigKeyPageSize: {Key: entity.ConfigKeyPageSize, Value: entity.ConfigDefaultPageSize, Type: entity.ConfigTypeInt},
|
||||
entity.ConfigKeyMaintenanceMode: {Key: entity.ConfigKeyMaintenanceMode, Value: entity.ConfigDefaultMaintenanceMode, Type: entity.ConfigTypeBool},
|
||||
entity.ConfigKeyEnableRegister: {Key: entity.ConfigKeyEnableRegister, Value: entity.ConfigDefaultEnableRegister, Type: entity.ConfigTypeBool},
|
||||
entity.ConfigKeyThirdPartyStatsCode: {Key: entity.ConfigKeyThirdPartyStatsCode, Value: entity.ConfigDefaultThirdPartyStatsCode, Type: entity.ConfigTypeString},
|
||||
}
|
||||
|
||||
// 检查现有配置中是否有缺失的配置项
|
||||
existingKeys := make(map[string]bool)
|
||||
for _, config := range configs {
|
||||
existingKeys[config.Key] = true
|
||||
}
|
||||
|
||||
// 找出缺失的配置项
|
||||
var missingConfigs []entity.SystemConfig
|
||||
for key, requiredConfig := range requiredConfigs {
|
||||
if !existingKeys[key] {
|
||||
missingConfigs = append(missingConfigs, requiredConfig)
|
||||
}
|
||||
}
|
||||
|
||||
// 如果有缺失的配置项,则添加它们
|
||||
if len(missingConfigs) > 0 {
|
||||
err = r.UpsertConfigs(missingConfigs)
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
// 重新获取所有配置
|
||||
configs, err = r.FindAll()
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
}
|
||||
|
||||
return configs, nil
|
||||
}
|
||||
|
||||
// initConfigCache 初始化配置缓存
|
||||
func (r *SystemConfigRepositoryImpl) initConfigCache() {
|
||||
r.configCacheOnce.Do(func() {
|
||||
// 获取所有配置
|
||||
configs, err := r.FindAll()
|
||||
if err != nil {
|
||||
// 如果获取失败,尝试创建默认配置
|
||||
configs, err = r.GetOrCreateDefault()
|
||||
if err != nil {
|
||||
return
|
||||
}
|
||||
}
|
||||
|
||||
// 初始化缓存
|
||||
r.configCacheMutex.Lock()
|
||||
defer r.configCacheMutex.Unlock()
|
||||
|
||||
for _, config := range configs {
|
||||
r.configCache[config.Key] = config.Value
|
||||
}
|
||||
})
|
||||
}
|
||||
|
||||
// refreshConfigCache 刷新配置缓存
|
||||
func (r *SystemConfigRepositoryImpl) refreshConfigCache() {
|
||||
// 重置Once,允许重新初始化
|
||||
r.configCacheOnce = sync.Once{}
|
||||
|
||||
// 清空缓存
|
||||
r.configCacheMutex.Lock()
|
||||
r.configCache = make(map[string]string)
|
||||
r.configCacheMutex.Unlock()
|
||||
|
||||
// 重新初始化缓存
|
||||
r.initConfigCache()
|
||||
}
|
||||
|
||||
// GetConfigValue 获取配置值(字符串)
|
||||
func (r *SystemConfigRepositoryImpl) GetConfigValue(key string) (string, error) {
|
||||
// 初始化缓存
|
||||
r.initConfigCache()
|
||||
|
||||
// 从缓存中读取
|
||||
r.configCacheMutex.RLock()
|
||||
value, exists := r.configCache[key]
|
||||
r.configCacheMutex.RUnlock()
|
||||
|
||||
if exists {
|
||||
return value, nil
|
||||
}
|
||||
|
||||
// 如果缓存中没有,尝试从数据库获取(可能是新添加的配置)
|
||||
config, err := r.FindByKey(key)
|
||||
if err != nil {
|
||||
return "", err
|
||||
}
|
||||
|
||||
// 更新缓存
|
||||
r.configCacheMutex.Lock()
|
||||
r.configCache[key] = config.Value
|
||||
r.configCacheMutex.Unlock()
|
||||
|
||||
return config.Value, nil
|
||||
}
|
||||
|
||||
// GetConfigBool 获取配置值(布尔)
|
||||
func (r *SystemConfigRepositoryImpl) GetConfigBool(key string) (bool, error) {
|
||||
value, err := r.GetConfigValue(key)
|
||||
if err != nil {
|
||||
return false, err
|
||||
}
|
||||
|
||||
switch value {
|
||||
case "true", "1", "yes":
|
||||
return true, nil
|
||||
case "false", "0", "no":
|
||||
return false, nil
|
||||
default:
|
||||
return false, nil
|
||||
}
|
||||
}
|
||||
|
||||
// GetConfigInt 获取配置值(整数)
|
||||
func (r *SystemConfigRepositoryImpl) GetConfigInt(key string) (int, error) {
|
||||
value, err := r.GetConfigValue(key)
|
||||
if err != nil {
|
||||
return 0, err
|
||||
}
|
||||
|
||||
// 这里需要导入 strconv 包,但为了避免循环导入,我们使用简单的转换
|
||||
var result int
|
||||
_, err = fmt.Sscanf(value, "%d", &result)
|
||||
return result, err
|
||||
}
|
||||
|
||||
// GetCachedConfigs 获取所有缓存的配置(用于调试)
|
||||
func (r *SystemConfigRepositoryImpl) GetCachedConfigs() map[string]string {
|
||||
r.initConfigCache()
|
||||
|
||||
r.configCacheMutex.RLock()
|
||||
defer r.configCacheMutex.RUnlock()
|
||||
|
||||
// 返回缓存的副本
|
||||
result := make(map[string]string)
|
||||
for k, v := range r.configCache {
|
||||
result[k] = v
|
||||
}
|
||||
|
||||
return result
|
||||
}
|
||||
|
||||
// ClearConfigCache 清空配置缓存(用于测试或手动刷新)
|
||||
func (r *SystemConfigRepositoryImpl) ClearConfigCache() {
|
||||
r.configCacheMutex.Lock()
|
||||
r.configCache = make(map[string]string)
|
||||
r.configCacheMutex.Unlock()
|
||||
|
||||
// 重置Once,允许重新初始化
|
||||
r.configCacheOnce = sync.Once{}
|
||||
}
|
||||
|
||||
@@ -10,14 +10,19 @@ import (
|
||||
type TagRepository interface {
|
||||
BaseRepository[entity.Tag]
|
||||
FindByName(name string) (*entity.Tag, error)
|
||||
FindByNameIncludingDeleted(name string) (*entity.Tag, error)
|
||||
FindWithResources() ([]entity.Tag, error)
|
||||
FindByCategoryID(categoryID uint) ([]entity.Tag, error)
|
||||
FindByCategoryIDPaginated(categoryID uint, page, pageSize int) ([]entity.Tag, int64, error)
|
||||
GetResourceCount(tagID uint) (int64, error)
|
||||
FindByResourceID(resourceID uint) ([]entity.Tag, error)
|
||||
FindWithPagination(page, pageSize int) ([]entity.Tag, int64, error)
|
||||
FindWithPaginationOrderByResourceCount(page, pageSize int) ([]entity.Tag, int64, error)
|
||||
Search(query string, page, pageSize int) ([]entity.Tag, int64, error)
|
||||
SearchOrderByResourceCount(query string, page, pageSize int) ([]entity.Tag, int64, error)
|
||||
UpdateWithNulls(tag *entity.Tag) error
|
||||
GetByID(id uint) (*entity.Tag, error)
|
||||
RestoreDeletedTag(id uint) error
|
||||
}
|
||||
|
||||
// TagRepositoryImpl Tag的Repository实现
|
||||
@@ -42,6 +47,16 @@ func (r *TagRepositoryImpl) FindByName(name string) (*entity.Tag, error) {
|
||||
return &tag, nil
|
||||
}
|
||||
|
||||
// FindByNameIncludingDeleted 根据名称查找(包括已删除的记录)
|
||||
func (r *TagRepositoryImpl) FindByNameIncludingDeleted(name string) (*entity.Tag, error) {
|
||||
var tag entity.Tag
|
||||
err := r.db.Unscoped().Where("name = ?", name).First(&tag).Error
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
return &tag, nil
|
||||
}
|
||||
|
||||
// FindWithResources 查找包含资源的标签
|
||||
func (r *TagRepositoryImpl) FindWithResources() ([]entity.Tag, error) {
|
||||
var tags []entity.Tag
|
||||
@@ -144,3 +159,86 @@ func (r *TagRepositoryImpl) UpdateWithNulls(tag *entity.Tag) error {
|
||||
// 使用Select方法明确指定要更新的字段,包括null值
|
||||
return r.db.Model(tag).Select("name", "description", "category_id", "updated_at").Updates(tag).Error
|
||||
}
|
||||
|
||||
// GetByID 通过ID查找标签
|
||||
func (r *TagRepositoryImpl) GetByID(id uint) (*entity.Tag, error) {
|
||||
var tag entity.Tag
|
||||
err := r.db.First(&tag, id).Error
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
return &tag, nil
|
||||
}
|
||||
|
||||
// RestoreDeletedTag 恢复已删除的标签
|
||||
func (r *TagRepositoryImpl) RestoreDeletedTag(id uint) error {
|
||||
return r.db.Unscoped().Model(&entity.Tag{}).Where("id = ?", id).Update("deleted_at", nil).Error
|
||||
}
|
||||
|
||||
// FindWithPaginationOrderByResourceCount 按资源数量排序的分页查询
|
||||
func (r *TagRepositoryImpl) FindWithPaginationOrderByResourceCount(page, pageSize int) ([]entity.Tag, int64, error) {
|
||||
var tags []entity.Tag
|
||||
var total int64
|
||||
|
||||
// 获取总数
|
||||
err := r.db.Model(&entity.Tag{}).Count(&total).Error
|
||||
if err != nil {
|
||||
return nil, 0, err
|
||||
}
|
||||
|
||||
// 使用子查询统计每个标签的资源数量并排序
|
||||
offset := (page - 1) * pageSize
|
||||
err = r.db.Preload("Category").
|
||||
Select("tags.*, COALESCE(resource_counts.count, 0) as resource_count").
|
||||
Joins(`LEFT JOIN (
|
||||
SELECT rt.tag_id, COUNT(rt.resource_id) as count
|
||||
FROM resource_tags rt
|
||||
INNER JOIN resources r ON rt.resource_id = r.id AND r.deleted_at IS NULL
|
||||
GROUP BY rt.tag_id
|
||||
) as resource_counts ON tags.id = resource_counts.tag_id`).
|
||||
Order("COALESCE(resource_counts.count, 0) DESC, tags.created_at DESC").
|
||||
Offset(offset).Limit(pageSize).
|
||||
Find(&tags).Error
|
||||
|
||||
if err != nil {
|
||||
return nil, 0, err
|
||||
}
|
||||
|
||||
return tags, total, nil
|
||||
}
|
||||
|
||||
// SearchOrderByResourceCount 按资源数量排序的搜索
|
||||
func (r *TagRepositoryImpl) SearchOrderByResourceCount(query string, page, pageSize int) ([]entity.Tag, int64, error) {
|
||||
var tags []entity.Tag
|
||||
var total int64
|
||||
|
||||
// 构建搜索条件
|
||||
searchQuery := "%" + query + "%"
|
||||
|
||||
// 获取总数
|
||||
err := r.db.Model(&entity.Tag{}).Where("name ILIKE ? OR description ILIKE ?", searchQuery, searchQuery).Count(&total).Error
|
||||
if err != nil {
|
||||
return nil, 0, err
|
||||
}
|
||||
|
||||
// 使用子查询统计每个标签的资源数量并排序
|
||||
offset := (page - 1) * pageSize
|
||||
err = r.db.Preload("Category").
|
||||
Select("tags.*, COALESCE(resource_counts.count, 0) as resource_count").
|
||||
Joins(`LEFT JOIN (
|
||||
SELECT rt.tag_id, COUNT(rt.resource_id) as count
|
||||
FROM resource_tags rt
|
||||
INNER JOIN resources r ON rt.resource_id = r.id AND r.deleted_at IS NULL
|
||||
GROUP BY rt.tag_id
|
||||
) as resource_counts ON tags.id = resource_counts.tag_id`).
|
||||
Where("tags.name ILIKE ? OR tags.description ILIKE ?", searchQuery, searchQuery).
|
||||
Order("COALESCE(resource_counts.count, 0) DESC, tags.created_at DESC").
|
||||
Offset(offset).Limit(pageSize).
|
||||
Find(&tags).Error
|
||||
|
||||
if err != nil {
|
||||
return nil, 0, err
|
||||
}
|
||||
|
||||
return tags, total, nil
|
||||
}
|
||||
|
||||
145
db/repo/task_item_repository.go
Normal file
@@ -0,0 +1,145 @@
|
||||
package repo
|
||||
|
||||
import (
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"gorm.io/gorm"
|
||||
)
|
||||
|
||||
// TaskItemRepository 任务项仓库接口
|
||||
type TaskItemRepository interface {
|
||||
GetByID(id uint) (*entity.TaskItem, error)
|
||||
Create(item *entity.TaskItem) error
|
||||
Delete(id uint) error
|
||||
DeleteByTaskID(taskID uint) error
|
||||
GetByTaskIDAndStatus(taskID uint, status string) ([]*entity.TaskItem, error)
|
||||
GetListByTaskID(taskID uint, page, pageSize int, status string) ([]*entity.TaskItem, int64, error)
|
||||
UpdateStatus(id uint, status string) error
|
||||
UpdateStatusAndOutput(id uint, status, outputData string) error
|
||||
GetStatsByTaskID(taskID uint) (map[string]int, error)
|
||||
ResetProcessingItems(taskID uint) error
|
||||
}
|
||||
|
||||
// TaskItemRepositoryImpl 任务项仓库实现
|
||||
type TaskItemRepositoryImpl struct {
|
||||
db *gorm.DB
|
||||
}
|
||||
|
||||
// NewTaskItemRepository 创建任务项仓库
|
||||
func NewTaskItemRepository(db *gorm.DB) TaskItemRepository {
|
||||
return &TaskItemRepositoryImpl{
|
||||
db: db,
|
||||
}
|
||||
}
|
||||
|
||||
// GetByID 根据ID获取任务项
|
||||
func (r *TaskItemRepositoryImpl) GetByID(id uint) (*entity.TaskItem, error) {
|
||||
var item entity.TaskItem
|
||||
err := r.db.First(&item, id).Error
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
return &item, nil
|
||||
}
|
||||
|
||||
// Create 创建任务项
|
||||
func (r *TaskItemRepositoryImpl) Create(item *entity.TaskItem) error {
|
||||
return r.db.Create(item).Error
|
||||
}
|
||||
|
||||
// Delete 删除任务项
|
||||
func (r *TaskItemRepositoryImpl) Delete(id uint) error {
|
||||
return r.db.Delete(&entity.TaskItem{}, id).Error
|
||||
}
|
||||
|
||||
// DeleteByTaskID 根据任务ID删除所有任务项
|
||||
func (r *TaskItemRepositoryImpl) DeleteByTaskID(taskID uint) error {
|
||||
return r.db.Where("task_id = ?", taskID).Delete(&entity.TaskItem{}).Error
|
||||
}
|
||||
|
||||
// GetByTaskIDAndStatus 根据任务ID和状态获取任务项
|
||||
func (r *TaskItemRepositoryImpl) GetByTaskIDAndStatus(taskID uint, status string) ([]*entity.TaskItem, error) {
|
||||
var items []*entity.TaskItem
|
||||
err := r.db.Where("task_id = ? AND status = ?", taskID, status).Order("id ASC").Find(&items).Error
|
||||
return items, err
|
||||
}
|
||||
|
||||
// GetListByTaskID 根据任务ID分页获取任务项
|
||||
func (r *TaskItemRepositoryImpl) GetListByTaskID(taskID uint, page, pageSize int, status string) ([]*entity.TaskItem, int64, error) {
|
||||
var items []*entity.TaskItem
|
||||
var total int64
|
||||
|
||||
query := r.db.Model(&entity.TaskItem{}).Where("task_id = ?", taskID)
|
||||
|
||||
// 添加状态过滤
|
||||
if status != "" {
|
||||
query = query.Where("status = ?", status)
|
||||
}
|
||||
|
||||
// 获取总数
|
||||
err := query.Count(&total).Error
|
||||
if err != nil {
|
||||
return nil, 0, err
|
||||
}
|
||||
|
||||
// 分页查询
|
||||
offset := (page - 1) * pageSize
|
||||
err = query.Offset(offset).Limit(pageSize).Order("id ASC").Find(&items).Error
|
||||
if err != nil {
|
||||
return nil, 0, err
|
||||
}
|
||||
|
||||
return items, total, nil
|
||||
}
|
||||
|
||||
// UpdateStatus 更新任务项状态
|
||||
func (r *TaskItemRepositoryImpl) UpdateStatus(id uint, status string) error {
|
||||
return r.db.Model(&entity.TaskItem{}).Where("id = ?", id).Update("status", status).Error
|
||||
}
|
||||
|
||||
// UpdateStatusAndOutput 更新任务项状态和输出数据
|
||||
func (r *TaskItemRepositoryImpl) UpdateStatusAndOutput(id uint, status, outputData string) error {
|
||||
return r.db.Model(&entity.TaskItem{}).Where("id = ?", id).Updates(map[string]interface{}{
|
||||
"status": status,
|
||||
"output_data": outputData,
|
||||
}).Error
|
||||
}
|
||||
|
||||
// GetStatsByTaskID 获取任务项统计信息
|
||||
func (r *TaskItemRepositoryImpl) GetStatsByTaskID(taskID uint) (map[string]int, error) {
|
||||
var results []struct {
|
||||
Status string
|
||||
Count int
|
||||
}
|
||||
|
||||
err := r.db.Model(&entity.TaskItem{}).
|
||||
Select("status, count(*) as count").
|
||||
Where("task_id = ?", taskID).
|
||||
Group("status").
|
||||
Find(&results).Error
|
||||
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
|
||||
stats := map[string]int{
|
||||
"total": 0,
|
||||
"pending": 0,
|
||||
"processing": 0,
|
||||
"completed": 0,
|
||||
"failed": 0,
|
||||
}
|
||||
|
||||
for _, result := range results {
|
||||
stats[result.Status] = result.Count
|
||||
stats["total"] += result.Count
|
||||
}
|
||||
|
||||
return stats, nil
|
||||
}
|
||||
|
||||
// ResetProcessingItems 重置处理中的任务项为pending状态
|
||||
func (r *TaskItemRepositoryImpl) ResetProcessingItems(taskID uint) error {
|
||||
return r.db.Model(&entity.TaskItem{}).
|
||||
Where("task_id = ? AND status = ?", taskID, "processing").
|
||||
Update("status", "pending").Error
|
||||
}
|
||||
136
db/repo/task_repository.go
Normal file
@@ -0,0 +1,136 @@
|
||||
package repo
|
||||
|
||||
import (
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"gorm.io/gorm"
|
||||
)
|
||||
|
||||
// TaskRepository 任务仓库接口
|
||||
type TaskRepository interface {
|
||||
GetByID(id uint) (*entity.Task, error)
|
||||
Create(task *entity.Task) error
|
||||
Delete(id uint) error
|
||||
GetList(page, pageSize int, taskType, status string) ([]*entity.Task, int64, error)
|
||||
UpdateStatus(id uint, status string) error
|
||||
UpdateProgress(id uint, progress float64, progressData string) error
|
||||
UpdateStatusAndMessage(id uint, status, message string) error
|
||||
UpdateTaskStats(id uint, processed, success, failed int) error
|
||||
}
|
||||
|
||||
// TaskRepositoryImpl 任务仓库实现
|
||||
type TaskRepositoryImpl struct {
|
||||
db *gorm.DB
|
||||
}
|
||||
|
||||
// NewTaskRepository 创建任务仓库
|
||||
func NewTaskRepository(db *gorm.DB) TaskRepository {
|
||||
return &TaskRepositoryImpl{
|
||||
db: db,
|
||||
}
|
||||
}
|
||||
|
||||
// GetByID 根据ID获取任务
|
||||
func (r *TaskRepositoryImpl) GetByID(id uint) (*entity.Task, error) {
|
||||
var task entity.Task
|
||||
err := r.db.First(&task, id).Error
|
||||
if err != nil {
|
||||
return nil, err
|
||||
}
|
||||
return &task, nil
|
||||
}
|
||||
|
||||
// Create 创建任务
|
||||
func (r *TaskRepositoryImpl) Create(task *entity.Task) error {
|
||||
return r.db.Create(task).Error
|
||||
}
|
||||
|
||||
// Delete 删除任务
|
||||
func (r *TaskRepositoryImpl) Delete(id uint) error {
|
||||
return r.db.Delete(&entity.Task{}, id).Error
|
||||
}
|
||||
|
||||
// GetList 获取任务列表
|
||||
func (r *TaskRepositoryImpl) GetList(page, pageSize int, taskType, status string) ([]*entity.Task, int64, error) {
|
||||
var tasks []*entity.Task
|
||||
var total int64
|
||||
|
||||
query := r.db.Model(&entity.Task{})
|
||||
|
||||
// 添加过滤条件
|
||||
if taskType != "" {
|
||||
query = query.Where("task_type = ?", taskType)
|
||||
}
|
||||
if status != "" {
|
||||
query = query.Where("status = ?", status)
|
||||
}
|
||||
|
||||
// 获取总数
|
||||
err := query.Count(&total).Error
|
||||
if err != nil {
|
||||
return nil, 0, err
|
||||
}
|
||||
|
||||
// 分页查询
|
||||
offset := (page - 1) * pageSize
|
||||
err = query.Offset(offset).Limit(pageSize).Order("created_at DESC").Find(&tasks).Error
|
||||
if err != nil {
|
||||
return nil, 0, err
|
||||
}
|
||||
|
||||
return tasks, total, nil
|
||||
}
|
||||
|
||||
// UpdateStatus 更新任务状态
|
||||
func (r *TaskRepositoryImpl) UpdateStatus(id uint, status string) error {
|
||||
return r.db.Model(&entity.Task{}).Where("id = ?", id).Update("status", status).Error
|
||||
}
|
||||
|
||||
// UpdateProgress 更新任务进度
|
||||
func (r *TaskRepositoryImpl) UpdateProgress(id uint, progress float64, progressData string) error {
|
||||
// 检查progress和progress_data字段是否存在
|
||||
var count int64
|
||||
err := r.db.Raw("SELECT COUNT(*) FROM information_schema.columns WHERE table_name = 'tasks' AND column_name = 'progress'").Count(&count).Error
|
||||
if err != nil || count == 0 {
|
||||
// 如果检查失败或字段不存在,只更新processed_items等现有字段
|
||||
return r.db.Model(&entity.Task{}).Where("id = ?", id).Updates(map[string]interface{}{
|
||||
"processed_items": progress, // 使用progress作为processed_items的近似值
|
||||
}).Error
|
||||
}
|
||||
|
||||
// 字段存在,正常更新
|
||||
return r.db.Model(&entity.Task{}).Where("id = ?", id).Updates(map[string]interface{}{
|
||||
"progress": progress,
|
||||
"progress_data": progressData,
|
||||
}).Error
|
||||
}
|
||||
|
||||
// UpdateStatusAndMessage 更新任务状态和消息
|
||||
func (r *TaskRepositoryImpl) UpdateStatusAndMessage(id uint, status, message string) error {
|
||||
// 检查message字段是否存在
|
||||
var count int64
|
||||
err := r.db.Raw("SELECT COUNT(*) FROM information_schema.columns WHERE table_name = 'tasks' AND column_name = 'message'").Count(&count).Error
|
||||
if err != nil {
|
||||
// 如果检查失败,只更新状态
|
||||
return r.db.Model(&entity.Task{}).Where("id = ?", id).Update("status", status).Error
|
||||
}
|
||||
|
||||
if count > 0 {
|
||||
// message字段存在,更新状态和消息
|
||||
return r.db.Model(&entity.Task{}).Where("id = ?", id).Updates(map[string]interface{}{
|
||||
"status": status,
|
||||
"message": message,
|
||||
}).Error
|
||||
} else {
|
||||
// message字段不存在,只更新状态
|
||||
return r.db.Model(&entity.Task{}).Where("id = ?", id).Update("status", status).Error
|
||||
}
|
||||
}
|
||||
|
||||
// UpdateTaskStats 更新任务统计信息
|
||||
func (r *TaskRepositoryImpl) UpdateTaskStats(id uint, processed, success, failed int) error {
|
||||
return r.db.Model(&entity.Task{}).Where("id = ?", id).Updates(map[string]interface{}{
|
||||
"processed_items": processed,
|
||||
"success_items": success,
|
||||
"failed_items": failed,
|
||||
}).Error
|
||||
}
|
||||
@@ -20,7 +20,7 @@ services:
|
||||
- app-network
|
||||
|
||||
backend:
|
||||
image: ctwj/urldb-backend:1.0.7
|
||||
image: ctwj/urldb-backend:1.1.0
|
||||
environment:
|
||||
DB_HOST: postgres
|
||||
DB_PORT: 5432
|
||||
@@ -28,6 +28,7 @@ services:
|
||||
DB_PASSWORD: password
|
||||
DB_NAME: url_db
|
||||
PORT: 8080
|
||||
TIMEZONE: Asia/Shanghai
|
||||
depends_on:
|
||||
postgres:
|
||||
condition: service_healthy
|
||||
@@ -37,7 +38,7 @@ services:
|
||||
- app-network
|
||||
|
||||
frontend:
|
||||
image: ctwj/urldb-frontend:1.0.7
|
||||
image: ctwj/urldb-frontend:1.1.0
|
||||
environment:
|
||||
NUXT_PUBLIC_API_SERVER: http://backend:8080/api
|
||||
NUXT_PUBLIC_API_CLIENT: /api
|
||||
|
||||
@@ -1 +1 @@
|
||||
p.l9.lc
|
||||
doc.l9.lc
|
||||
@@ -2,17 +2,14 @@
|
||||
|
||||
* [🏠 首页](/)
|
||||
* [🚀 快速开始](guide/quick-start.md)
|
||||
* [⚙️ 系统配置](guide/configuration.md)
|
||||
* [🐳 Docker部署](guide/docker-deployment.md)
|
||||
* [💻 本地开发](guide/local-development.md)
|
||||
|
||||
* 📚 API 文档
|
||||
* [公开API](api/overview.md)
|
||||
|
||||
* 📖 使用指南
|
||||
* [配置多账号](usage/user-account.md)
|
||||
* [配置自动处理资源](usage/resource-auto.md)
|
||||
* [配置自动转存分享](usage/save-auto.md)
|
||||
|
||||
* 📄 其他
|
||||
* [常见问题](faq.md)
|
||||
* [更新日志](changelog.md)
|
||||
* [许可证](license.md)
|
||||
* [许可证](license.md)
|
||||
* [版本管理](github-version-management.md)
|
||||
@@ -1,10 +1,14 @@
|
||||
// docsify 配置文件
|
||||
window.$docsify = {
|
||||
name: 'URL数据库管理系统',
|
||||
name: '老九网盘链接数据库',
|
||||
repo: 'https://github.com/ctwj/urldb',
|
||||
loadSidebar: true,
|
||||
loadSidebar: '_sidebar.md',
|
||||
subMaxLevel: 3,
|
||||
auto2top: true,
|
||||
// 添加侧边栏配置
|
||||
sidebarDisplayLevel: 1,
|
||||
// 添加错误处理
|
||||
notFoundPage: true,
|
||||
search: {
|
||||
maxAge: 86400000,
|
||||
paths: 'auto',
|
||||
@@ -34,6 +38,16 @@ window.$docsify = {
|
||||
'最后更新: ' + new Date().toLocaleDateString('zh-CN') +
|
||||
'</div>';
|
||||
});
|
||||
|
||||
// 添加侧边栏加载调试
|
||||
hook.doneEach(function() {
|
||||
console.log('Docsify loaded, sidebar should be visible');
|
||||
if (document.querySelector('.sidebar-nav')) {
|
||||
console.log('Sidebar element found');
|
||||
} else {
|
||||
console.log('Sidebar element not found');
|
||||
}
|
||||
});
|
||||
}
|
||||
]
|
||||
};
|
||||
@@ -12,8 +12,8 @@
|
||||
</head>
|
||||
<body>
|
||||
<div id="app"></div>
|
||||
<script src="./docsify.config.js"></script>
|
||||
<script src="//cdn.jsdelivr.net/npm/docsify@4"></script>
|
||||
<script src="docsify.config.js"></script>
|
||||
<script src="//cdn.jsdelivr.net/npm/docsify@4/lib/plugins/search.min.js"></script>
|
||||
<script src="//cdn.jsdelivr.net/npm/docsify@4/lib/plugins/copy-code.min.js"></script>
|
||||
<script src="//cdn.jsdelivr.net/npm/docsify@4/lib/plugins/pagination.min.js"></script>
|
||||
|
||||
@@ -7,6 +7,10 @@ DB_NAME=url_db
|
||||
|
||||
# 服务器配置
|
||||
PORT=8080
|
||||
GIN_MODE=release
|
||||
|
||||
# 时区配置
|
||||
TIMEZONE=Asia/Shanghai
|
||||
|
||||
# 文件上传配置
|
||||
UPLOAD_DIR=./uploads
|
||||
|
||||
BIN
github/account.webp
Normal file
|
After Width: | Height: | Size: 31 KiB |
BIN
github/admin.webp
Normal file
|
After Width: | Height: | Size: 45 KiB |
BIN
github/config.webp
Normal file
|
After Width: | Height: | Size: 32 KiB |
BIN
github/index.webp
Normal file
|
After Width: | Height: | Size: 49 KiB |
BIN
github/save.webp
Normal file
|
After Width: | Height: | Size: 66 KiB |
1
go.mod
@@ -35,6 +35,7 @@ require (
|
||||
github.com/klauspost/cpuid/v2 v2.3.0 // indirect
|
||||
github.com/kr/pretty v0.3.1 // indirect
|
||||
github.com/leodido/go-urn v1.4.0 // indirect
|
||||
github.com/matoous/go-nanoid/v2 v2.1.0
|
||||
github.com/mattn/go-isatty v0.0.20 // indirect
|
||||
github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd // indirect
|
||||
github.com/modern-go/reflect2 v1.0.2 // indirect
|
||||
|
||||
2
go.sum
@@ -76,6 +76,8 @@ github.com/kr/text v0.2.0/go.mod h1:eLer722TekiGuMkidMxC/pM04lWEeraHUUmBw8l2grE=
|
||||
github.com/leodido/go-urn v1.2.1/go.mod h1:zt4jvISO2HfUBqxjfIshjdMTYS56ZS/qv49ictyFfxY=
|
||||
github.com/leodido/go-urn v1.4.0 h1:WT9HwE9SGECu3lg4d/dIA+jxlljEa1/ffXKmRjqdmIQ=
|
||||
github.com/leodido/go-urn v1.4.0/go.mod h1:bvxc+MVxLKB4z00jd1z+Dvzr47oO32F/QSNjSBOlFxI=
|
||||
github.com/matoous/go-nanoid/v2 v2.1.0 h1:P64+dmq21hhWdtvZfEAofnvJULaRR1Yib0+PnU669bE=
|
||||
github.com/matoous/go-nanoid/v2 v2.1.0/go.mod h1:KlbGNQ+FhrUNIHUxZdL63t7tl4LaPkZNpUULS8H4uVM=
|
||||
github.com/mattn/go-isatty v0.0.14/go.mod h1:7GGIvUiUoEMVVmxf/4nioHXj79iQHKdU27kJ6hsGG94=
|
||||
github.com/mattn/go-isatty v0.0.20 h1:xfD0iDuEKnDkl03q4limB+vH+GxLEtL/jb4xVJSWWEY=
|
||||
github.com/mattn/go-isatty v0.0.20/go.mod h1:W+V8PltTTMOvKvAeJH7IuucS94S2C6jfK/D7dTCTo3Y=
|
||||
|
||||
@@ -7,6 +7,7 @@ import (
|
||||
"github.com/ctwj/urldb/db/converter"
|
||||
"github.com/ctwj/urldb/db/dto"
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
|
||||
"github.com/gin-gonic/gin"
|
||||
)
|
||||
@@ -18,6 +19,8 @@ func GetCategories(c *gin.Context) {
|
||||
pageSize, _ := strconv.Atoi(c.DefaultQuery("page_size", "20"))
|
||||
search := c.Query("search")
|
||||
|
||||
utils.Debug("获取分类列表 - 分页参数: page=%d, pageSize=%d, search=%s", page, pageSize, search)
|
||||
|
||||
var categories []entity.Category
|
||||
var total int64
|
||||
var err error
|
||||
@@ -35,6 +38,8 @@ func GetCategories(c *gin.Context) {
|
||||
return
|
||||
}
|
||||
|
||||
utils.Debug("查询到分类数量: %d, 总数: %d", len(categories), total)
|
||||
|
||||
// 获取每个分类的资源数量和标签名称
|
||||
resourceCounts := make(map[uint]int64)
|
||||
tagNamesMap := make(map[uint][]string)
|
||||
@@ -73,12 +78,50 @@ func CreateCategory(c *gin.Context) {
|
||||
return
|
||||
}
|
||||
|
||||
// 首先检查是否存在已删除的同名分类
|
||||
deletedCategory, err := repoManager.CategoryRepository.FindByNameIncludingDeleted(req.Name)
|
||||
if err == nil && deletedCategory.DeletedAt.Valid {
|
||||
utils.Debug("找到已删除的分类: ID=%d, Name=%s", deletedCategory.ID, deletedCategory.Name)
|
||||
|
||||
// 如果存在已删除的同名分类,则恢复它
|
||||
err = repoManager.CategoryRepository.RestoreDeletedCategory(deletedCategory.ID)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "恢复已删除分类失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
utils.Debug("分类恢复成功: ID=%d", deletedCategory.ID)
|
||||
|
||||
// 重新获取恢复后的分类
|
||||
restoredCategory, err := repoManager.CategoryRepository.FindByID(deletedCategory.ID)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "获取恢复的分类失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
utils.Debug("重新获取到恢复的分类: ID=%d, Name=%s", restoredCategory.ID, restoredCategory.Name)
|
||||
|
||||
// 更新分类信息
|
||||
restoredCategory.Description = req.Description
|
||||
err = repoManager.CategoryRepository.Update(restoredCategory)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "更新恢复的分类失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
utils.Debug("分类信息更新成功: ID=%d, Description=%s", restoredCategory.ID, restoredCategory.Description)
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"message": "分类恢复成功",
|
||||
"category": converter.ToCategoryResponse(restoredCategory, 0, []string{}),
|
||||
})
|
||||
return
|
||||
}
|
||||
|
||||
// 如果不存在已删除的同名分类,则创建新分类
|
||||
category := &entity.Category{
|
||||
Name: req.Name,
|
||||
Description: req.Description,
|
||||
}
|
||||
|
||||
err := repoManager.CategoryRepository.Create(category)
|
||||
err = repoManager.CategoryRepository.Create(category)
|
||||
if err != nil {
|
||||
ErrorResponse(c, err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
|
||||
@@ -324,7 +324,7 @@ func RefreshCapacity(c *gin.Context) {
|
||||
cks.UsedSpace = userInfo.UsedSpace
|
||||
cks.IsValid = userInfo.VIPStatus // 根据VIP状态更新有效性
|
||||
|
||||
err = repoManager.CksRepository.Update(cks)
|
||||
err = repoManager.CksRepository.UpdateWithAllFields(cks)
|
||||
if err != nil {
|
||||
ErrorResponse(c, err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
|
||||
@@ -2,9 +2,10 @@ package handlers
|
||||
|
||||
import (
|
||||
"strconv"
|
||||
"strings"
|
||||
|
||||
"github.com/ctwj/urldb/db/converter"
|
||||
"github.com/ctwj/urldb/db/dto"
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
|
||||
"github.com/gin-gonic/gin"
|
||||
)
|
||||
@@ -17,57 +18,54 @@ func NewPublicAPIHandler() *PublicAPIHandler {
|
||||
return &PublicAPIHandler{}
|
||||
}
|
||||
|
||||
// AddSingleResource godoc
|
||||
// @Summary 单个添加资源
|
||||
// @Description 通过公开API添加单个资源到待处理列表
|
||||
// @Tags PublicAPI
|
||||
// @Accept json
|
||||
// @Produce json
|
||||
// @Param X-API-Token header string true "API访问令牌"
|
||||
// @Param data body dto.ReadyResourceRequest true "资源信息"
|
||||
// @Success 200 {object} map[string]interface{} "添加成功"
|
||||
// @Failure 400 {object} map[string]interface{} "请求参数错误"
|
||||
// @Failure 401 {object} map[string]interface{} "认证失败"
|
||||
// @Failure 500 {object} map[string]interface{} "服务器内部错误"
|
||||
// @Router /api/public/resources/add [post]
|
||||
func (h *PublicAPIHandler) AddSingleResource(c *gin.Context) {
|
||||
var req dto.ReadyResourceRequest
|
||||
if err := c.ShouldBindJSON(&req); err != nil {
|
||||
ErrorResponse(c, "请求参数错误: "+err.Error(), 400)
|
||||
return
|
||||
}
|
||||
|
||||
// 验证必填字段
|
||||
if req.Title == "" {
|
||||
ErrorResponse(c, "标题不能为空", 400)
|
||||
return
|
||||
}
|
||||
|
||||
if req.Url == "" {
|
||||
ErrorResponse(c, "URL不能为空", 400)
|
||||
return
|
||||
}
|
||||
|
||||
// 转换为实体
|
||||
readyResource := converter.RequestToReadyResource(&req)
|
||||
if readyResource == nil {
|
||||
ErrorResponse(c, "数据转换失败", 500)
|
||||
return
|
||||
}
|
||||
|
||||
// 设置来源
|
||||
readyResource.Source = "公开API"
|
||||
|
||||
// 保存到数据库
|
||||
err := repoManager.ReadyResourceRepository.Create(readyResource)
|
||||
// filterForbiddenWords 过滤包含违禁词的资源
|
||||
func (h *PublicAPIHandler) filterForbiddenWords(resources []entity.Resource) ([]entity.Resource, []string) {
|
||||
// 获取违禁词配置
|
||||
forbiddenWords, err := repoManager.SystemConfigRepository.GetConfigValue(entity.ConfigKeyForbiddenWords)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "添加资源失败: "+err.Error(), 500)
|
||||
return
|
||||
// 如果获取失败,返回原资源列表
|
||||
return resources, nil
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"id": readyResource.ID,
|
||||
})
|
||||
if forbiddenWords == "" {
|
||||
return resources, nil
|
||||
}
|
||||
|
||||
// 分割违禁词
|
||||
words := strings.Split(forbiddenWords, ",")
|
||||
var filteredResources []entity.Resource
|
||||
var foundForbiddenWords []string
|
||||
|
||||
for _, resource := range resources {
|
||||
shouldSkip := false
|
||||
title := strings.ToLower(resource.Title)
|
||||
description := strings.ToLower(resource.Description)
|
||||
|
||||
for _, word := range words {
|
||||
word = strings.TrimSpace(word)
|
||||
if word != "" && (strings.Contains(title, strings.ToLower(word)) || strings.Contains(description, strings.ToLower(word))) {
|
||||
foundForbiddenWords = append(foundForbiddenWords, word)
|
||||
shouldSkip = true
|
||||
break
|
||||
}
|
||||
}
|
||||
|
||||
if !shouldSkip {
|
||||
filteredResources = append(filteredResources, resource)
|
||||
}
|
||||
}
|
||||
|
||||
// 去重违禁词
|
||||
uniqueForbiddenWords := make([]string, 0)
|
||||
wordMap := make(map[string]bool)
|
||||
for _, word := range foundForbiddenWords {
|
||||
if !wordMap[word] {
|
||||
wordMap[word] = true
|
||||
uniqueForbiddenWords = append(uniqueForbiddenWords, word)
|
||||
}
|
||||
}
|
||||
|
||||
return filteredResources, uniqueForbiddenWords
|
||||
}
|
||||
|
||||
// AddBatchResources godoc
|
||||
@@ -95,26 +93,62 @@ func (h *PublicAPIHandler) AddBatchResources(c *gin.Context) {
|
||||
return
|
||||
}
|
||||
|
||||
// 验证每个资源
|
||||
for i, resource := range req.Resources {
|
||||
if resource.Title == "" {
|
||||
ErrorResponse(c, "第"+strconv.Itoa(i+1)+"个资源标题不能为空", 400)
|
||||
return
|
||||
}
|
||||
|
||||
if resource.Url == "" {
|
||||
ErrorResponse(c, "第"+strconv.Itoa(i+1)+"个资源URL不能为空", 400)
|
||||
return
|
||||
// 收集所有待提交的URL,去重
|
||||
urlSet := make(map[string]struct{})
|
||||
for _, resource := range req.Resources {
|
||||
for _, u := range resource.Url {
|
||||
if u != "" {
|
||||
urlSet[u] = struct{}{}
|
||||
}
|
||||
}
|
||||
}
|
||||
uniqueUrls := make([]string, 0, len(urlSet))
|
||||
for url := range urlSet {
|
||||
uniqueUrls = append(uniqueUrls, url)
|
||||
}
|
||||
|
||||
// 批量查重
|
||||
readyList, _ := repoManager.ReadyResourceRepository.BatchFindByURLs(uniqueUrls)
|
||||
existReadyUrls := make(map[string]struct{})
|
||||
for _, r := range readyList {
|
||||
existReadyUrls[r.URL] = struct{}{}
|
||||
}
|
||||
resourceList, _ := repoManager.ResourceRepository.BatchFindByURLs(uniqueUrls)
|
||||
existResourceUrls := make(map[string]struct{})
|
||||
for _, r := range resourceList {
|
||||
existResourceUrls[r.URL] = struct{}{}
|
||||
}
|
||||
|
||||
// 批量保存
|
||||
var createdResources []uint
|
||||
for _, resourceReq := range req.Resources {
|
||||
readyResource := converter.RequestToReadyResource(&resourceReq)
|
||||
if readyResource != nil {
|
||||
readyResource.Source = "公开API批量添加"
|
||||
err := repoManager.ReadyResourceRepository.Create(readyResource)
|
||||
// 生成 key(每组同一个 key)
|
||||
key, err := repoManager.ReadyResourceRepository.GenerateUniqueKey()
|
||||
if err != nil {
|
||||
ErrorResponse(c, "生成资源组标识失败: "+err.Error(), 500)
|
||||
return
|
||||
}
|
||||
for _, url := range resourceReq.Url {
|
||||
if url == "" {
|
||||
continue
|
||||
}
|
||||
if _, ok := existReadyUrls[url]; ok {
|
||||
continue
|
||||
}
|
||||
if _, ok := existResourceUrls[url]; ok {
|
||||
continue
|
||||
}
|
||||
readyResource := entity.ReadyResource{
|
||||
Title: &resourceReq.Title,
|
||||
Description: resourceReq.Description,
|
||||
URL: url,
|
||||
Category: resourceReq.Category,
|
||||
Tags: resourceReq.Tags,
|
||||
Img: resourceReq.Img,
|
||||
Source: "api",
|
||||
Extra: resourceReq.Extra,
|
||||
Key: key,
|
||||
}
|
||||
err := repoManager.ReadyResourceRepository.Create(&readyResource)
|
||||
if err == nil {
|
||||
createdResources = append(createdResources, readyResource.ID)
|
||||
}
|
||||
@@ -129,7 +163,7 @@ func (h *PublicAPIHandler) AddBatchResources(c *gin.Context) {
|
||||
|
||||
// SearchResources godoc
|
||||
// @Summary 资源搜索
|
||||
// @Description 搜索资源,支持关键词、标签、分类过滤
|
||||
// @Description 搜索资源,支持关键词、标签、分类过滤,自动过滤包含违禁词的资源
|
||||
// @Tags PublicAPI
|
||||
// @Accept json
|
||||
// @Produce json
|
||||
@@ -139,7 +173,7 @@ func (h *PublicAPIHandler) AddBatchResources(c *gin.Context) {
|
||||
// @Param category query string false "分类过滤"
|
||||
// @Param page query int false "页码" default(1)
|
||||
// @Param page_size query int false "每页数量" default(20) maximum(100)
|
||||
// @Success 200 {object} map[string]interface{} "搜索成功"
|
||||
// @Success 200 {object} map[string]interface{} "搜索成功,如果存在违禁词过滤会返回forbidden_words_filtered字段"
|
||||
// @Failure 401 {object} map[string]interface{} "认证失败"
|
||||
// @Failure 500 {object} map[string]interface{} "服务器内部错误"
|
||||
// @Router /api/public/resources/search [get]
|
||||
@@ -186,9 +220,15 @@ func (h *PublicAPIHandler) SearchResources(c *gin.Context) {
|
||||
return
|
||||
}
|
||||
|
||||
// 过滤违禁词
|
||||
filteredResources, foundForbiddenWords := h.filterForbiddenWords(resources)
|
||||
|
||||
// 计算过滤后的总数
|
||||
filteredTotal := len(filteredResources)
|
||||
|
||||
// 转换为响应格式
|
||||
var resourceResponses []gin.H
|
||||
for _, resource := range resources {
|
||||
for _, resource := range filteredResources {
|
||||
resourceResponses = append(resourceResponses, gin.H{
|
||||
"id": resource.ID,
|
||||
"title": resource.Title,
|
||||
@@ -200,12 +240,23 @@ func (h *PublicAPIHandler) SearchResources(c *gin.Context) {
|
||||
})
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
// 构建响应数据
|
||||
responseData := gin.H{
|
||||
"list": resourceResponses,
|
||||
"total": total,
|
||||
"total": filteredTotal,
|
||||
"page": page,
|
||||
"limit": pageSize,
|
||||
})
|
||||
}
|
||||
|
||||
// 如果存在违禁词过滤,添加提醒字段
|
||||
if len(foundForbiddenWords) > 0 {
|
||||
responseData["forbidden_words_filtered"] = true
|
||||
responseData["filtered_forbidden_words"] = foundForbiddenWords
|
||||
responseData["original_total"] = total
|
||||
responseData["filtered_count"] = total - int64(filteredTotal)
|
||||
}
|
||||
|
||||
SuccessResponse(c, responseData)
|
||||
}
|
||||
|
||||
// GetHotDramas godoc
|
||||
|
||||
@@ -46,53 +46,6 @@ func GetReadyResources(c *gin.Context) {
|
||||
})
|
||||
}
|
||||
|
||||
// CreateReadyResource 创建待处理资源
|
||||
func CreateReadyResource(c *gin.Context) {
|
||||
var req dto.CreateReadyResourceRequest
|
||||
if err := c.ShouldBindJSON(&req); err != nil {
|
||||
ErrorResponse(c, err.Error(), http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
if req.URL != "" {
|
||||
// 检查待处理资源表
|
||||
readyList, _ := repoManager.ReadyResourceRepository.BatchFindByURLs([]string{req.URL})
|
||||
if len(readyList) > 0 {
|
||||
ErrorResponse(c, "该URL已存在于待处理资源列表", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
// 检查资源表
|
||||
resourceList, _ := repoManager.ResourceRepository.BatchFindByURLs([]string{req.URL})
|
||||
if len(resourceList) > 0 {
|
||||
ErrorResponse(c, "该URL已存在于资源列表", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
}
|
||||
|
||||
resource := &entity.ReadyResource{
|
||||
Title: req.Title,
|
||||
Description: req.Description,
|
||||
URL: req.URL,
|
||||
Category: req.Category,
|
||||
Tags: req.Tags,
|
||||
Img: req.Img,
|
||||
Source: req.Source,
|
||||
Extra: req.Extra,
|
||||
IP: req.IP,
|
||||
}
|
||||
|
||||
err := repoManager.ReadyResourceRepository.Create(resource)
|
||||
if err != nil {
|
||||
ErrorResponse(c, err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"id": resource.ID,
|
||||
"message": "待处理资源创建成功",
|
||||
})
|
||||
}
|
||||
|
||||
// BatchCreateReadyResources 批量创建待处理资源
|
||||
func BatchCreateReadyResources(c *gin.Context) {
|
||||
var req dto.BatchCreateReadyResourceRequest
|
||||
@@ -104,10 +57,14 @@ func BatchCreateReadyResources(c *gin.Context) {
|
||||
// 1. 先收集所有待提交的URL,去重
|
||||
urlSet := make(map[string]struct{})
|
||||
for _, reqResource := range req.Resources {
|
||||
if reqResource.URL == "" {
|
||||
if len(reqResource.URL) == 0 {
|
||||
continue
|
||||
}
|
||||
urlSet[reqResource.URL] = struct{}{}
|
||||
for _, u := range reqResource.URL {
|
||||
if u != "" {
|
||||
urlSet[u] = struct{}{}
|
||||
}
|
||||
}
|
||||
}
|
||||
uniqueUrls := make([]string, 0, len(urlSet))
|
||||
for url := range urlSet {
|
||||
@@ -132,31 +89,42 @@ func BatchCreateReadyResources(c *gin.Context) {
|
||||
}
|
||||
}
|
||||
|
||||
// 4. 过滤掉已存在的URL
|
||||
// 5. 过滤掉已存在的URL
|
||||
var resources []entity.ReadyResource
|
||||
for _, reqResource := range req.Resources {
|
||||
url := reqResource.URL
|
||||
if url == "" {
|
||||
if len(reqResource.URL) == 0 {
|
||||
continue
|
||||
}
|
||||
if _, ok := existReadyUrls[url]; ok {
|
||||
continue
|
||||
key, err := repoManager.ReadyResourceRepository.GenerateUniqueKey()
|
||||
if err != nil {
|
||||
ErrorResponse(c, "生成批量资源组标识失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
if _, ok := existResourceUrls[url]; ok {
|
||||
continue
|
||||
for _, url := range reqResource.URL {
|
||||
if url == "" {
|
||||
continue
|
||||
}
|
||||
if _, ok := existReadyUrls[url]; ok {
|
||||
continue
|
||||
}
|
||||
if _, ok := existResourceUrls[url]; ok {
|
||||
continue
|
||||
}
|
||||
|
||||
resource := entity.ReadyResource{
|
||||
Title: reqResource.Title,
|
||||
Description: reqResource.Description,
|
||||
URL: url,
|
||||
Category: reqResource.Category,
|
||||
Tags: reqResource.Tags,
|
||||
Img: reqResource.Img,
|
||||
Source: reqResource.Source,
|
||||
Extra: reqResource.Extra,
|
||||
IP: reqResource.IP,
|
||||
Key: key,
|
||||
}
|
||||
resources = append(resources, resource)
|
||||
}
|
||||
resource := entity.ReadyResource{
|
||||
Title: reqResource.Title,
|
||||
Description: reqResource.Description,
|
||||
URL: reqResource.URL,
|
||||
Category: reqResource.Category,
|
||||
Tags: reqResource.Tags,
|
||||
Img: reqResource.Img,
|
||||
Source: reqResource.Source,
|
||||
Extra: reqResource.Extra,
|
||||
IP: reqResource.IP,
|
||||
}
|
||||
resources = append(resources, resource)
|
||||
}
|
||||
|
||||
if len(resources) == 0 {
|
||||
@@ -261,3 +229,346 @@ func ClearReadyResources(c *gin.Context) {
|
||||
"message": "所有待处理资源已清空",
|
||||
})
|
||||
}
|
||||
|
||||
// GetReadyResourcesByKey 根据key获取待处理资源
|
||||
func GetReadyResourcesByKey(c *gin.Context) {
|
||||
key := c.Param("key")
|
||||
if key == "" {
|
||||
ErrorResponse(c, "key参数不能为空", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
resources, err := repoManager.ReadyResourceRepository.FindByKey(key)
|
||||
if err != nil {
|
||||
ErrorResponse(c, err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
responses := converter.ToReadyResourceResponseList(resources)
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"data": responses,
|
||||
"key": key,
|
||||
"count": len(resources),
|
||||
})
|
||||
}
|
||||
|
||||
// DeleteReadyResourcesByKey 根据key删除待处理资源
|
||||
func DeleteReadyResourcesByKey(c *gin.Context) {
|
||||
key := c.Param("key")
|
||||
if key == "" {
|
||||
ErrorResponse(c, "key参数不能为空", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
// 先查询要删除的资源数量
|
||||
resources, err := repoManager.ReadyResourceRepository.FindByKey(key)
|
||||
if err != nil {
|
||||
ErrorResponse(c, err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
if len(resources) == 0 {
|
||||
ErrorResponse(c, "未找到指定key的资源", http.StatusNotFound)
|
||||
return
|
||||
}
|
||||
|
||||
// 删除所有具有相同key的资源
|
||||
err = repoManager.ReadyResourceRepository.DeleteByKey(key)
|
||||
if err != nil {
|
||||
ErrorResponse(c, err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"deleted_count": len(resources),
|
||||
"key": key,
|
||||
"message": "资源组删除成功",
|
||||
})
|
||||
}
|
||||
|
||||
// getRetryableErrorCount 统计可重试的错误数量
|
||||
func getRetryableErrorCount(resources []entity.ReadyResource) int {
|
||||
count := 0
|
||||
|
||||
for _, resource := range resources {
|
||||
if resource.ErrorMsg != "" {
|
||||
errorMsg := strings.ToUpper(resource.ErrorMsg)
|
||||
// 检查错误类型标记
|
||||
if strings.Contains(resource.ErrorMsg, "[NO_ACCOUNT]") ||
|
||||
strings.Contains(resource.ErrorMsg, "[NO_VALID_ACCOUNT]") ||
|
||||
strings.Contains(resource.ErrorMsg, "[TRANSFER_FAILED]") ||
|
||||
strings.Contains(resource.ErrorMsg, "[LINK_CHECK_FAILED]") {
|
||||
count++
|
||||
} else if strings.Contains(errorMsg, "没有可用的网盘账号") ||
|
||||
strings.Contains(errorMsg, "没有有效的网盘账号") ||
|
||||
strings.Contains(errorMsg, "网盘信息获取失败") ||
|
||||
strings.Contains(errorMsg, "链接检查失败") {
|
||||
count++
|
||||
}
|
||||
}
|
||||
}
|
||||
return count
|
||||
}
|
||||
|
||||
// GetReadyResourcesWithErrors 获取有错误信息的待处理资源
|
||||
func GetReadyResourcesWithErrors(c *gin.Context) {
|
||||
// 获取分页参数
|
||||
pageStr := c.DefaultQuery("page", "1")
|
||||
pageSizeStr := c.DefaultQuery("page_size", "100")
|
||||
errorFilter := c.Query("error_filter")
|
||||
|
||||
page, err := strconv.Atoi(pageStr)
|
||||
if err != nil || page < 1 {
|
||||
page = 1
|
||||
}
|
||||
|
||||
pageSize, err := strconv.Atoi(pageSizeStr)
|
||||
if err != nil || pageSize < 1 || pageSize > 1000 {
|
||||
pageSize = 100
|
||||
}
|
||||
|
||||
// 获取有错误的资源(分页,包括软删除的)
|
||||
resources, total, err := repoManager.ReadyResourceRepository.FindWithErrorsPaginatedIncludingDeleted(page, pageSize, errorFilter)
|
||||
if err != nil {
|
||||
ErrorResponse(c, err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
responses := converter.ToReadyResourceResponseList(resources)
|
||||
|
||||
// 统计错误类型
|
||||
errorTypeStats := make(map[string]int)
|
||||
for _, resource := range resources {
|
||||
if resource.ErrorMsg != "" {
|
||||
// 尝试从错误信息中提取错误类型
|
||||
if len(resource.ErrorMsg) > 0 && resource.ErrorMsg[0] == '[' {
|
||||
endIndex := strings.Index(resource.ErrorMsg, "]")
|
||||
if endIndex > 0 {
|
||||
errorType := resource.ErrorMsg[1:endIndex]
|
||||
errorTypeStats[errorType]++
|
||||
} else {
|
||||
errorTypeStats["UNKNOWN"]++
|
||||
}
|
||||
} else {
|
||||
// 如果没有错误类型标记,尝试从错误信息中推断
|
||||
errorMsg := strings.ToUpper(resource.ErrorMsg)
|
||||
if strings.Contains(errorMsg, "不支持的链接") {
|
||||
errorTypeStats["UNSUPPORTED_LINK"]++
|
||||
} else if strings.Contains(errorMsg, "链接无效") {
|
||||
errorTypeStats["INVALID_LINK"]++
|
||||
} else if strings.Contains(errorMsg, "没有可用的网盘账号") {
|
||||
errorTypeStats["NO_ACCOUNT"]++
|
||||
} else if strings.Contains(errorMsg, "没有有效的网盘账号") {
|
||||
errorTypeStats["NO_VALID_ACCOUNT"]++
|
||||
} else if strings.Contains(errorMsg, "网盘信息获取失败") {
|
||||
errorTypeStats["TRANSFER_FAILED"]++
|
||||
} else if strings.Contains(errorMsg, "创建网盘服务失败") {
|
||||
errorTypeStats["SERVICE_CREATION_FAILED"]++
|
||||
} else if strings.Contains(errorMsg, "处理标签失败") {
|
||||
errorTypeStats["TAG_PROCESSING_FAILED"]++
|
||||
} else if strings.Contains(errorMsg, "处理分类失败") {
|
||||
errorTypeStats["CATEGORY_PROCESSING_FAILED"]++
|
||||
} else if strings.Contains(errorMsg, "资源保存失败") {
|
||||
errorTypeStats["RESOURCE_SAVE_FAILED"]++
|
||||
} else if strings.Contains(errorMsg, "未找到对应的平台ID") {
|
||||
errorTypeStats["PLATFORM_NOT_FOUND"]++
|
||||
} else if strings.Contains(errorMsg, "链接检查失败") {
|
||||
errorTypeStats["LINK_CHECK_FAILED"]++
|
||||
} else {
|
||||
errorTypeStats["UNKNOWN"]++
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"data": responses,
|
||||
"page": page,
|
||||
"page_size": pageSize,
|
||||
"total": total,
|
||||
"count": len(resources),
|
||||
"error_stats": errorTypeStats,
|
||||
"retryable_count": getRetryableErrorCount(resources),
|
||||
})
|
||||
}
|
||||
|
||||
// ClearErrorMsg 清除指定资源的错误信息
|
||||
func ClearErrorMsg(c *gin.Context) {
|
||||
idStr := c.Param("id")
|
||||
id, err := strconv.ParseUint(idStr, 10, 32)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "无效的ID", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
err = repoManager.ReadyResourceRepository.ClearErrorMsg(uint(id))
|
||||
if err != nil {
|
||||
ErrorResponse(c, err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{"message": "错误信息已清除"})
|
||||
}
|
||||
|
||||
// RetryFailedResources 重试失败的资源
|
||||
func RetryFailedResources(c *gin.Context) {
|
||||
// 获取有错误的资源
|
||||
resources, err := repoManager.ReadyResourceRepository.FindWithErrors()
|
||||
if err != nil {
|
||||
ErrorResponse(c, err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
if len(resources) == 0 {
|
||||
SuccessResponse(c, gin.H{
|
||||
"message": "没有需要重试的资源",
|
||||
"count": 0,
|
||||
})
|
||||
return
|
||||
}
|
||||
|
||||
// 只重试可重试的错误
|
||||
clearedCount := 0
|
||||
skippedCount := 0
|
||||
|
||||
for _, resource := range resources {
|
||||
isRetryable := false
|
||||
errorMsg := strings.ToUpper(resource.ErrorMsg)
|
||||
|
||||
// 检查错误类型标记
|
||||
if strings.Contains(resource.ErrorMsg, "[NO_ACCOUNT]") ||
|
||||
strings.Contains(resource.ErrorMsg, "[NO_VALID_ACCOUNT]") ||
|
||||
strings.Contains(resource.ErrorMsg, "[TRANSFER_FAILED]") ||
|
||||
strings.Contains(resource.ErrorMsg, "[LINK_CHECK_FAILED]") {
|
||||
isRetryable = true
|
||||
} else if strings.Contains(errorMsg, "没有可用的网盘账号") ||
|
||||
strings.Contains(errorMsg, "没有有效的网盘账号") ||
|
||||
strings.Contains(errorMsg, "网盘信息获取失败") ||
|
||||
strings.Contains(errorMsg, "链接检查失败") {
|
||||
isRetryable = true
|
||||
}
|
||||
|
||||
if isRetryable {
|
||||
if err := repoManager.ReadyResourceRepository.ClearErrorMsg(resource.ID); err == nil {
|
||||
clearedCount++
|
||||
}
|
||||
} else {
|
||||
skippedCount++
|
||||
}
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"message": "已清除可重试资源的错误信息,资源将在下次调度时重新处理",
|
||||
"total_count": len(resources),
|
||||
"cleared_count": clearedCount,
|
||||
"skipped_count": skippedCount,
|
||||
"retryable_count": getRetryableErrorCount(resources),
|
||||
})
|
||||
}
|
||||
|
||||
// BatchRestoreToReadyPool 批量将失败资源重新放入待处理池
|
||||
func BatchRestoreToReadyPool(c *gin.Context) {
|
||||
var req struct {
|
||||
IDs []uint `json:"ids" binding:"required"`
|
||||
}
|
||||
|
||||
if err := c.ShouldBindJSON(&req); err != nil {
|
||||
ErrorResponse(c, "请求参数错误: "+err.Error(), http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
if len(req.IDs) == 0 {
|
||||
ErrorResponse(c, "资源ID列表不能为空", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
successCount := 0
|
||||
failedCount := 0
|
||||
|
||||
for _, id := range req.IDs {
|
||||
// 清除错误信息并恢复软删除的资源
|
||||
err := repoManager.ReadyResourceRepository.ClearErrorMsgAndRestore(id)
|
||||
if err != nil {
|
||||
failedCount++
|
||||
continue
|
||||
}
|
||||
successCount++
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"message": "批量重新放入待处理池操作完成",
|
||||
"total_count": len(req.IDs),
|
||||
"success_count": successCount,
|
||||
"failed_count": failedCount,
|
||||
})
|
||||
}
|
||||
|
||||
// BatchRestoreToReadyPoolByQuery 根据查询条件批量将失败资源重新放入待处理池
|
||||
func BatchRestoreToReadyPoolByQuery(c *gin.Context) {
|
||||
var req struct {
|
||||
ErrorFilter string `json:"error_filter"`
|
||||
}
|
||||
if err := c.ShouldBindJSON(&req); err != nil {
|
||||
ErrorResponse(c, "请求参数错误: "+err.Error(), http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
// 根据查询条件获取所有符合条件的资源
|
||||
resources, err := repoManager.ReadyResourceRepository.FindWithErrorsByQuery(req.ErrorFilter)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "查询资源失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
if len(resources) == 0 {
|
||||
SuccessResponse(c, gin.H{
|
||||
"message": "没有找到符合条件的资源",
|
||||
"total_count": 0,
|
||||
"success_count": 0,
|
||||
"failed_count": 0,
|
||||
})
|
||||
return
|
||||
}
|
||||
|
||||
successCount := 0
|
||||
failedCount := 0
|
||||
for _, resource := range resources {
|
||||
err := repoManager.ReadyResourceRepository.ClearErrorMsgAndRestore(resource.ID)
|
||||
if err != nil {
|
||||
failedCount++
|
||||
continue
|
||||
}
|
||||
successCount++
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"message": "批量重新放入待处理池操作完成",
|
||||
"total_count": len(resources),
|
||||
"success_count": successCount,
|
||||
"failed_count": failedCount,
|
||||
})
|
||||
}
|
||||
|
||||
// ClearAllErrorsByQuery 根据查询条件批量清除错误信息并删除资源
|
||||
func ClearAllErrorsByQuery(c *gin.Context) {
|
||||
var req struct {
|
||||
ErrorFilter string `json:"error_filter"`
|
||||
}
|
||||
if err := c.ShouldBindJSON(&req); err != nil {
|
||||
ErrorResponse(c, "请求参数错误: "+err.Error(), http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
// 根据查询条件批量删除失败资源
|
||||
affectedRows, err := repoManager.ReadyResourceRepository.ClearAllErrorsByQuery(req.ErrorFilter)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "批量删除失败资源失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"message": "批量删除失败资源操作完成",
|
||||
"affected_rows": affectedRows,
|
||||
})
|
||||
}
|
||||
|
||||
@@ -1,12 +1,16 @@
|
||||
package handlers
|
||||
|
||||
import (
|
||||
"fmt"
|
||||
"net/http"
|
||||
"strconv"
|
||||
|
||||
pan "github.com/ctwj/urldb/common"
|
||||
commonutils "github.com/ctwj/urldb/common/utils"
|
||||
"github.com/ctwj/urldb/db/converter"
|
||||
"github.com/ctwj/urldb/db/dto"
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
|
||||
"github.com/gin-gonic/gin"
|
||||
)
|
||||
@@ -16,6 +20,8 @@ func GetResources(c *gin.Context) {
|
||||
page, _ := strconv.Atoi(c.DefaultQuery("page", "1"))
|
||||
pageSize, _ := strconv.Atoi(c.DefaultQuery("page_size", "20"))
|
||||
|
||||
utils.Info("资源列表请求 - page: %d, pageSize: %d", page, pageSize)
|
||||
|
||||
params := map[string]interface{}{
|
||||
"page": page,
|
||||
"page_size": pageSize,
|
||||
@@ -30,10 +36,29 @@ func GetResources(c *gin.Context) {
|
||||
}
|
||||
}
|
||||
if categoryID := c.Query("category_id"); categoryID != "" {
|
||||
utils.Info("收到分类ID参数: %s", categoryID)
|
||||
if id, err := strconv.ParseUint(categoryID, 10, 32); err == nil {
|
||||
params["category_id"] = uint(id)
|
||||
utils.Info("解析分类ID成功: %d", uint(id))
|
||||
} else {
|
||||
utils.Error("解析分类ID失败: %v", err)
|
||||
}
|
||||
}
|
||||
if hasSaveURL := c.Query("has_save_url"); hasSaveURL != "" {
|
||||
if hasSaveURL == "true" {
|
||||
params["has_save_url"] = true
|
||||
} else if hasSaveURL == "false" {
|
||||
params["has_save_url"] = false
|
||||
}
|
||||
}
|
||||
if noSaveURL := c.Query("no_save_url"); noSaveURL != "" {
|
||||
if noSaveURL == "true" {
|
||||
params["no_save_url"] = true
|
||||
}
|
||||
}
|
||||
if panName := c.Query("pan_name"); panName != "" {
|
||||
params["pan_name"] = panName
|
||||
}
|
||||
|
||||
resources, total, err := repoManager.ResourceRepository.SearchWithFilters(params)
|
||||
|
||||
@@ -120,7 +145,7 @@ func CreateResource(c *gin.Context) {
|
||||
Description: req.Description,
|
||||
URL: req.URL,
|
||||
PanID: req.PanID,
|
||||
QuarkURL: req.QuarkURL,
|
||||
SaveURL: req.SaveURL,
|
||||
FileSize: req.FileSize,
|
||||
CategoryID: req.CategoryID,
|
||||
IsValid: req.IsValid,
|
||||
@@ -185,8 +210,8 @@ func UpdateResource(c *gin.Context) {
|
||||
if req.PanID != nil {
|
||||
resource.PanID = req.PanID
|
||||
}
|
||||
if req.QuarkURL != "" {
|
||||
resource.QuarkURL = req.QuarkURL
|
||||
if req.SaveURL != "" {
|
||||
resource.SaveURL = req.SaveURL
|
||||
}
|
||||
if req.FileSize != "" {
|
||||
resource.FileSize = req.FileSize
|
||||
@@ -285,11 +310,23 @@ func IncrementResourceViewCount(c *gin.Context) {
|
||||
ErrorResponse(c, "无效的资源ID", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
// 增加资源访问量
|
||||
err = repoManager.ResourceRepository.IncrementViewCount(uint(id))
|
||||
if err != nil {
|
||||
ErrorResponse(c, "增加浏览次数失败", http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
// 记录访问记录
|
||||
ipAddress := c.ClientIP()
|
||||
userAgent := c.GetHeader("User-Agent")
|
||||
err = repoManager.ResourceViewRepository.RecordView(uint(id), ipAddress, userAgent)
|
||||
if err != nil {
|
||||
// 记录访问失败不影响主要功能,只记录日志
|
||||
utils.Error("记录资源访问失败: %v", err)
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{"message": "浏览次数+1"})
|
||||
}
|
||||
|
||||
@@ -310,3 +347,305 @@ func BatchDeleteResources(c *gin.Context) {
|
||||
}
|
||||
SuccessResponse(c, gin.H{"deleted": count, "message": "批量删除成功"})
|
||||
}
|
||||
|
||||
// GetResourceLink 获取资源链接(智能转存)
|
||||
func GetResourceLink(c *gin.Context) {
|
||||
// 获取资源ID
|
||||
resourceIDStr := c.Param("id")
|
||||
resourceID, err := strconv.ParseUint(resourceIDStr, 10, 32)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "无效的资源ID", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
utils.Info("获取资源链接请求 - resourceID: %d", resourceID)
|
||||
|
||||
// 查询资源信息
|
||||
resource, err := repoManager.ResourceRepository.FindByID(uint(resourceID))
|
||||
if err != nil {
|
||||
utils.Error("查询资源失败: %v", err)
|
||||
ErrorResponse(c, "资源不存在", http.StatusNotFound)
|
||||
return
|
||||
}
|
||||
|
||||
// 查询平台信息
|
||||
var panInfo entity.Pan
|
||||
if resource.PanID != nil {
|
||||
panPtr, err := repoManager.PanRepository.FindByID(*resource.PanID)
|
||||
if err != nil {
|
||||
utils.Error("查询平台信息失败: %v", err)
|
||||
} else if panPtr != nil {
|
||||
panInfo = *panPtr
|
||||
}
|
||||
}
|
||||
|
||||
utils.Info("资源信息 - 平台: %s, 原始链接: %s, 转存链接: %s", panInfo.Name, resource.URL, resource.SaveURL)
|
||||
|
||||
// 统计访问次数
|
||||
err = repoManager.ResourceRepository.IncrementViewCount(uint(resourceID))
|
||||
if err != nil {
|
||||
utils.Error("增加资源访问量失败: %v", err)
|
||||
}
|
||||
|
||||
// 记录访问记录
|
||||
ipAddress := c.ClientIP()
|
||||
userAgent := c.GetHeader("User-Agent")
|
||||
err = repoManager.ResourceViewRepository.RecordView(uint(resourceID), ipAddress, userAgent)
|
||||
if err != nil {
|
||||
utils.Error("记录资源访问失败: %v", err)
|
||||
}
|
||||
|
||||
// 如果不是夸克网盘,直接返回原链接
|
||||
if panInfo.Name != "quark" {
|
||||
utils.Info("非夸克资源,直接返回原链接")
|
||||
SuccessResponse(c, gin.H{
|
||||
"url": resource.URL,
|
||||
"type": "original",
|
||||
"platform": panInfo.Remark,
|
||||
"resource_id": resource.ID,
|
||||
})
|
||||
return
|
||||
}
|
||||
|
||||
// 夸克资源处理逻辑
|
||||
utils.Info("夸克资源处理开始")
|
||||
|
||||
// 如果已存在转存链接,直接返回
|
||||
if resource.SaveURL != "" {
|
||||
utils.Info("已存在转存链接,直接返回: %s", resource.SaveURL)
|
||||
SuccessResponse(c, gin.H{
|
||||
"url": resource.SaveURL,
|
||||
"type": "transferred",
|
||||
"platform": panInfo.Remark,
|
||||
"resource_id": resource.ID,
|
||||
})
|
||||
return
|
||||
}
|
||||
|
||||
// 检查是否开启自动转存
|
||||
autoTransferEnabled, err := repoManager.SystemConfigRepository.GetConfigBool(entity.ConfigKeyAutoTransferEnabled)
|
||||
if err != nil {
|
||||
utils.Error("获取自动转存配置失败: %v", err)
|
||||
// 配置获取失败,返回原链接
|
||||
SuccessResponse(c, gin.H{
|
||||
"url": resource.URL,
|
||||
"type": "original",
|
||||
"platform": panInfo.Remark,
|
||||
"resource_id": resource.ID,
|
||||
"message": "",
|
||||
})
|
||||
return
|
||||
}
|
||||
|
||||
if !autoTransferEnabled {
|
||||
utils.Info("自动转存功能未开启,返回原链接")
|
||||
SuccessResponse(c, gin.H{
|
||||
"url": resource.URL,
|
||||
"type": "original",
|
||||
"platform": panInfo.Remark,
|
||||
"resource_id": resource.ID,
|
||||
"message": "",
|
||||
})
|
||||
return
|
||||
}
|
||||
|
||||
// 执行自动转存
|
||||
utils.Info("开始执行自动转存")
|
||||
transferResult := performAutoTransfer(resource)
|
||||
|
||||
if transferResult.Success {
|
||||
utils.Info("自动转存成功,返回转存链接: %s", transferResult.SaveURL)
|
||||
SuccessResponse(c, gin.H{
|
||||
"url": transferResult.SaveURL,
|
||||
"type": "transferred",
|
||||
"platform": panInfo.Remark,
|
||||
"resource_id": resource.ID,
|
||||
"message": "资源易和谐,请及时用手机夸克扫码转存",
|
||||
})
|
||||
} else {
|
||||
utils.Error("自动转存失败: %s", transferResult.ErrorMsg)
|
||||
SuccessResponse(c, gin.H{
|
||||
"url": resource.URL,
|
||||
"type": "original",
|
||||
"platform": panInfo.Remark,
|
||||
"resource_id": resource.ID,
|
||||
"message": "",
|
||||
})
|
||||
}
|
||||
}
|
||||
|
||||
// TransferResult 转存结果
|
||||
type TransferResult struct {
|
||||
Success bool `json:"success"`
|
||||
SaveURL string `json:"save_url"`
|
||||
ErrorMsg string `json:"error_msg"`
|
||||
}
|
||||
|
||||
// performAutoTransfer 执行自动转存
|
||||
func performAutoTransfer(resource *entity.Resource) TransferResult {
|
||||
utils.Info("开始执行资源转存 - ID: %d, URL: %s", resource.ID, resource.URL)
|
||||
|
||||
// 获取夸克平台ID
|
||||
quarkPanID, err := getQuarkPanID()
|
||||
if err != nil {
|
||||
utils.Error("获取夸克平台ID失败: %v", err)
|
||||
return TransferResult{
|
||||
Success: false,
|
||||
ErrorMsg: fmt.Sprintf("获取夸克平台ID失败: %v", err),
|
||||
}
|
||||
}
|
||||
|
||||
// 获取可用的夸克账号
|
||||
accounts, err := repoManager.CksRepository.FindAll()
|
||||
if err != nil {
|
||||
utils.Error("获取网盘账号失败: %v", err)
|
||||
return TransferResult{
|
||||
Success: false,
|
||||
ErrorMsg: fmt.Sprintf("获取网盘账号失败: %v", err),
|
||||
}
|
||||
}
|
||||
|
||||
// 获取最小存储空间配置
|
||||
autoTransferMinSpace, err := repoManager.SystemConfigRepository.GetConfigInt(entity.ConfigKeyAutoTransferMinSpace)
|
||||
if err != nil {
|
||||
utils.Error("获取最小存储空间配置失败: %v", err)
|
||||
autoTransferMinSpace = 5 // 默认5GB
|
||||
}
|
||||
|
||||
// 过滤:只保留已激活、夸克平台、剩余空间足够的账号
|
||||
minSpaceBytes := int64(autoTransferMinSpace) * 1024 * 1024 * 1024
|
||||
var validAccounts []entity.Cks
|
||||
for _, acc := range accounts {
|
||||
if acc.IsValid && acc.PanID == quarkPanID && acc.LeftSpace >= minSpaceBytes {
|
||||
validAccounts = append(validAccounts, acc)
|
||||
}
|
||||
}
|
||||
|
||||
if len(validAccounts) == 0 {
|
||||
utils.Info("没有可用的夸克网盘账号")
|
||||
return TransferResult{
|
||||
Success: false,
|
||||
ErrorMsg: "没有可用的夸克网盘账号",
|
||||
}
|
||||
}
|
||||
|
||||
utils.Info("找到 %d 个可用夸克网盘账号,开始转存处理...", len(validAccounts))
|
||||
|
||||
// 使用第一个可用账号进行转存
|
||||
account := validAccounts[0]
|
||||
|
||||
// 创建网盘服务工厂
|
||||
factory := pan.NewPanFactory()
|
||||
|
||||
// 执行转存
|
||||
result := transferSingleResource(resource, account, factory)
|
||||
|
||||
if result.Success {
|
||||
// 更新资源的转存信息
|
||||
resource.SaveURL = result.SaveURL
|
||||
resource.ErrorMsg = ""
|
||||
if err := repoManager.ResourceRepository.Update(resource); err != nil {
|
||||
utils.Error("更新资源转存信息失败: %v", err)
|
||||
}
|
||||
} else {
|
||||
// 更新错误信息
|
||||
resource.ErrorMsg = result.ErrorMsg
|
||||
if err := repoManager.ResourceRepository.Update(resource); err != nil {
|
||||
utils.Error("更新资源错误信息失败: %v", err)
|
||||
}
|
||||
}
|
||||
|
||||
return result
|
||||
}
|
||||
|
||||
// transferSingleResource 转存单个资源
|
||||
func transferSingleResource(resource *entity.Resource, account entity.Cks, factory *pan.PanFactory) TransferResult {
|
||||
utils.Info("开始转存资源 - 资源ID: %d, 账号: %s", resource.ID, account.Username)
|
||||
|
||||
service, err := factory.CreatePanService(resource.URL, &pan.PanConfig{
|
||||
URL: resource.URL,
|
||||
ExpiredType: 0,
|
||||
IsType: 0,
|
||||
Cookie: account.Ck,
|
||||
})
|
||||
if err != nil {
|
||||
utils.Error("创建网盘服务失败: %v", err)
|
||||
return TransferResult{
|
||||
Success: false,
|
||||
ErrorMsg: fmt.Sprintf("创建网盘服务失败: %v", err),
|
||||
}
|
||||
}
|
||||
|
||||
// 提取分享ID
|
||||
shareID, _ := commonutils.ExtractShareIdString(resource.URL)
|
||||
if shareID == "" {
|
||||
return TransferResult{
|
||||
Success: false,
|
||||
ErrorMsg: "无效的分享链接",
|
||||
}
|
||||
}
|
||||
|
||||
// 执行转存
|
||||
transferResult, err := service.Transfer(shareID)
|
||||
if err != nil {
|
||||
utils.Error("转存失败: %v", err)
|
||||
return TransferResult{
|
||||
Success: false,
|
||||
ErrorMsg: fmt.Sprintf("转存失败: %v", err),
|
||||
}
|
||||
}
|
||||
|
||||
if transferResult == nil || !transferResult.Success {
|
||||
errMsg := "转存失败"
|
||||
if transferResult != nil && transferResult.Message != "" {
|
||||
errMsg = transferResult.Message
|
||||
}
|
||||
utils.Error("转存失败: %s", errMsg)
|
||||
return TransferResult{
|
||||
Success: false,
|
||||
ErrorMsg: errMsg,
|
||||
}
|
||||
}
|
||||
|
||||
// 提取转存链接
|
||||
var saveURL string
|
||||
if data, ok := transferResult.Data.(map[string]interface{}); ok {
|
||||
if v, ok := data["shareUrl"]; ok {
|
||||
saveURL, _ = v.(string)
|
||||
}
|
||||
}
|
||||
if saveURL == "" {
|
||||
saveURL = transferResult.ShareURL
|
||||
}
|
||||
|
||||
if saveURL == "" {
|
||||
return TransferResult{
|
||||
Success: false,
|
||||
ErrorMsg: "转存成功但未获取到分享链接",
|
||||
}
|
||||
}
|
||||
|
||||
utils.Info("转存成功 - 资源ID: %d, 转存链接: %s", resource.ID, saveURL)
|
||||
|
||||
return TransferResult{
|
||||
Success: true,
|
||||
SaveURL: saveURL,
|
||||
}
|
||||
}
|
||||
|
||||
// getQuarkPanID 获取夸克网盘ID
|
||||
func getQuarkPanID() (uint, error) {
|
||||
// 通过FindAll方法查找所有平台,然后过滤出quark平台
|
||||
pans, err := repoManager.PanRepository.FindAll()
|
||||
if err != nil {
|
||||
return 0, fmt.Errorf("查询平台信息失败: %v", err)
|
||||
}
|
||||
|
||||
for _, p := range pans {
|
||||
if p.Name == "quark" {
|
||||
return p.ID, nil
|
||||
}
|
||||
}
|
||||
|
||||
return 0, fmt.Errorf("未找到quark平台")
|
||||
}
|
||||
|
||||
@@ -3,19 +3,21 @@ package handlers
|
||||
import (
|
||||
"net/http"
|
||||
|
||||
"github.com/ctwj/urldb/utils"
|
||||
"github.com/ctwj/urldb/scheduler"
|
||||
"github.com/gin-gonic/gin"
|
||||
)
|
||||
|
||||
// GetSchedulerStatus 获取调度器状态
|
||||
func GetSchedulerStatus(c *gin.Context) {
|
||||
scheduler := utils.GetGlobalScheduler(
|
||||
scheduler := scheduler.GetGlobalScheduler(
|
||||
repoManager.HotDramaRepository,
|
||||
repoManager.ReadyResourceRepository,
|
||||
repoManager.ResourceRepository,
|
||||
repoManager.SystemConfigRepository,
|
||||
repoManager.PanRepository,
|
||||
repoManager.CksRepository,
|
||||
repoManager.TagRepository,
|
||||
repoManager.CategoryRepository,
|
||||
)
|
||||
|
||||
status := gin.H{
|
||||
@@ -29,13 +31,15 @@ func GetSchedulerStatus(c *gin.Context) {
|
||||
|
||||
// 启动热播剧定时任务
|
||||
func StartHotDramaScheduler(c *gin.Context) {
|
||||
scheduler := utils.GetGlobalScheduler(
|
||||
scheduler := scheduler.GetGlobalScheduler(
|
||||
repoManager.HotDramaRepository,
|
||||
repoManager.ReadyResourceRepository,
|
||||
repoManager.ResourceRepository,
|
||||
repoManager.SystemConfigRepository,
|
||||
repoManager.PanRepository,
|
||||
repoManager.CksRepository,
|
||||
repoManager.TagRepository,
|
||||
repoManager.CategoryRepository,
|
||||
)
|
||||
if scheduler.IsHotDramaSchedulerRunning() {
|
||||
ErrorResponse(c, "热播剧定时任务已在运行中", http.StatusBadRequest)
|
||||
@@ -47,13 +51,15 @@ func StartHotDramaScheduler(c *gin.Context) {
|
||||
|
||||
// 停止热播剧定时任务
|
||||
func StopHotDramaScheduler(c *gin.Context) {
|
||||
scheduler := utils.GetGlobalScheduler(
|
||||
scheduler := scheduler.GetGlobalScheduler(
|
||||
repoManager.HotDramaRepository,
|
||||
repoManager.ReadyResourceRepository,
|
||||
repoManager.ResourceRepository,
|
||||
repoManager.SystemConfigRepository,
|
||||
repoManager.PanRepository,
|
||||
repoManager.CksRepository,
|
||||
repoManager.TagRepository,
|
||||
repoManager.CategoryRepository,
|
||||
)
|
||||
if !scheduler.IsHotDramaSchedulerRunning() {
|
||||
ErrorResponse(c, "热播剧定时任务未在运行", http.StatusBadRequest)
|
||||
@@ -65,13 +71,15 @@ func StopHotDramaScheduler(c *gin.Context) {
|
||||
|
||||
// 手动触发热播剧定时任务
|
||||
func TriggerHotDramaScheduler(c *gin.Context) {
|
||||
scheduler := utils.GetGlobalScheduler(
|
||||
scheduler := scheduler.GetGlobalScheduler(
|
||||
repoManager.HotDramaRepository,
|
||||
repoManager.ReadyResourceRepository,
|
||||
repoManager.ResourceRepository,
|
||||
repoManager.SystemConfigRepository,
|
||||
repoManager.PanRepository,
|
||||
repoManager.CksRepository,
|
||||
repoManager.TagRepository,
|
||||
repoManager.CategoryRepository,
|
||||
)
|
||||
scheduler.StartHotDramaScheduler() // 直接启动一次
|
||||
SuccessResponse(c, gin.H{"message": "手动触发热播剧定时任务成功"})
|
||||
@@ -79,13 +87,15 @@ func TriggerHotDramaScheduler(c *gin.Context) {
|
||||
|
||||
// 手动获取热播剧名字
|
||||
func FetchHotDramaNames(c *gin.Context) {
|
||||
scheduler := utils.GetGlobalScheduler(
|
||||
scheduler := scheduler.GetGlobalScheduler(
|
||||
repoManager.HotDramaRepository,
|
||||
repoManager.ReadyResourceRepository,
|
||||
repoManager.ResourceRepository,
|
||||
repoManager.SystemConfigRepository,
|
||||
repoManager.PanRepository,
|
||||
repoManager.CksRepository,
|
||||
repoManager.TagRepository,
|
||||
repoManager.CategoryRepository,
|
||||
)
|
||||
names, err := scheduler.GetHotDramaNames()
|
||||
if err != nil {
|
||||
@@ -97,13 +107,15 @@ func FetchHotDramaNames(c *gin.Context) {
|
||||
|
||||
// 启动待处理资源自动处理任务
|
||||
func StartReadyResourceScheduler(c *gin.Context) {
|
||||
scheduler := utils.GetGlobalScheduler(
|
||||
scheduler := scheduler.GetGlobalScheduler(
|
||||
repoManager.HotDramaRepository,
|
||||
repoManager.ReadyResourceRepository,
|
||||
repoManager.ResourceRepository,
|
||||
repoManager.SystemConfigRepository,
|
||||
repoManager.PanRepository,
|
||||
repoManager.CksRepository,
|
||||
repoManager.TagRepository,
|
||||
repoManager.CategoryRepository,
|
||||
)
|
||||
if scheduler.IsReadyResourceRunning() {
|
||||
ErrorResponse(c, "待处理资源自动处理任务已在运行中", http.StatusBadRequest)
|
||||
@@ -115,13 +127,15 @@ func StartReadyResourceScheduler(c *gin.Context) {
|
||||
|
||||
// 停止待处理资源自动处理任务
|
||||
func StopReadyResourceScheduler(c *gin.Context) {
|
||||
scheduler := utils.GetGlobalScheduler(
|
||||
scheduler := scheduler.GetGlobalScheduler(
|
||||
repoManager.HotDramaRepository,
|
||||
repoManager.ReadyResourceRepository,
|
||||
repoManager.ResourceRepository,
|
||||
repoManager.SystemConfigRepository,
|
||||
repoManager.PanRepository,
|
||||
repoManager.CksRepository,
|
||||
repoManager.TagRepository,
|
||||
repoManager.CategoryRepository,
|
||||
)
|
||||
if !scheduler.IsReadyResourceRunning() {
|
||||
ErrorResponse(c, "待处理资源自动处理任务未在运行", http.StatusBadRequest)
|
||||
@@ -133,28 +147,31 @@ func StopReadyResourceScheduler(c *gin.Context) {
|
||||
|
||||
// 手动触发待处理资源自动处理任务
|
||||
func TriggerReadyResourceScheduler(c *gin.Context) {
|
||||
scheduler := utils.GetGlobalScheduler(
|
||||
scheduler := scheduler.GetGlobalScheduler(
|
||||
repoManager.HotDramaRepository,
|
||||
repoManager.ReadyResourceRepository,
|
||||
repoManager.ResourceRepository,
|
||||
repoManager.SystemConfigRepository,
|
||||
repoManager.PanRepository,
|
||||
repoManager.CksRepository,
|
||||
repoManager.TagRepository,
|
||||
repoManager.CategoryRepository,
|
||||
)
|
||||
// 手动触发一次处理
|
||||
scheduler.ProcessReadyResources()
|
||||
scheduler.StartReadyResourceScheduler() // 直接启动一次
|
||||
SuccessResponse(c, gin.H{"message": "手动触发待处理资源自动处理任务成功"})
|
||||
}
|
||||
|
||||
// 启动自动转存定时任务
|
||||
func StartAutoTransferScheduler(c *gin.Context) {
|
||||
scheduler := utils.GetGlobalScheduler(
|
||||
scheduler := scheduler.GetGlobalScheduler(
|
||||
repoManager.HotDramaRepository,
|
||||
repoManager.ReadyResourceRepository,
|
||||
repoManager.ResourceRepository,
|
||||
repoManager.SystemConfigRepository,
|
||||
repoManager.PanRepository,
|
||||
repoManager.CksRepository,
|
||||
repoManager.TagRepository,
|
||||
repoManager.CategoryRepository,
|
||||
)
|
||||
if scheduler.IsAutoTransferRunning() {
|
||||
ErrorResponse(c, "自动转存定时任务已在运行中", http.StatusBadRequest)
|
||||
@@ -166,13 +183,15 @@ func StartAutoTransferScheduler(c *gin.Context) {
|
||||
|
||||
// 停止自动转存定时任务
|
||||
func StopAutoTransferScheduler(c *gin.Context) {
|
||||
scheduler := utils.GetGlobalScheduler(
|
||||
scheduler := scheduler.GetGlobalScheduler(
|
||||
repoManager.HotDramaRepository,
|
||||
repoManager.ReadyResourceRepository,
|
||||
repoManager.ResourceRepository,
|
||||
repoManager.SystemConfigRepository,
|
||||
repoManager.PanRepository,
|
||||
repoManager.CksRepository,
|
||||
repoManager.TagRepository,
|
||||
repoManager.CategoryRepository,
|
||||
)
|
||||
if !scheduler.IsAutoTransferRunning() {
|
||||
ErrorResponse(c, "自动转存定时任务未在运行", http.StatusBadRequest)
|
||||
@@ -184,15 +203,16 @@ func StopAutoTransferScheduler(c *gin.Context) {
|
||||
|
||||
// 手动触发自动转存定时任务
|
||||
func TriggerAutoTransferScheduler(c *gin.Context) {
|
||||
scheduler := utils.GetGlobalScheduler(
|
||||
scheduler := scheduler.GetGlobalScheduler(
|
||||
repoManager.HotDramaRepository,
|
||||
repoManager.ReadyResourceRepository,
|
||||
repoManager.ResourceRepository,
|
||||
repoManager.SystemConfigRepository,
|
||||
repoManager.PanRepository,
|
||||
repoManager.CksRepository,
|
||||
repoManager.TagRepository,
|
||||
repoManager.CategoryRepository,
|
||||
)
|
||||
// 手动触发一次处理
|
||||
scheduler.ProcessAutoTransfer()
|
||||
scheduler.StartAutoTransferScheduler() // 直接启动一次
|
||||
SuccessResponse(c, gin.H{"message": "手动触发自动转存定时任务成功"})
|
||||
}
|
||||
|
||||
@@ -22,17 +22,44 @@ func GetStats(c *gin.Context) {
|
||||
db.DB.Model(&entity.Tag{}).Count(&totalTags)
|
||||
db.DB.Model(&entity.Resource{}).Select("COALESCE(SUM(view_count), 0)").Scan(&totalViews)
|
||||
|
||||
// 获取今日更新数量
|
||||
// 获取今日数据
|
||||
today := utils.GetTodayString()
|
||||
|
||||
// 今日新增资源数量
|
||||
var todayResources int64
|
||||
db.DB.Model(&entity.Resource{}).Where("DATE(created_at) = ?", today).Count(&todayResources)
|
||||
|
||||
// 今日更新资源数量(包括新增和修改)
|
||||
var todayUpdates int64
|
||||
today := time.Now().Format("2006-01-02")
|
||||
db.DB.Model(&entity.Resource{}).Where("DATE(updated_at) = ?", today).Count(&todayUpdates)
|
||||
|
||||
// 今日浏览量 - 使用访问记录表统计今日访问量
|
||||
var todayViews int64
|
||||
todayViews, err := repoManager.ResourceViewRepository.GetTodayViews()
|
||||
if err != nil {
|
||||
utils.Error("获取今日访问量失败: %v", err)
|
||||
todayViews = 0
|
||||
}
|
||||
|
||||
// 今日搜索量
|
||||
var todaySearches int64
|
||||
db.DB.Model(&entity.SearchStat{}).Where("DATE(date) = ?", today).Count(&todaySearches)
|
||||
|
||||
// 添加调试日志
|
||||
utils.Info("统计数据 - 总资源: %d, 总分类: %d, 总标签: %d, 总浏览量: %d",
|
||||
totalResources, totalCategories, totalTags, totalViews)
|
||||
utils.Info("今日数据 - 新增资源: %d, 今日更新: %d, 今日浏览量: %d, 今日搜索: %d",
|
||||
todayResources, todayUpdates, todayViews, todaySearches)
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"total_resources": totalResources,
|
||||
"total_categories": totalCategories,
|
||||
"total_tags": totalTags,
|
||||
"total_views": totalViews,
|
||||
"today_resources": todayResources,
|
||||
"today_updates": todayUpdates,
|
||||
"today_views": todayViews,
|
||||
"today_searches": todaySearches,
|
||||
})
|
||||
}
|
||||
|
||||
@@ -65,7 +92,7 @@ func GetPerformanceStats(c *gin.Context) {
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"timestamp": time.Now().Unix(),
|
||||
"timestamp": utils.GetCurrentTime().Unix(),
|
||||
"memory": gin.H{
|
||||
"alloc": m.Alloc,
|
||||
"total_alloc": m.TotalAlloc,
|
||||
@@ -89,13 +116,68 @@ func GetPerformanceStats(c *gin.Context) {
|
||||
func GetSystemInfo(c *gin.Context) {
|
||||
SuccessResponse(c, gin.H{
|
||||
"uptime": time.Since(startTime).String(),
|
||||
"start_time": startTime.Format("2006-01-02 15:04:05"),
|
||||
"version": "1.0.0",
|
||||
"start_time": utils.FormatTime(startTime, utils.TimeFormatDateTime),
|
||||
"version": utils.Version,
|
||||
"environment": gin.H{
|
||||
"gin_mode": gin.Mode(),
|
||||
},
|
||||
})
|
||||
}
|
||||
|
||||
// GetViewsTrend 获取访问量趋势数据
|
||||
func GetViewsTrend(c *gin.Context) {
|
||||
// 使用访问记录表获取最近7天的访问量数据
|
||||
results, err := repoManager.ResourceViewRepository.GetViewsTrend(7)
|
||||
if err != nil {
|
||||
utils.Error("获取访问量趋势数据失败: %v", err)
|
||||
// 如果获取失败,返回空数据
|
||||
results = []map[string]interface{}{}
|
||||
}
|
||||
|
||||
// 添加调试日志
|
||||
utils.Info("访问量趋势数据: %+v", results)
|
||||
for i, result := range results {
|
||||
utils.Info("第%d天: 日期=%s, 访问量=%d", i+1, result["date"], result["views"])
|
||||
}
|
||||
|
||||
SuccessResponse(c, results)
|
||||
}
|
||||
|
||||
// GetSearchesTrend 获取搜索量趋势数据
|
||||
func GetSearchesTrend(c *gin.Context) {
|
||||
// 获取最近7天的搜索量数据
|
||||
var results []gin.H
|
||||
|
||||
// 生成最近7天的日期
|
||||
for i := 6; i >= 0; i-- {
|
||||
date := utils.GetCurrentTime().AddDate(0, 0, -i)
|
||||
dateStr := date.Format(utils.TimeFormatDate)
|
||||
|
||||
// 查询该日期的搜索量(从搜索统计表)
|
||||
var searches int64
|
||||
db.DB.Model(&entity.SearchStat{}).
|
||||
Where("DATE(date) = ?", dateStr).
|
||||
Count(&searches)
|
||||
|
||||
// 如果没有搜索记录,返回0
|
||||
// 移除模拟数据生成逻辑,只返回真实数据
|
||||
|
||||
results = append(results, gin.H{
|
||||
"date": dateStr,
|
||||
"searches": searches,
|
||||
})
|
||||
}
|
||||
|
||||
// 添加调试日志
|
||||
utils.Info("搜索量趋势数据: %+v", results)
|
||||
|
||||
// 添加更详细的调试信息
|
||||
for i, result := range results {
|
||||
utils.Info("第%d天: 日期=%s, 搜索量=%d", i+1, result["date"], result["searches"])
|
||||
}
|
||||
|
||||
SuccessResponse(c, results)
|
||||
}
|
||||
|
||||
// 记录启动时间
|
||||
var startTime = time.Now()
|
||||
var startTime = utils.GetCurrentTime()
|
||||
|
||||
@@ -5,7 +5,9 @@ import (
|
||||
|
||||
"github.com/ctwj/urldb/db/converter"
|
||||
"github.com/ctwj/urldb/db/dto"
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/ctwj/urldb/db/repo"
|
||||
"github.com/ctwj/urldb/scheduler"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
|
||||
"github.com/gin-gonic/gin"
|
||||
@@ -25,13 +27,13 @@ func NewSystemConfigHandler(systemConfigRepo repo.SystemConfigRepository) *Syste
|
||||
|
||||
// GetConfig 获取系统配置
|
||||
func (h *SystemConfigHandler) GetConfig(c *gin.Context) {
|
||||
config, err := h.systemConfigRepo.GetOrCreateDefault()
|
||||
configs, err := h.systemConfigRepo.GetOrCreateDefault()
|
||||
if err != nil {
|
||||
ErrorResponse(c, "获取系统配置失败", http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
configResponse := converter.SystemConfigToResponse(config)
|
||||
configResponse := converter.SystemConfigToResponse(configs)
|
||||
SuccessResponse(c, configResponse)
|
||||
}
|
||||
|
||||
@@ -43,67 +45,61 @@ func (h *SystemConfigHandler) UpdateConfig(c *gin.Context) {
|
||||
return
|
||||
}
|
||||
|
||||
// 验证参数
|
||||
if req.SiteTitle == "" {
|
||||
ErrorResponse(c, "网站标题不能为空", http.StatusBadRequest)
|
||||
// 验证参数 - 只验证提交的字段
|
||||
if req.SiteTitle != "" && (len(req.SiteTitle) < 1 || len(req.SiteTitle) > 100) {
|
||||
ErrorResponse(c, "网站标题长度必须在1-100字符之间", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
if req.AutoProcessInterval < 1 || req.AutoProcessInterval > 1440 {
|
||||
if req.AutoProcessInterval > 0 && (req.AutoProcessInterval < 1 || req.AutoProcessInterval > 1440) {
|
||||
ErrorResponse(c, "自动处理间隔必须在1-1440分钟之间", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
if req.PageSize < 10 || req.PageSize > 500 {
|
||||
if req.PageSize > 0 && (req.PageSize < 10 || req.PageSize > 500) {
|
||||
ErrorResponse(c, "每页显示数量必须在10-500之间", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
// 验证自动转存配置
|
||||
if req.AutoTransferLimitDays < 0 || req.AutoTransferLimitDays > 365 {
|
||||
ErrorResponse(c, "自动转存限制天数必须在0-365之间", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
if req.AutoTransferMinSpace < 100 || req.AutoTransferMinSpace > 1024 {
|
||||
if req.AutoTransferMinSpace > 0 && (req.AutoTransferMinSpace < 100 || req.AutoTransferMinSpace > 1024) {
|
||||
ErrorResponse(c, "最小存储空间必须在100-1024GB之间", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
// 转换为实体
|
||||
config := converter.RequestToSystemConfig(&req)
|
||||
if config == nil {
|
||||
configs := converter.RequestToSystemConfig(&req)
|
||||
if configs == nil {
|
||||
ErrorResponse(c, "数据转换失败", http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
// 保存配置
|
||||
err := h.systemConfigRepo.Upsert(config)
|
||||
err := h.systemConfigRepo.UpsertConfigs(configs)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "保存系统配置失败", http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
// 返回更新后的配置
|
||||
updatedConfig, err := h.systemConfigRepo.FindFirst()
|
||||
updatedConfigs, err := h.systemConfigRepo.FindAll()
|
||||
if err != nil {
|
||||
ErrorResponse(c, "获取更新后的配置失败", http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
configResponse := converter.SystemConfigToResponse(updatedConfig)
|
||||
configResponse := converter.SystemConfigToResponse(updatedConfigs)
|
||||
SuccessResponse(c, configResponse)
|
||||
}
|
||||
|
||||
// GetSystemConfig 获取系统配置(使用全局repoManager)
|
||||
func GetSystemConfig(c *gin.Context) {
|
||||
config, err := repoManager.SystemConfigRepository.GetOrCreateDefault()
|
||||
configs, err := repoManager.SystemConfigRepository.GetOrCreateDefault()
|
||||
if err != nil {
|
||||
ErrorResponse(c, "获取系统配置失败", http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
configResponse := converter.SystemConfigToResponse(config)
|
||||
configResponse := converter.SystemConfigToResponse(configs)
|
||||
SuccessResponse(c, configResponse)
|
||||
}
|
||||
|
||||
@@ -115,78 +111,146 @@ func UpdateSystemConfig(c *gin.Context) {
|
||||
return
|
||||
}
|
||||
|
||||
// 验证参数
|
||||
if req.SiteTitle == "" {
|
||||
ErrorResponse(c, "网站标题不能为空", http.StatusBadRequest)
|
||||
// 调试信息
|
||||
utils.Info("接收到的配置请求: %+v", req)
|
||||
|
||||
// 验证参数 - 只验证提交的字段
|
||||
if req.SiteTitle != "" && (len(req.SiteTitle) < 1 || len(req.SiteTitle) > 100) {
|
||||
ErrorResponse(c, "网站标题长度必须在1-100字符之间", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
if req.AutoProcessInterval < 1 || req.AutoProcessInterval > 1440 {
|
||||
if req.AutoProcessInterval != 0 && (req.AutoProcessInterval < 1 || req.AutoProcessInterval > 1440) {
|
||||
ErrorResponse(c, "自动处理间隔必须在1-1440分钟之间", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
if req.PageSize < 10 || req.PageSize > 500 {
|
||||
if req.PageSize != 0 && (req.PageSize < 10 || req.PageSize > 500) {
|
||||
ErrorResponse(c, "每页显示数量必须在10-500之间", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
// 验证自动转存配置
|
||||
if req.AutoTransferLimitDays < 0 || req.AutoTransferLimitDays > 365 {
|
||||
if req.AutoTransferLimitDays != 0 && (req.AutoTransferLimitDays < 0 || req.AutoTransferLimitDays > 365) {
|
||||
ErrorResponse(c, "自动转存限制天数必须在0-365之间", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
if req.AutoTransferMinSpace < 100 || req.AutoTransferMinSpace > 1024 {
|
||||
if req.AutoTransferMinSpace != 0 && (req.AutoTransferMinSpace < 100 || req.AutoTransferMinSpace > 1024) {
|
||||
ErrorResponse(c, "最小存储空间必须在100-1024GB之间", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
// 转换为实体
|
||||
config := converter.RequestToSystemConfig(&req)
|
||||
if config == nil {
|
||||
configs := converter.RequestToSystemConfig(&req)
|
||||
if configs == nil {
|
||||
ErrorResponse(c, "数据转换失败", http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
// 保存配置
|
||||
err := repoManager.SystemConfigRepository.Upsert(config)
|
||||
err := repoManager.SystemConfigRepository.UpsertConfigs(configs)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "保存系统配置失败", http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
// 根据配置更新定时任务状态(错误不影响配置保存)
|
||||
scheduler := utils.GetGlobalScheduler(
|
||||
scheduler := scheduler.GetGlobalScheduler(
|
||||
repoManager.HotDramaRepository,
|
||||
repoManager.ReadyResourceRepository,
|
||||
repoManager.ResourceRepository,
|
||||
repoManager.SystemConfigRepository,
|
||||
repoManager.PanRepository,
|
||||
repoManager.CksRepository,
|
||||
repoManager.TagRepository,
|
||||
repoManager.CategoryRepository,
|
||||
)
|
||||
if scheduler != nil {
|
||||
scheduler.UpdateSchedulerStatusWithAutoTransfer(req.AutoFetchHotDramaEnabled, req.AutoProcessReadyResources, req.AutoTransferEnabled)
|
||||
}
|
||||
|
||||
// 返回更新后的配置
|
||||
updatedConfig, err := repoManager.SystemConfigRepository.FindFirst()
|
||||
updatedConfigs, err := repoManager.SystemConfigRepository.FindAll()
|
||||
if err != nil {
|
||||
ErrorResponse(c, "获取更新后的配置失败", http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
configResponse := converter.SystemConfigToResponse(updatedConfig)
|
||||
configResponse := converter.SystemConfigToResponse(updatedConfigs)
|
||||
SuccessResponse(c, configResponse)
|
||||
}
|
||||
|
||||
// 新增:公开获取系统配置(不含api_token)
|
||||
func GetPublicSystemConfig(c *gin.Context) {
|
||||
config, err := repoManager.SystemConfigRepository.GetOrCreateDefault()
|
||||
configs, err := repoManager.SystemConfigRepository.GetOrCreateDefault()
|
||||
if err != nil {
|
||||
ErrorResponse(c, "获取系统配置失败", http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
configResponse := converter.SystemConfigToPublicResponse(config)
|
||||
configResponse := converter.SystemConfigToPublicResponse(configs)
|
||||
SuccessResponse(c, configResponse)
|
||||
}
|
||||
|
||||
// 新增:切换自动处理配置
|
||||
func ToggleAutoProcess(c *gin.Context) {
|
||||
var req struct {
|
||||
AutoProcessReadyResources bool `json:"auto_process_ready_resources"`
|
||||
}
|
||||
if err := c.ShouldBindJSON(&req); err != nil {
|
||||
ErrorResponse(c, "请求参数错误", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
// 获取当前配置
|
||||
configs, err := repoManager.SystemConfigRepository.GetOrCreateDefault()
|
||||
if err != nil {
|
||||
ErrorResponse(c, "获取系统配置失败", http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
// 更新自动处理配置
|
||||
for i, config := range configs {
|
||||
if config.Key == entity.ConfigKeyAutoProcessReadyResources {
|
||||
configs[i].Value = "true"
|
||||
if !req.AutoProcessReadyResources {
|
||||
configs[i].Value = "false"
|
||||
}
|
||||
break
|
||||
}
|
||||
}
|
||||
|
||||
// 保存配置
|
||||
err = repoManager.SystemConfigRepository.UpsertConfigs(configs)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "保存系统配置失败", http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
// 更新定时任务状态
|
||||
scheduler := scheduler.GetGlobalScheduler(
|
||||
repoManager.HotDramaRepository,
|
||||
repoManager.ReadyResourceRepository,
|
||||
repoManager.ResourceRepository,
|
||||
repoManager.SystemConfigRepository,
|
||||
repoManager.PanRepository,
|
||||
repoManager.CksRepository,
|
||||
repoManager.TagRepository,
|
||||
repoManager.CategoryRepository,
|
||||
)
|
||||
if scheduler != nil {
|
||||
// 获取其他配置值
|
||||
autoFetchHotDrama, _ := repoManager.SystemConfigRepository.GetConfigBool(entity.ConfigKeyAutoFetchHotDramaEnabled)
|
||||
autoTransfer, _ := repoManager.SystemConfigRepository.GetConfigBool(entity.ConfigKeyAutoTransferEnabled)
|
||||
|
||||
scheduler.UpdateSchedulerStatusWithAutoTransfer(
|
||||
autoFetchHotDrama,
|
||||
req.AutoProcessReadyResources,
|
||||
autoTransfer,
|
||||
)
|
||||
}
|
||||
|
||||
// 返回更新后的配置
|
||||
configResponse := converter.SystemConfigToResponse(configs)
|
||||
SuccessResponse(c, configResponse)
|
||||
}
|
||||
|
||||
@@ -24,11 +24,11 @@ func GetTags(c *gin.Context) {
|
||||
var err error
|
||||
|
||||
if search != "" {
|
||||
// 搜索标签
|
||||
tags, total, err = repoManager.TagRepository.Search(search, page, pageSize)
|
||||
// 搜索标签(按资源数量排序)
|
||||
tags, total, err = repoManager.TagRepository.SearchOrderByResourceCount(search, page, pageSize)
|
||||
} else {
|
||||
// 分页查询
|
||||
tags, total, err = repoManager.TagRepository.FindWithPagination(page, pageSize)
|
||||
// 分页查询(按资源数量排序)
|
||||
tags, total, err = repoManager.TagRepository.FindWithPaginationOrderByResourceCount(page, pageSize)
|
||||
}
|
||||
|
||||
if err != nil {
|
||||
@@ -65,13 +65,47 @@ func CreateTag(c *gin.Context) {
|
||||
return
|
||||
}
|
||||
|
||||
// 首先检查是否存在已删除的同名标签
|
||||
deletedTag, err := repoManager.TagRepository.FindByNameIncludingDeleted(req.Name)
|
||||
if err == nil && deletedTag.DeletedAt.Valid {
|
||||
// 如果存在已删除的同名标签,则恢复它
|
||||
err = repoManager.TagRepository.RestoreDeletedTag(deletedTag.ID)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "恢复已删除标签失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
// 重新获取恢复后的标签
|
||||
restoredTag, err := repoManager.TagRepository.FindByID(deletedTag.ID)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "获取恢复的标签失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
// 更新标签信息
|
||||
restoredTag.Description = req.Description
|
||||
restoredTag.CategoryID = req.CategoryID
|
||||
err = repoManager.TagRepository.UpdateWithNulls(restoredTag)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "更新恢复的标签失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"message": "标签恢复成功",
|
||||
"tag": converter.ToTagResponse(restoredTag, 0),
|
||||
})
|
||||
return
|
||||
}
|
||||
|
||||
// 如果不存在已删除的同名标签,则创建新标签
|
||||
tag := &entity.Tag{
|
||||
Name: req.Name,
|
||||
Description: req.Description,
|
||||
CategoryID: req.CategoryID,
|
||||
}
|
||||
|
||||
err := repoManager.TagRepository.Create(tag)
|
||||
err = repoManager.TagRepository.Create(tag)
|
||||
if err != nil {
|
||||
ErrorResponse(c, err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
|
||||
375
handlers/task_handler.go
Normal file
@@ -0,0 +1,375 @@
|
||||
package handlers
|
||||
|
||||
import (
|
||||
"encoding/json"
|
||||
"net/http"
|
||||
"strconv"
|
||||
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/ctwj/urldb/db/repo"
|
||||
"github.com/ctwj/urldb/task"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
|
||||
"github.com/gin-gonic/gin"
|
||||
)
|
||||
|
||||
// TaskHandler 任务处理器
|
||||
type TaskHandler struct {
|
||||
repoMgr *repo.RepositoryManager
|
||||
taskManager *task.TaskManager
|
||||
}
|
||||
|
||||
// NewTaskHandler 创建任务处理器
|
||||
func NewTaskHandler(repoMgr *repo.RepositoryManager, taskManager *task.TaskManager) *TaskHandler {
|
||||
return &TaskHandler{
|
||||
repoMgr: repoMgr,
|
||||
taskManager: taskManager,
|
||||
}
|
||||
}
|
||||
|
||||
// 批量转存任务资源项
|
||||
type BatchTransferResource struct {
|
||||
Title string `json:"title" binding:"required"`
|
||||
URL string `json:"url" binding:"required"`
|
||||
CategoryID uint `json:"category_id,omitempty"`
|
||||
PanID uint `json:"pan_id,omitempty"`
|
||||
Tags []uint `json:"tags,omitempty"`
|
||||
}
|
||||
|
||||
// CreateBatchTransferTask 创建批量转存任务
|
||||
func (h *TaskHandler) CreateBatchTransferTask(c *gin.Context) {
|
||||
var req struct {
|
||||
Title string `json:"title" binding:"required"`
|
||||
Description string `json:"description"`
|
||||
Resources []BatchTransferResource `json:"resources" binding:"required,min=1"`
|
||||
SelectedAccounts []uint `json:"selected_accounts,omitempty"`
|
||||
}
|
||||
|
||||
if err := c.ShouldBindJSON(&req); err != nil {
|
||||
ErrorResponse(c, "参数错误: "+err.Error(), http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
utils.Info("创建批量转存任务: %s,资源数量: %d,选择账号数量: %d", req.Title, len(req.Resources), len(req.SelectedAccounts))
|
||||
|
||||
// 构建任务配置
|
||||
taskConfig := map[string]interface{}{
|
||||
"selected_accounts": req.SelectedAccounts,
|
||||
}
|
||||
configJSON, _ := json.Marshal(taskConfig)
|
||||
|
||||
// 创建任务
|
||||
newTask := &entity.Task{
|
||||
Title: req.Title,
|
||||
Description: req.Description,
|
||||
Type: "transfer",
|
||||
Status: "pending",
|
||||
TotalItems: len(req.Resources),
|
||||
Config: string(configJSON),
|
||||
CreatedAt: utils.GetCurrentTime(),
|
||||
UpdatedAt: utils.GetCurrentTime(),
|
||||
}
|
||||
|
||||
err := h.repoMgr.TaskRepository.Create(newTask)
|
||||
if err != nil {
|
||||
utils.Error("创建任务失败: %v", err)
|
||||
ErrorResponse(c, "创建任务失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
// 创建任务项
|
||||
for _, resource := range req.Resources {
|
||||
// 构建转存输入数据
|
||||
transferInput := task.TransferInput{
|
||||
Title: resource.Title,
|
||||
URL: resource.URL,
|
||||
CategoryID: resource.CategoryID,
|
||||
PanID: resource.PanID,
|
||||
Tags: resource.Tags,
|
||||
}
|
||||
|
||||
inputJSON, _ := json.Marshal(transferInput)
|
||||
|
||||
taskItem := &entity.TaskItem{
|
||||
TaskID: newTask.ID,
|
||||
Status: "pending",
|
||||
InputData: string(inputJSON),
|
||||
CreatedAt: utils.GetCurrentTime(),
|
||||
UpdatedAt: utils.GetCurrentTime(),
|
||||
}
|
||||
|
||||
err = h.repoMgr.TaskItemRepository.Create(taskItem)
|
||||
if err != nil {
|
||||
utils.Error("创建任务项失败: %v", err)
|
||||
// 继续创建其他任务项
|
||||
}
|
||||
}
|
||||
|
||||
utils.Info("批量转存任务创建完成: %d, 共 %d 项", newTask.ID, len(req.Resources))
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"task_id": newTask.ID,
|
||||
"total_items": len(req.Resources),
|
||||
"message": "任务创建成功",
|
||||
})
|
||||
}
|
||||
|
||||
// StartTask 启动任务
|
||||
func (h *TaskHandler) StartTask(c *gin.Context) {
|
||||
taskIDStr := c.Param("id")
|
||||
taskID, err := strconv.ParseUint(taskIDStr, 10, 32)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "无效的任务ID: "+err.Error(), http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
utils.Info("启动任务: %d", taskID)
|
||||
|
||||
err = h.taskManager.StartTask(uint(taskID))
|
||||
if err != nil {
|
||||
utils.Error("启动任务失败: %v", err)
|
||||
ErrorResponse(c, "启动任务失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"message": "任务启动成功",
|
||||
})
|
||||
}
|
||||
|
||||
// StopTask 停止任务
|
||||
func (h *TaskHandler) StopTask(c *gin.Context) {
|
||||
taskIDStr := c.Param("id")
|
||||
taskID, err := strconv.ParseUint(taskIDStr, 10, 32)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "无效的任务ID: "+err.Error(), http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
utils.Info("停止任务: %d", taskID)
|
||||
|
||||
err = h.taskManager.StopTask(uint(taskID))
|
||||
if err != nil {
|
||||
utils.Error("停止任务失败: %v", err)
|
||||
ErrorResponse(c, "停止任务失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"message": "任务停止成功",
|
||||
})
|
||||
}
|
||||
|
||||
// PauseTask 暂停任务
|
||||
func (h *TaskHandler) PauseTask(c *gin.Context) {
|
||||
taskIDStr := c.Param("id")
|
||||
taskID, err := strconv.ParseUint(taskIDStr, 10, 32)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "无效的任务ID: "+err.Error(), http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
utils.Info("暂停任务: %d", taskID)
|
||||
|
||||
err = h.taskManager.PauseTask(uint(taskID))
|
||||
if err != nil {
|
||||
utils.Error("暂停任务失败: %v", err)
|
||||
ErrorResponse(c, "暂停任务失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"message": "任务暂停成功",
|
||||
})
|
||||
}
|
||||
|
||||
// GetTaskStatus 获取任务状态
|
||||
func (h *TaskHandler) GetTaskStatus(c *gin.Context) {
|
||||
taskIDStr := c.Param("id")
|
||||
taskID, err := strconv.ParseUint(taskIDStr, 10, 32)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "无效的任务ID: "+err.Error(), http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
// 获取任务详情
|
||||
task, err := h.repoMgr.TaskRepository.GetByID(uint(taskID))
|
||||
if err != nil {
|
||||
ErrorResponse(c, "任务不存在: "+err.Error(), http.StatusNotFound)
|
||||
return
|
||||
}
|
||||
|
||||
// 获取任务项统计
|
||||
stats, err := h.repoMgr.TaskItemRepository.GetStatsByTaskID(uint(taskID))
|
||||
if err != nil {
|
||||
utils.Error("获取任务项统计失败: %v", err)
|
||||
stats = map[string]int{
|
||||
"total": 0,
|
||||
"pending": 0,
|
||||
"processing": 0,
|
||||
"completed": 0,
|
||||
"failed": 0,
|
||||
}
|
||||
}
|
||||
|
||||
// 检查任务是否在运行
|
||||
isRunning := h.taskManager.IsTaskRunning(uint(taskID))
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"id": task.ID,
|
||||
"title": task.Title,
|
||||
"description": task.Description,
|
||||
"task_type": task.Type,
|
||||
"status": task.Status,
|
||||
"total_items": task.TotalItems,
|
||||
"processed_items": task.ProcessedItems,
|
||||
"success_items": task.SuccessItems,
|
||||
"failed_items": task.FailedItems,
|
||||
"is_running": isRunning,
|
||||
"stats": stats,
|
||||
"created_at": task.CreatedAt,
|
||||
"updated_at": task.UpdatedAt,
|
||||
})
|
||||
}
|
||||
|
||||
// GetTasks 获取任务列表
|
||||
func (h *TaskHandler) GetTasks(c *gin.Context) {
|
||||
page, _ := strconv.Atoi(c.DefaultQuery("page", "1"))
|
||||
pageSize, _ := strconv.Atoi(c.DefaultQuery("page_size", "10"))
|
||||
taskType := c.Query("task_type")
|
||||
status := c.Query("status")
|
||||
|
||||
utils.Info("GetTasks: 获取任务列表 page=%d, pageSize=%d, taskType=%s, status=%s", page, pageSize, taskType, status)
|
||||
|
||||
tasks, total, err := h.repoMgr.TaskRepository.GetList(page, pageSize, taskType, status)
|
||||
if err != nil {
|
||||
utils.Error("获取任务列表失败: %v", err)
|
||||
ErrorResponse(c, "获取任务列表失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
utils.Info("GetTasks: 从数据库获取到 %d 个任务", len(tasks))
|
||||
|
||||
// 为每个任务添加运行状态
|
||||
var result []gin.H
|
||||
for _, task := range tasks {
|
||||
isRunning := h.taskManager.IsTaskRunning(task.ID)
|
||||
utils.Info("GetTasks: 任务 %d (%s) 数据库状态: %s, TaskManager运行状态: %v", task.ID, task.Title, task.Status, isRunning)
|
||||
|
||||
result = append(result, gin.H{
|
||||
"id": task.ID,
|
||||
"title": task.Title,
|
||||
"description": task.Description,
|
||||
"task_type": task.Type,
|
||||
"status": task.Status,
|
||||
"total_items": task.TotalItems,
|
||||
"processed_items": task.ProcessedItems,
|
||||
"success_items": task.SuccessItems,
|
||||
"failed_items": task.FailedItems,
|
||||
"is_running": isRunning,
|
||||
"created_at": task.CreatedAt,
|
||||
"updated_at": task.UpdatedAt,
|
||||
})
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"items": result,
|
||||
"total": total,
|
||||
"page": page,
|
||||
"size": pageSize,
|
||||
})
|
||||
}
|
||||
|
||||
// GetTaskItems 获取任务项列表
|
||||
func (h *TaskHandler) GetTaskItems(c *gin.Context) {
|
||||
taskIDStr := c.Param("id")
|
||||
taskID, err := strconv.ParseUint(taskIDStr, 10, 32)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "无效的任务ID: "+err.Error(), http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
page, _ := strconv.Atoi(c.DefaultQuery("page", "1"))
|
||||
pageSize, _ := strconv.Atoi(c.DefaultQuery("page_size", "10000"))
|
||||
status := c.Query("status")
|
||||
|
||||
items, total, err := h.repoMgr.TaskItemRepository.GetListByTaskID(uint(taskID), page, pageSize, status)
|
||||
if err != nil {
|
||||
utils.Error("获取任务项列表失败: %v", err)
|
||||
ErrorResponse(c, "获取任务项列表失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
// 解析输入和输出数据
|
||||
var result []gin.H
|
||||
for _, item := range items {
|
||||
itemData := gin.H{
|
||||
"id": item.ID,
|
||||
"status": item.Status,
|
||||
"created_at": item.CreatedAt,
|
||||
"updated_at": item.UpdatedAt,
|
||||
}
|
||||
|
||||
// 解析输入数据
|
||||
if item.InputData != "" {
|
||||
var inputData map[string]interface{}
|
||||
if err := json.Unmarshal([]byte(item.InputData), &inputData); err == nil {
|
||||
itemData["input"] = inputData
|
||||
}
|
||||
}
|
||||
|
||||
// 解析输出数据
|
||||
if item.OutputData != "" {
|
||||
var outputData map[string]interface{}
|
||||
if err := json.Unmarshal([]byte(item.OutputData), &outputData); err == nil {
|
||||
itemData["output"] = outputData
|
||||
}
|
||||
}
|
||||
|
||||
result = append(result, itemData)
|
||||
}
|
||||
|
||||
SuccessResponse(c, gin.H{
|
||||
"items": result,
|
||||
"total": total,
|
||||
"page": page,
|
||||
"size": pageSize,
|
||||
})
|
||||
}
|
||||
|
||||
// DeleteTask 删除任务
|
||||
func (h *TaskHandler) DeleteTask(c *gin.Context) {
|
||||
taskIDStr := c.Param("id")
|
||||
taskID, err := strconv.ParseUint(taskIDStr, 10, 32)
|
||||
if err != nil {
|
||||
ErrorResponse(c, "无效的任务ID: "+err.Error(), http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
// 检查任务是否在运行
|
||||
if h.taskManager.IsTaskRunning(uint(taskID)) {
|
||||
ErrorResponse(c, "任务正在运行,请先停止任务", http.StatusBadRequest)
|
||||
return
|
||||
}
|
||||
|
||||
// 删除任务项
|
||||
err = h.repoMgr.TaskItemRepository.DeleteByTaskID(uint(taskID))
|
||||
if err != nil {
|
||||
utils.Error("删除任务项失败: %v", err)
|
||||
ErrorResponse(c, "删除任务项失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
// 删除任务
|
||||
err = h.repoMgr.TaskRepository.Delete(uint(taskID))
|
||||
if err != nil {
|
||||
utils.Error("删除任务失败: %v", err)
|
||||
ErrorResponse(c, "删除任务失败: "+err.Error(), http.StatusInternalServerError)
|
||||
return
|
||||
}
|
||||
|
||||
utils.Info("任务删除成功: %d", taskID)
|
||||
SuccessResponse(c, gin.H{
|
||||
"message": "任务删除成功",
|
||||
})
|
||||
}
|
||||
@@ -3,6 +3,7 @@ package handlers
|
||||
import (
|
||||
"encoding/json"
|
||||
"fmt"
|
||||
"io"
|
||||
"net/http"
|
||||
"strings"
|
||||
"time"
|
||||
@@ -27,7 +28,7 @@ func GetVersion(c *gin.Context) {
|
||||
Success: true,
|
||||
Data: versionInfo,
|
||||
Message: "版本信息获取成功",
|
||||
Time: time.Now(),
|
||||
Time: utils.GetCurrentTime(),
|
||||
}
|
||||
|
||||
c.JSON(http.StatusOK, response)
|
||||
@@ -43,7 +44,7 @@ func GetVersionString(c *gin.Context) {
|
||||
"version": versionString,
|
||||
},
|
||||
Message: "版本字符串获取成功",
|
||||
Time: time.Now(),
|
||||
Time: utils.GetCurrentTime(),
|
||||
}
|
||||
|
||||
c.JSON(http.StatusOK, response)
|
||||
@@ -59,7 +60,7 @@ func GetFullVersionInfo(c *gin.Context) {
|
||||
"version_info": fullInfo,
|
||||
},
|
||||
Message: "完整版本信息获取成功",
|
||||
Time: time.Now(),
|
||||
Time: utils.GetCurrentTime(),
|
||||
}
|
||||
|
||||
c.JSON(http.StatusOK, response)
|
||||
@@ -72,8 +73,8 @@ func CheckUpdate(c *gin.Context) {
|
||||
// 从GitHub API获取最新版本信息
|
||||
latestVersion, err := getLatestVersionFromGitHub()
|
||||
if err != nil {
|
||||
// 如果GitHub API失败,使用模拟数据
|
||||
latestVersion = "1.0.0"
|
||||
// 如果GitHub API失败,使用当前版本作为最新版本
|
||||
latestVersion = currentVersion
|
||||
}
|
||||
|
||||
hasUpdate := utils.IsVersionNewer(latestVersion, currentVersion)
|
||||
@@ -88,7 +89,7 @@ func CheckUpdate(c *gin.Context) {
|
||||
"update_url": "https://github.com/ctwj/urldb/releases/latest",
|
||||
},
|
||||
Message: "更新检查完成",
|
||||
Time: time.Now(),
|
||||
Time: utils.GetCurrentTime(),
|
||||
}
|
||||
|
||||
c.JSON(http.StatusOK, response)
|
||||
@@ -96,10 +97,25 @@ func CheckUpdate(c *gin.Context) {
|
||||
|
||||
// getLatestVersionFromGitHub 从GitHub获取最新版本
|
||||
func getLatestVersionFromGitHub() (string, error) {
|
||||
// 使用GitHub API获取最新Release
|
||||
// 首先尝试从VERSION文件URL获取最新版本
|
||||
versionURL := "https://raw.githubusercontent.com/ctwj/urldb/refs/heads/main/VERSION"
|
||||
|
||||
resp, err := http.Get(versionURL)
|
||||
if err == nil && resp.StatusCode == http.StatusOK {
|
||||
defer resp.Body.Close()
|
||||
body, err := io.ReadAll(resp.Body)
|
||||
if err == nil {
|
||||
version := strings.TrimSpace(string(body))
|
||||
if version != "" {
|
||||
return version, nil
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
// 如果VERSION文件获取失败,尝试GitHub API获取最新Release
|
||||
url := "https://api.github.com/repos/ctwj/urldb/releases/latest"
|
||||
|
||||
resp, err := http.Get(url)
|
||||
resp, err = http.Get(url)
|
||||
if err != nil {
|
||||
return "", err
|
||||
}
|
||||
|
||||
127
main.go
@@ -4,12 +4,12 @@ import (
|
||||
"log"
|
||||
"os"
|
||||
|
||||
"github.com/ctwj/urldb/utils"
|
||||
|
||||
"github.com/ctwj/urldb/db"
|
||||
"github.com/ctwj/urldb/db/repo"
|
||||
"github.com/ctwj/urldb/handlers"
|
||||
"github.com/ctwj/urldb/middleware"
|
||||
"github.com/ctwj/urldb/task"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
|
||||
"github.com/gin-contrib/cors"
|
||||
"github.com/gin-gonic/gin"
|
||||
@@ -28,6 +28,38 @@ func main() {
|
||||
utils.Info("未找到.env文件,使用默认配置")
|
||||
}
|
||||
|
||||
// 初始化时区设置
|
||||
utils.InitTimezone()
|
||||
|
||||
// 设置Gin运行模式
|
||||
ginMode := os.Getenv("GIN_MODE")
|
||||
if ginMode == "" {
|
||||
// 如果没有设置GIN_MODE,根据环境判断
|
||||
if os.Getenv("ENV") == "production" {
|
||||
gin.SetMode(gin.ReleaseMode)
|
||||
utils.Info("设置Gin为Release模式")
|
||||
} else {
|
||||
gin.SetMode(gin.DebugMode)
|
||||
utils.Info("设置Gin为Debug模式")
|
||||
}
|
||||
} else {
|
||||
// 如果已经设置了GIN_MODE,根据值设置模式
|
||||
switch ginMode {
|
||||
case "release":
|
||||
gin.SetMode(gin.ReleaseMode)
|
||||
utils.Info("设置Gin为Release模式 (来自环境变量)")
|
||||
case "debug":
|
||||
gin.SetMode(gin.DebugMode)
|
||||
utils.Info("设置Gin为Debug模式 (来自环境变量)")
|
||||
case "test":
|
||||
gin.SetMode(gin.TestMode)
|
||||
utils.Info("设置Gin为Test模式 (来自环境变量)")
|
||||
default:
|
||||
gin.SetMode(gin.DebugMode)
|
||||
utils.Info("未知的GIN_MODE值: %s,使用Debug模式", ginMode)
|
||||
}
|
||||
}
|
||||
|
||||
// 初始化数据库
|
||||
if err := db.InitDB(); err != nil {
|
||||
utils.Fatal("数据库连接失败: %v", err)
|
||||
@@ -36,46 +68,22 @@ func main() {
|
||||
// 创建Repository管理器
|
||||
repoManager := repo.NewRepositoryManager(db.DB)
|
||||
|
||||
// 创建全局调度器
|
||||
scheduler := utils.GetGlobalScheduler(
|
||||
repoManager.HotDramaRepository,
|
||||
repoManager.ReadyResourceRepository,
|
||||
repoManager.ResourceRepository,
|
||||
repoManager.SystemConfigRepository,
|
||||
repoManager.PanRepository,
|
||||
repoManager.CksRepository,
|
||||
)
|
||||
// 创建任务管理器
|
||||
taskManager := task.NewTaskManager(repoManager)
|
||||
|
||||
// 检查系统配置,决定是否启动各种自动任务
|
||||
systemConfig, err := repoManager.SystemConfigRepository.GetOrCreateDefault()
|
||||
if err != nil {
|
||||
utils.Error("获取系统配置失败: %v", err)
|
||||
// 注册转存任务处理器
|
||||
transferProcessor := task.NewTransferProcessor(repoManager)
|
||||
taskManager.RegisterProcessor(transferProcessor)
|
||||
|
||||
// 恢复运行中的任务(服务器重启后)
|
||||
if err := taskManager.RecoverRunningTasks(); err != nil {
|
||||
utils.Error("恢复运行中任务失败: %v", err)
|
||||
} else {
|
||||
// 检查是否启动待处理资源自动处理任务
|
||||
if systemConfig.AutoProcessReadyResources {
|
||||
scheduler.StartReadyResourceScheduler()
|
||||
utils.Info("已启动待处理资源自动处理任务")
|
||||
} else {
|
||||
utils.Info("系统配置中自动处理待处理资源功能已禁用,跳过启动定时任务")
|
||||
}
|
||||
|
||||
// 检查是否启动热播剧自动拉取任务
|
||||
if systemConfig.AutoFetchHotDramaEnabled {
|
||||
scheduler.StartHotDramaScheduler()
|
||||
utils.Info("已启动热播剧自动拉取任务")
|
||||
} else {
|
||||
utils.Info("系统配置中自动拉取热播剧功能已禁用,跳过启动定时任务")
|
||||
}
|
||||
|
||||
// 检查是否启动自动转存任务
|
||||
if systemConfig.AutoTransferEnabled {
|
||||
scheduler.StartAutoTransferScheduler()
|
||||
utils.Info("已启动自动转存任务")
|
||||
} else {
|
||||
utils.Info("系统配置中自动转存功能已禁用,跳过启动定时任务")
|
||||
}
|
||||
utils.Info("运行中任务恢复完成")
|
||||
}
|
||||
|
||||
utils.Info("任务管理器初始化完成")
|
||||
|
||||
// 创建Gin实例
|
||||
r := gin.Default()
|
||||
|
||||
@@ -95,6 +103,9 @@ func main() {
|
||||
// 创建公开API处理器
|
||||
publicAPIHandler := handlers.NewPublicAPIHandler()
|
||||
|
||||
// 创建任务处理器
|
||||
taskHandler := handlers.NewTaskHandler(repoManager, taskManager)
|
||||
|
||||
// API路由
|
||||
api := r.Group("/api")
|
||||
{
|
||||
@@ -102,8 +113,6 @@ func main() {
|
||||
publicAPI := api.Group("/public")
|
||||
publicAPI.Use(middleware.PublicAPIAuth())
|
||||
{
|
||||
// 单个添加资源
|
||||
publicAPI.POST("/resources/add", publicAPIHandler.AddSingleResource)
|
||||
// 批量添加资源
|
||||
publicAPI.POST("/resources/batch-add", publicAPIHandler.AddBatchResources)
|
||||
// 资源搜索
|
||||
@@ -125,6 +134,7 @@ func main() {
|
||||
api.GET("/resources/:id", handlers.GetResourceByID)
|
||||
api.GET("/resources/check-exists", handlers.CheckResourceExists)
|
||||
api.POST("/resources/:id/view", handlers.IncrementResourceViewCount)
|
||||
api.GET("/resources/:id/link", handlers.GetResourceLink)
|
||||
api.DELETE("/resources/batch", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.BatchDeleteResources)
|
||||
|
||||
// 分类管理
|
||||
@@ -139,6 +149,8 @@ func main() {
|
||||
// 统计
|
||||
api.GET("/stats", handlers.GetStats)
|
||||
api.GET("/performance", handlers.GetPerformanceStats)
|
||||
api.GET("/stats/views-trend", handlers.GetViewsTrend)
|
||||
api.GET("/stats/searches-trend", handlers.GetSearchesTrend)
|
||||
api.GET("/system/info", handlers.GetSystemInfo)
|
||||
|
||||
// 平台管理
|
||||
@@ -166,11 +178,18 @@ func main() {
|
||||
|
||||
// 待处理资源管理
|
||||
api.GET("/ready-resources", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.GetReadyResources)
|
||||
api.POST("/ready-resources", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.CreateReadyResource)
|
||||
api.POST("/ready-resources/batch", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.BatchCreateReadyResources)
|
||||
api.POST("/ready-resources/text", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.CreateReadyResourcesFromText)
|
||||
api.DELETE("/ready-resources/:id", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.DeleteReadyResource)
|
||||
api.DELETE("/ready-resources", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.ClearReadyResources)
|
||||
api.GET("/ready-resources/key/:key", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.GetReadyResourcesByKey)
|
||||
api.DELETE("/ready-resources/key/:key", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.DeleteReadyResourcesByKey)
|
||||
api.GET("/ready-resources/errors", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.GetReadyResourcesWithErrors)
|
||||
api.POST("/ready-resources/:id/clear-error", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.ClearErrorMsg)
|
||||
api.POST("/ready-resources/retry-failed", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.RetryFailedResources)
|
||||
api.POST("/ready-resources/batch-restore", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.BatchRestoreToReadyPool)
|
||||
api.POST("/ready-resources/batch-restore-by-query", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.BatchRestoreToReadyPoolByQuery)
|
||||
api.POST("/ready-resources/clear-all-errors-by-query", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.ClearAllErrorsByQuery)
|
||||
|
||||
// 用户管理(仅管理员)
|
||||
api.GET("/users", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.GetUsers)
|
||||
@@ -192,6 +211,7 @@ func main() {
|
||||
// 系统配置路由
|
||||
api.GET("/system/config", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.GetSystemConfig)
|
||||
api.POST("/system/config", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.UpdateSystemConfig)
|
||||
api.POST("/system/config/toggle-auto-process", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.ToggleAutoProcess)
|
||||
api.GET("/public/system-config", handlers.GetPublicSystemConfig)
|
||||
|
||||
// 热播剧管理路由(查询接口无需认证)
|
||||
@@ -201,22 +221,15 @@ func main() {
|
||||
api.PUT("/hot-dramas/:id", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.UpdateHotDrama)
|
||||
api.DELETE("/hot-dramas/:id", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.DeleteHotDrama)
|
||||
|
||||
// 调度器管理路由(查询接口无需认证)
|
||||
api.GET("/scheduler/status", handlers.GetSchedulerStatus)
|
||||
api.GET("/scheduler/hot-drama/names", handlers.FetchHotDramaNames)
|
||||
api.POST("/scheduler/hot-drama/start", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.StartHotDramaScheduler)
|
||||
api.POST("/scheduler/hot-drama/stop", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.StopHotDramaScheduler)
|
||||
api.POST("/scheduler/hot-drama/trigger", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.TriggerHotDramaScheduler)
|
||||
|
||||
// 待处理资源自动处理管理路由
|
||||
api.POST("/scheduler/ready-resource/start", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.StartReadyResourceScheduler)
|
||||
api.POST("/scheduler/ready-resource/stop", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.StopReadyResourceScheduler)
|
||||
api.POST("/scheduler/ready-resource/trigger", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.TriggerReadyResourceScheduler)
|
||||
|
||||
// 自动转存管理路由
|
||||
api.POST("/scheduler/auto-transfer/start", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.StartAutoTransferScheduler)
|
||||
api.POST("/scheduler/auto-transfer/stop", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.StopAutoTransferScheduler)
|
||||
api.POST("/scheduler/auto-transfer/trigger", middleware.AuthMiddleware(), middleware.AdminMiddleware(), handlers.TriggerAutoTransferScheduler)
|
||||
// 任务管理路由
|
||||
api.POST("/tasks/transfer", middleware.AuthMiddleware(), middleware.AdminMiddleware(), taskHandler.CreateBatchTransferTask)
|
||||
api.GET("/tasks", middleware.AuthMiddleware(), middleware.AdminMiddleware(), taskHandler.GetTasks)
|
||||
api.GET("/tasks/:id", middleware.AuthMiddleware(), middleware.AdminMiddleware(), taskHandler.GetTaskStatus)
|
||||
api.POST("/tasks/:id/start", middleware.AuthMiddleware(), middleware.AdminMiddleware(), taskHandler.StartTask)
|
||||
api.POST("/tasks/:id/stop", middleware.AuthMiddleware(), middleware.AdminMiddleware(), taskHandler.StopTask)
|
||||
api.POST("/tasks/:id/pause", middleware.AuthMiddleware(), middleware.AdminMiddleware(), taskHandler.PauseTask)
|
||||
api.DELETE("/tasks/:id", middleware.AuthMiddleware(), middleware.AdminMiddleware(), taskHandler.DeleteTask)
|
||||
api.GET("/tasks/:id/items", middleware.AuthMiddleware(), middleware.AdminMiddleware(), taskHandler.GetTaskItems)
|
||||
|
||||
// 版本管理路由
|
||||
api.GET("/version", handlers.GetVersion)
|
||||
|
||||
@@ -94,9 +94,9 @@ func GenerateToken(user *entity.User) (string, error) {
|
||||
Username: user.Username,
|
||||
Role: user.Role,
|
||||
RegisteredClaims: jwt.RegisteredClaims{
|
||||
ExpiresAt: jwt.NewNumericDate(time.Now().Add(30 * 24 * time.Hour)), // 30天有效期
|
||||
IssuedAt: jwt.NewNumericDate(time.Now()),
|
||||
NotBefore: jwt.NewNumericDate(time.Now()),
|
||||
ExpiresAt: jwt.NewNumericDate(utils.GetCurrentTime().Add(30 * 24 * time.Hour)), // 30天有效期
|
||||
IssuedAt: jwt.NewNumericDate(utils.GetCurrentTime()),
|
||||
NotBefore: jwt.NewNumericDate(utils.GetCurrentTime()),
|
||||
},
|
||||
}
|
||||
|
||||
|
||||
@@ -3,6 +3,7 @@ package middleware
|
||||
import (
|
||||
"net/http"
|
||||
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/ctwj/urldb/db/repo"
|
||||
"github.com/gin-gonic/gin"
|
||||
)
|
||||
@@ -45,7 +46,8 @@ func PublicAPIAuth() gin.HandlerFunc {
|
||||
return
|
||||
}
|
||||
|
||||
config, err := repoManager.SystemConfigRepository.FindFirst()
|
||||
// 验证API Token
|
||||
apiTokenConfig, err := repoManager.SystemConfigRepository.GetConfigValue(entity.ConfigKeyApiToken)
|
||||
if err != nil {
|
||||
c.JSON(http.StatusInternalServerError, gin.H{
|
||||
"success": false,
|
||||
@@ -56,7 +58,7 @@ func PublicAPIAuth() gin.HandlerFunc {
|
||||
return
|
||||
}
|
||||
|
||||
if config.ApiToken == "" {
|
||||
if apiTokenConfig == "" {
|
||||
c.JSON(http.StatusServiceUnavailable, gin.H{
|
||||
"success": false,
|
||||
"message": "API Token未配置",
|
||||
@@ -66,7 +68,7 @@ func PublicAPIAuth() gin.HandlerFunc {
|
||||
return
|
||||
}
|
||||
|
||||
if config.ApiToken != apiToken {
|
||||
if apiTokenConfig != apiToken {
|
||||
c.JSON(http.StatusUnauthorized, gin.H{
|
||||
"success": false,
|
||||
"message": "API Token无效",
|
||||
@@ -77,7 +79,18 @@ func PublicAPIAuth() gin.HandlerFunc {
|
||||
}
|
||||
|
||||
// 检查维护模式
|
||||
if config.MaintenanceMode {
|
||||
maintenanceMode, err := repoManager.SystemConfigRepository.GetConfigBool(entity.ConfigKeyMaintenanceMode)
|
||||
if err != nil {
|
||||
c.JSON(http.StatusInternalServerError, gin.H{
|
||||
"success": false,
|
||||
"message": "系统配置获取失败",
|
||||
"code": 500,
|
||||
})
|
||||
c.Abort()
|
||||
return
|
||||
}
|
||||
|
||||
if maintenanceMode {
|
||||
c.JSON(http.StatusServiceUnavailable, gin.H{
|
||||
"success": false,
|
||||
"message": "系统维护中,请稍后再试",
|
||||
|
||||
444
scheduler/auto_transfer.go
Normal file
@@ -0,0 +1,444 @@
|
||||
package scheduler
|
||||
|
||||
import (
|
||||
"fmt"
|
||||
"math/rand"
|
||||
"strings"
|
||||
"sync"
|
||||
"time"
|
||||
|
||||
panutils "github.com/ctwj/urldb/common"
|
||||
commonutils "github.com/ctwj/urldb/common/utils"
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/ctwj/urldb/db/repo"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
"gorm.io/gorm"
|
||||
)
|
||||
|
||||
// AutoTransferScheduler 自动转存调度器
|
||||
type AutoTransferScheduler struct {
|
||||
*BaseScheduler
|
||||
autoTransferRunning bool
|
||||
autoTransferMutex sync.Mutex // 防止自动转存任务重叠执行
|
||||
}
|
||||
|
||||
// NewAutoTransferScheduler 创建自动转存调度器
|
||||
func NewAutoTransferScheduler(base *BaseScheduler) *AutoTransferScheduler {
|
||||
return &AutoTransferScheduler{
|
||||
BaseScheduler: base,
|
||||
autoTransferRunning: false,
|
||||
autoTransferMutex: sync.Mutex{},
|
||||
}
|
||||
}
|
||||
|
||||
// Start 启动自动转存定时任务
|
||||
func (a *AutoTransferScheduler) Start() {
|
||||
|
||||
// 自动转存已经放弃,不再自动缓存
|
||||
return
|
||||
|
||||
if a.autoTransferRunning {
|
||||
utils.Info("自动转存定时任务已在运行中")
|
||||
return
|
||||
}
|
||||
|
||||
a.autoTransferRunning = true
|
||||
utils.Info("启动自动转存定时任务")
|
||||
|
||||
go func() {
|
||||
// 获取系统配置中的间隔时间
|
||||
interval := 5 * time.Minute // 默认5分钟
|
||||
if autoProcessInterval, err := a.systemConfigRepo.GetConfigInt(entity.ConfigKeyAutoProcessInterval); err == nil && autoProcessInterval > 0 {
|
||||
interval = time.Duration(autoProcessInterval) * time.Minute
|
||||
}
|
||||
|
||||
ticker := time.NewTicker(interval)
|
||||
defer ticker.Stop()
|
||||
|
||||
utils.Info(fmt.Sprintf("自动转存定时任务已启动,间隔时间: %v", interval))
|
||||
|
||||
// 立即执行一次
|
||||
a.processAutoTransfer()
|
||||
|
||||
for {
|
||||
select {
|
||||
case <-ticker.C:
|
||||
// 使用TryLock防止任务重叠执行
|
||||
if a.autoTransferMutex.TryLock() {
|
||||
go func() {
|
||||
defer a.autoTransferMutex.Unlock()
|
||||
a.processAutoTransfer()
|
||||
}()
|
||||
} else {
|
||||
utils.Info("上一次自动转存任务还在执行中,跳过本次执行")
|
||||
}
|
||||
case <-a.GetStopChan():
|
||||
utils.Info("停止自动转存定时任务")
|
||||
return
|
||||
}
|
||||
}
|
||||
}()
|
||||
}
|
||||
|
||||
// Stop 停止自动转存定时任务
|
||||
func (a *AutoTransferScheduler) Stop() {
|
||||
if !a.autoTransferRunning {
|
||||
utils.Info("自动转存定时任务未在运行")
|
||||
return
|
||||
}
|
||||
|
||||
a.GetStopChan() <- true
|
||||
a.autoTransferRunning = false
|
||||
utils.Info("已发送停止信号给自动转存定时任务")
|
||||
}
|
||||
|
||||
// IsAutoTransferRunning 检查自动转存任务是否正在运行
|
||||
func (a *AutoTransferScheduler) IsAutoTransferRunning() bool {
|
||||
return a.autoTransferRunning
|
||||
}
|
||||
|
||||
// processAutoTransfer 处理自动转存
|
||||
func (a *AutoTransferScheduler) processAutoTransfer() {
|
||||
utils.Info("开始处理自动转存...")
|
||||
|
||||
// 检查系统配置,确认是否启用自动转存
|
||||
autoTransferEnabled, err := a.systemConfigRepo.GetConfigBool(entity.ConfigKeyAutoTransferEnabled)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("获取系统配置失败: %v", err))
|
||||
return
|
||||
}
|
||||
|
||||
if !autoTransferEnabled {
|
||||
utils.Info("自动转存功能已禁用")
|
||||
return
|
||||
}
|
||||
|
||||
// 获取quark平台ID
|
||||
quarkPanID, err := a.getQuarkPanID()
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("获取夸克网盘ID失败: %v", err))
|
||||
return
|
||||
}
|
||||
|
||||
// 获取所有账号
|
||||
accounts, err := a.cksRepo.FindAll()
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("获取网盘账号失败: %v", err))
|
||||
return
|
||||
}
|
||||
|
||||
// 获取最小存储空间配置
|
||||
autoTransferMinSpace, err := a.systemConfigRepo.GetConfigInt(entity.ConfigKeyAutoTransferMinSpace)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("获取最小存储空间配置失败: %v", err))
|
||||
return
|
||||
}
|
||||
|
||||
// 过滤:只保留已激活、quark平台、剩余空间足够的账号
|
||||
minSpaceBytes := int64(autoTransferMinSpace) * 1024 * 1024 * 1024
|
||||
var validAccounts []entity.Cks
|
||||
for _, acc := range accounts {
|
||||
if acc.IsValid && acc.PanID == quarkPanID && acc.LeftSpace >= minSpaceBytes {
|
||||
validAccounts = append(validAccounts, acc)
|
||||
}
|
||||
}
|
||||
|
||||
if len(validAccounts) == 0 {
|
||||
utils.Info("没有可用的quark网盘账号")
|
||||
return
|
||||
}
|
||||
|
||||
utils.Info(fmt.Sprintf("找到 %d 个可用quark网盘账号,开始自动转存处理...", len(validAccounts)))
|
||||
|
||||
// 计算处理数量限制
|
||||
// 假设每5秒转存一个资源,每分钟20个,5分钟100个
|
||||
// 根据时间间隔和账号数量计算大致的处理数量
|
||||
interval := 5 * time.Minute // 默认5分钟
|
||||
if autoProcessInterval, err := a.systemConfigRepo.GetConfigInt(entity.ConfigKeyAutoProcessInterval); err == nil && autoProcessInterval > 0 {
|
||||
interval = time.Duration(autoProcessInterval) * time.Minute
|
||||
}
|
||||
|
||||
// 计算每分钟能处理的资源数量:账号数 * 12(每分钟12个,即每5秒一个)
|
||||
resourcesPerMinute := len(validAccounts) * 12
|
||||
// 根据时间间隔计算总处理数量
|
||||
maxProcessCount := int(float64(resourcesPerMinute) * interval.Minutes())
|
||||
|
||||
utils.Info(fmt.Sprintf("时间间隔: %v, 账号数: %d, 每分钟处理能力: %d, 最大处理数量: %d",
|
||||
interval, len(validAccounts), resourcesPerMinute, maxProcessCount))
|
||||
|
||||
// 获取需要转存的资源(限制数量)
|
||||
resources, err := a.getResourcesForTransfer(quarkPanID, maxProcessCount)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("获取需要转存的资源失败: %v", err))
|
||||
return
|
||||
}
|
||||
|
||||
if len(resources) == 0 {
|
||||
utils.Info("没有需要转存的资源")
|
||||
return
|
||||
}
|
||||
|
||||
utils.Info(fmt.Sprintf("找到 %d 个需要转存的资源", len(resources)))
|
||||
|
||||
// 获取违禁词配置
|
||||
forbiddenWords, err := a.systemConfigRepo.GetConfigValue(entity.ConfigKeyForbiddenWords)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("获取违禁词配置失败: %v", err))
|
||||
forbiddenWords = "" // 如果获取失败,使用空字符串
|
||||
}
|
||||
|
||||
// 过滤包含违禁词的资源,并标记违禁词错误
|
||||
var filteredResources []*entity.Resource
|
||||
var forbiddenResources []*entity.Resource
|
||||
|
||||
if forbiddenWords != "" {
|
||||
words := strings.Split(forbiddenWords, ",")
|
||||
// 清理违禁词数组,去除空格
|
||||
var cleanWords []string
|
||||
for _, word := range words {
|
||||
word = strings.TrimSpace(word)
|
||||
if word != "" {
|
||||
cleanWords = append(cleanWords, word)
|
||||
}
|
||||
}
|
||||
|
||||
for _, resource := range resources {
|
||||
shouldSkip := false
|
||||
var matchedWords []string
|
||||
title := strings.ToLower(resource.Title)
|
||||
description := strings.ToLower(resource.Description)
|
||||
|
||||
for _, word := range cleanWords {
|
||||
wordLower := strings.ToLower(word)
|
||||
if strings.Contains(title, wordLower) || strings.Contains(description, wordLower) {
|
||||
matchedWords = append(matchedWords, word)
|
||||
shouldSkip = true
|
||||
}
|
||||
}
|
||||
|
||||
if shouldSkip {
|
||||
// 标记为违禁词错误
|
||||
resource.ErrorMsg = fmt.Sprintf("存在违禁词: %s", strings.Join(matchedWords, ", "))
|
||||
forbiddenResources = append(forbiddenResources, resource)
|
||||
utils.Info(fmt.Sprintf("标记违禁词资源: %s, 违禁词: %s", resource.Title, strings.Join(matchedWords, ", ")))
|
||||
} else {
|
||||
filteredResources = append(filteredResources, resource)
|
||||
}
|
||||
}
|
||||
utils.Info(fmt.Sprintf("违禁词过滤后,剩余 %d 个资源需要转存,违禁词资源 %d 个", len(filteredResources), len(forbiddenResources)))
|
||||
} else {
|
||||
filteredResources = resources
|
||||
}
|
||||
|
||||
// 注意:资源数量已在数据库查询时限制,无需再次限制
|
||||
|
||||
// 保存违禁词资源的错误信息
|
||||
for _, resource := range forbiddenResources {
|
||||
if err := a.resourceRepo.Update(resource); err != nil {
|
||||
utils.Error(fmt.Sprintf("保存违禁词错误信息失败 (ID: %d): %v", resource.ID, err))
|
||||
}
|
||||
}
|
||||
|
||||
// 并发自动转存
|
||||
resourceCh := make(chan *entity.Resource, len(filteredResources))
|
||||
for _, res := range filteredResources {
|
||||
resourceCh <- res
|
||||
}
|
||||
close(resourceCh)
|
||||
|
||||
var wg sync.WaitGroup
|
||||
for _, account := range validAccounts {
|
||||
wg.Add(1)
|
||||
go func(acc entity.Cks) {
|
||||
defer wg.Done()
|
||||
factory := panutils.GetInstance() // 使用单例模式
|
||||
for res := range resourceCh {
|
||||
if err := a.transferResource(res, []entity.Cks{acc}, factory); err != nil {
|
||||
utils.Error(fmt.Sprintf("转存资源失败 (ID: %d): %v", res.ID, err))
|
||||
} else {
|
||||
utils.Info(fmt.Sprintf("成功转存资源: %s", res.Title))
|
||||
rand.Seed(utils.GetCurrentTime().UnixNano())
|
||||
sleepSec := rand.Intn(3) + 1 // 1,2,3
|
||||
time.Sleep(time.Duration(sleepSec) * time.Second)
|
||||
}
|
||||
}
|
||||
}(account)
|
||||
}
|
||||
wg.Wait()
|
||||
utils.Info(fmt.Sprintf("自动转存处理完成,账号数: %d,处理资源数: %d,违禁词资源数: %d",
|
||||
len(validAccounts), len(filteredResources), len(forbiddenResources)))
|
||||
}
|
||||
|
||||
// getQuarkPanID 获取夸克网盘ID
|
||||
func (a *AutoTransferScheduler) getQuarkPanID() (uint, error) {
|
||||
// 获取panRepo的实现,以便访问数据库
|
||||
panRepoImpl, ok := a.panRepo.(interface{ GetDB() *gorm.DB })
|
||||
if !ok {
|
||||
return 0, fmt.Errorf("panRepo不支持GetDB方法")
|
||||
}
|
||||
|
||||
var quarkPan entity.Pan
|
||||
err := panRepoImpl.GetDB().Where("name = ?", "quark").First(&quarkPan).Error
|
||||
if err != nil {
|
||||
return 0, fmt.Errorf("未找到quark平台: %v", err)
|
||||
}
|
||||
|
||||
return quarkPan.ID, nil
|
||||
}
|
||||
|
||||
// getResourcesForTransfer 获取需要转存的资源
|
||||
func (a *AutoTransferScheduler) getResourcesForTransfer(quarkPanID uint, limit int) ([]*entity.Resource, error) {
|
||||
// 获取最近24小时内的资源
|
||||
sinceTime := utils.GetCurrentTime().Add(-24 * time.Hour)
|
||||
|
||||
// 使用资源仓库的方法获取需要转存的资源
|
||||
repoImpl, ok := a.resourceRepo.(*repo.ResourceRepositoryImpl)
|
||||
if !ok {
|
||||
return nil, fmt.Errorf("资源仓库类型错误")
|
||||
}
|
||||
|
||||
return repoImpl.GetResourcesForTransfer(quarkPanID, sinceTime, limit)
|
||||
}
|
||||
|
||||
// transferResource 转存单个资源
|
||||
func (a *AutoTransferScheduler) transferResource(resource *entity.Resource, accounts []entity.Cks, factory *panutils.PanFactory) error {
|
||||
if len(accounts) == 0 {
|
||||
return fmt.Errorf("没有可用的网盘账号")
|
||||
}
|
||||
account := accounts[0]
|
||||
|
||||
service, err := factory.CreatePanService(resource.URL, &panutils.PanConfig{
|
||||
URL: resource.URL,
|
||||
ExpiredType: 0,
|
||||
IsType: 0,
|
||||
Cookie: account.Ck,
|
||||
})
|
||||
if err != nil {
|
||||
return fmt.Errorf("创建网盘服务失败: %v", err)
|
||||
}
|
||||
|
||||
// 获取最小存储空间配置
|
||||
autoTransferMinSpace, err := a.systemConfigRepo.GetConfigInt(entity.ConfigKeyAutoTransferMinSpace)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("获取最小存储空间配置失败: %v", err))
|
||||
return err
|
||||
}
|
||||
|
||||
// 检查账号剩余空间
|
||||
minSpaceBytes := int64(autoTransferMinSpace) * 1024 * 1024 * 1024
|
||||
if account.LeftSpace < minSpaceBytes {
|
||||
return fmt.Errorf("账号剩余空间不足,需要 %d GB,当前剩余 %d GB", autoTransferMinSpace, account.LeftSpace/1024/1024/1024)
|
||||
}
|
||||
|
||||
// 提取分享ID
|
||||
shareID, _ := commonutils.ExtractShareIdString(resource.URL)
|
||||
|
||||
// 转存资源
|
||||
result, err := service.Transfer(shareID)
|
||||
if err != nil {
|
||||
// 更新错误信息
|
||||
resource.ErrorMsg = err.Error()
|
||||
a.resourceRepo.Update(resource)
|
||||
return fmt.Errorf("转存失败: %v", err)
|
||||
}
|
||||
|
||||
if result == nil || !result.Success {
|
||||
errMsg := "转存失败"
|
||||
if result != nil && result.Message != "" {
|
||||
errMsg = result.Message
|
||||
}
|
||||
// 更新错误信息
|
||||
resource.ErrorMsg = errMsg
|
||||
a.resourceRepo.Update(resource)
|
||||
return fmt.Errorf("转存失败: %s", errMsg)
|
||||
}
|
||||
|
||||
// 提取转存链接、fid等
|
||||
var saveURL, fid string
|
||||
if data, ok := result.Data.(map[string]interface{}); ok {
|
||||
if v, ok := data["shareUrl"]; ok {
|
||||
saveURL, _ = v.(string)
|
||||
}
|
||||
if v, ok := data["fid"]; ok {
|
||||
fid, _ = v.(string)
|
||||
}
|
||||
}
|
||||
if saveURL == "" {
|
||||
saveURL = result.ShareURL
|
||||
}
|
||||
|
||||
// 更新资源信息
|
||||
resource.SaveURL = saveURL
|
||||
resource.CkID = &account.ID
|
||||
resource.Fid = fid
|
||||
resource.ErrorMsg = ""
|
||||
|
||||
// 保存更新
|
||||
err = a.resourceRepo.Update(resource)
|
||||
if err != nil {
|
||||
return fmt.Errorf("保存转存结果失败: %v", err)
|
||||
}
|
||||
|
||||
return nil
|
||||
}
|
||||
|
||||
// selectBestAccount 选择最佳账号
|
||||
func (a *AutoTransferScheduler) selectBestAccount(accounts []entity.Cks) *entity.Cks {
|
||||
if len(accounts) == 0 {
|
||||
return nil
|
||||
}
|
||||
|
||||
// 获取最小存储空间配置
|
||||
autoTransferMinSpace, err := a.systemConfigRepo.GetConfigInt(entity.ConfigKeyAutoTransferMinSpace)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("获取最小存储空间配置失败: %v", err))
|
||||
return &accounts[0] // 返回第一个账号
|
||||
}
|
||||
|
||||
minSpaceBytes := int64(autoTransferMinSpace) * 1024 * 1024 * 1024
|
||||
|
||||
var bestAccount *entity.Cks
|
||||
var bestScore int64 = -1
|
||||
|
||||
for i := range accounts {
|
||||
account := &accounts[i]
|
||||
if account.LeftSpace < minSpaceBytes {
|
||||
continue // 跳过空间不足的账号
|
||||
}
|
||||
|
||||
score := a.calculateAccountScore(account)
|
||||
if score > bestScore {
|
||||
bestScore = score
|
||||
bestAccount = account
|
||||
}
|
||||
}
|
||||
|
||||
return bestAccount
|
||||
}
|
||||
|
||||
// calculateAccountScore 计算账号评分
|
||||
func (a *AutoTransferScheduler) calculateAccountScore(account *entity.Cks) int64 {
|
||||
// TODO: 实现账号评分算法
|
||||
// 1. VIP账号加分
|
||||
// 2. 剩余空间大的账号加分
|
||||
// 3. 使用率低的账号加分
|
||||
// 4. 可以根据历史使用情况调整评分
|
||||
|
||||
score := int64(0)
|
||||
|
||||
// VIP账号加分
|
||||
if account.VipStatus {
|
||||
score += 1000
|
||||
}
|
||||
|
||||
// 剩余空间加分(每GB加1分)
|
||||
score += account.LeftSpace / (1024 * 1024 * 1024)
|
||||
|
||||
// 使用率加分(使用率越低分数越高)
|
||||
if account.Space > 0 {
|
||||
usageRate := float64(account.UsedSpace) / float64(account.Space)
|
||||
score += int64((1 - usageRate) * 500) // 使用率越低,加分越多
|
||||
}
|
||||
|
||||
return score
|
||||
}
|
||||
88
scheduler/base.go
Normal file
@@ -0,0 +1,88 @@
|
||||
package scheduler
|
||||
|
||||
import (
|
||||
"sync"
|
||||
"time"
|
||||
|
||||
"github.com/ctwj/urldb/db/repo"
|
||||
)
|
||||
|
||||
// BaseScheduler 基础调度器结构
|
||||
type BaseScheduler struct {
|
||||
// 共享的仓库
|
||||
hotDramaRepo repo.HotDramaRepository
|
||||
readyResourceRepo repo.ReadyResourceRepository
|
||||
resourceRepo repo.ResourceRepository
|
||||
systemConfigRepo repo.SystemConfigRepository
|
||||
panRepo repo.PanRepository
|
||||
cksRepo repo.CksRepository
|
||||
tagRepo repo.TagRepository
|
||||
categoryRepo repo.CategoryRepository
|
||||
|
||||
// 控制字段
|
||||
stopChan chan bool
|
||||
isRunning bool
|
||||
|
||||
// 平台映射缓存
|
||||
panCache map[string]*uint // serviceType -> panID
|
||||
panCacheOnce sync.Once
|
||||
}
|
||||
|
||||
// NewBaseScheduler 创建基础调度器
|
||||
func NewBaseScheduler(
|
||||
hotDramaRepo repo.HotDramaRepository,
|
||||
readyResourceRepo repo.ReadyResourceRepository,
|
||||
resourceRepo repo.ResourceRepository,
|
||||
systemConfigRepo repo.SystemConfigRepository,
|
||||
panRepo repo.PanRepository,
|
||||
cksRepo repo.CksRepository,
|
||||
tagRepo repo.TagRepository,
|
||||
categoryRepo repo.CategoryRepository,
|
||||
) *BaseScheduler {
|
||||
return &BaseScheduler{
|
||||
hotDramaRepo: hotDramaRepo,
|
||||
readyResourceRepo: readyResourceRepo,
|
||||
resourceRepo: resourceRepo,
|
||||
systemConfigRepo: systemConfigRepo,
|
||||
panRepo: panRepo,
|
||||
cksRepo: cksRepo,
|
||||
tagRepo: tagRepo,
|
||||
categoryRepo: categoryRepo,
|
||||
stopChan: make(chan bool),
|
||||
isRunning: false,
|
||||
panCache: make(map[string]*uint),
|
||||
}
|
||||
}
|
||||
|
||||
// Stop 停止调度器
|
||||
func (b *BaseScheduler) Stop() {
|
||||
if b.isRunning {
|
||||
b.stopChan <- true
|
||||
b.isRunning = false
|
||||
}
|
||||
}
|
||||
|
||||
// IsRunning 检查是否正在运行
|
||||
func (b *BaseScheduler) IsRunning() bool {
|
||||
return b.isRunning
|
||||
}
|
||||
|
||||
// SetRunning 设置运行状态
|
||||
func (b *BaseScheduler) SetRunning(running bool) {
|
||||
b.isRunning = running
|
||||
}
|
||||
|
||||
// GetStopChan 获取停止通道
|
||||
func (b *BaseScheduler) GetStopChan() chan bool {
|
||||
return b.stopChan
|
||||
}
|
||||
|
||||
// SleepWithStopCheck 带停止检查的睡眠
|
||||
func (b *BaseScheduler) SleepWithStopCheck(duration time.Duration) bool {
|
||||
select {
|
||||
case <-time.After(duration):
|
||||
return false
|
||||
case <-b.stopChan:
|
||||
return true
|
||||
}
|
||||
}
|
||||
184
scheduler/global.go
Normal file
@@ -0,0 +1,184 @@
|
||||
package scheduler
|
||||
|
||||
import (
|
||||
"sync"
|
||||
|
||||
"github.com/ctwj/urldb/db/repo"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
)
|
||||
|
||||
// GlobalScheduler 全局调度器管理器
|
||||
type GlobalScheduler struct {
|
||||
manager *Manager
|
||||
mutex sync.RWMutex
|
||||
}
|
||||
|
||||
var (
|
||||
globalScheduler *GlobalScheduler
|
||||
once sync.Once
|
||||
)
|
||||
|
||||
// GetGlobalScheduler 获取全局调度器实例(单例模式)
|
||||
func GetGlobalScheduler(hotDramaRepo repo.HotDramaRepository, readyResourceRepo repo.ReadyResourceRepository, resourceRepo repo.ResourceRepository, systemConfigRepo repo.SystemConfigRepository, panRepo repo.PanRepository, cksRepo repo.CksRepository, tagRepo repo.TagRepository, categoryRepo repo.CategoryRepository) *GlobalScheduler {
|
||||
once.Do(func() {
|
||||
globalScheduler = &GlobalScheduler{
|
||||
manager: NewManager(hotDramaRepo, readyResourceRepo, resourceRepo, systemConfigRepo, panRepo, cksRepo, tagRepo, categoryRepo),
|
||||
}
|
||||
})
|
||||
return globalScheduler
|
||||
}
|
||||
|
||||
// StartHotDramaScheduler 启动热播剧定时任务
|
||||
func (gs *GlobalScheduler) StartHotDramaScheduler() {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
if gs.manager.IsHotDramaRunning() {
|
||||
utils.Info("热播剧定时任务已在运行中")
|
||||
return
|
||||
}
|
||||
|
||||
gs.manager.StartHotDramaScheduler()
|
||||
utils.Info("全局调度器已启动热播剧定时任务")
|
||||
}
|
||||
|
||||
// StopHotDramaScheduler 停止热播剧定时任务
|
||||
func (gs *GlobalScheduler) StopHotDramaScheduler() {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
if !gs.manager.IsHotDramaRunning() {
|
||||
utils.Info("热播剧定时任务未在运行")
|
||||
return
|
||||
}
|
||||
|
||||
gs.manager.StopHotDramaScheduler()
|
||||
utils.Info("全局调度器已停止热播剧定时任务")
|
||||
}
|
||||
|
||||
// IsHotDramaSchedulerRunning 检查热播剧定时任务是否在运行
|
||||
func (gs *GlobalScheduler) IsHotDramaSchedulerRunning() bool {
|
||||
gs.mutex.RLock()
|
||||
defer gs.mutex.RUnlock()
|
||||
return gs.manager.IsHotDramaRunning()
|
||||
}
|
||||
|
||||
// GetHotDramaNames 手动获取热播剧名字
|
||||
func (gs *GlobalScheduler) GetHotDramaNames() ([]string, error) {
|
||||
return gs.manager.GetHotDramaNames()
|
||||
}
|
||||
|
||||
// StartReadyResourceScheduler 启动待处理资源自动处理任务
|
||||
func (gs *GlobalScheduler) StartReadyResourceScheduler() {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
if gs.manager.IsReadyResourceRunning() {
|
||||
utils.Info("待处理资源自动处理任务已在运行中")
|
||||
return
|
||||
}
|
||||
|
||||
gs.manager.StartReadyResourceScheduler()
|
||||
utils.Info("全局调度器已启动待处理资源自动处理任务")
|
||||
}
|
||||
|
||||
// StopReadyResourceScheduler 停止待处理资源自动处理任务
|
||||
func (gs *GlobalScheduler) StopReadyResourceScheduler() {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
if !gs.manager.IsReadyResourceRunning() {
|
||||
utils.Info("待处理资源自动处理任务未在运行")
|
||||
return
|
||||
}
|
||||
|
||||
gs.manager.StopReadyResourceScheduler()
|
||||
utils.Info("全局调度器已停止待处理资源自动处理任务")
|
||||
}
|
||||
|
||||
// IsReadyResourceRunning 检查待处理资源自动处理任务是否在运行
|
||||
func (gs *GlobalScheduler) IsReadyResourceRunning() bool {
|
||||
gs.mutex.RLock()
|
||||
defer gs.mutex.RUnlock()
|
||||
return gs.manager.IsReadyResourceRunning()
|
||||
}
|
||||
|
||||
// StartAutoTransferScheduler 启动自动转存定时任务
|
||||
func (gs *GlobalScheduler) StartAutoTransferScheduler() {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
if gs.manager.IsAutoTransferRunning() {
|
||||
utils.Info("自动转存定时任务已在运行中")
|
||||
return
|
||||
}
|
||||
|
||||
gs.manager.StartAutoTransferScheduler()
|
||||
utils.Info("全局调度器已启动自动转存定时任务")
|
||||
}
|
||||
|
||||
// StopAutoTransferScheduler 停止自动转存定时任务
|
||||
func (gs *GlobalScheduler) StopAutoTransferScheduler() {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
if !gs.manager.IsAutoTransferRunning() {
|
||||
utils.Info("自动转存定时任务未在运行")
|
||||
return
|
||||
}
|
||||
|
||||
gs.manager.StopAutoTransferScheduler()
|
||||
utils.Info("全局调度器已停止自动转存定时任务")
|
||||
}
|
||||
|
||||
// IsAutoTransferRunning 检查自动转存定时任务是否在运行
|
||||
func (gs *GlobalScheduler) IsAutoTransferRunning() bool {
|
||||
gs.mutex.RLock()
|
||||
defer gs.mutex.RUnlock()
|
||||
return gs.manager.IsAutoTransferRunning()
|
||||
}
|
||||
|
||||
// UpdateSchedulerStatusWithAutoTransfer 根据系统配置更新调度器状态(包含自动转存)
|
||||
func (gs *GlobalScheduler) UpdateSchedulerStatusWithAutoTransfer(autoFetchHotDramaEnabled bool, autoProcessReadyResources bool, autoTransferEnabled bool) {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
// 处理热播剧自动拉取功能
|
||||
if autoFetchHotDramaEnabled {
|
||||
if !gs.manager.IsHotDramaRunning() {
|
||||
utils.Info("系统配置启用自动拉取热播剧,启动定时任务")
|
||||
gs.manager.StartHotDramaScheduler()
|
||||
}
|
||||
} else {
|
||||
if gs.manager.IsHotDramaRunning() {
|
||||
utils.Info("系统配置禁用自动拉取热播剧,停止定时任务")
|
||||
gs.manager.StopHotDramaScheduler()
|
||||
}
|
||||
}
|
||||
|
||||
// 处理待处理资源自动处理功能
|
||||
if autoProcessReadyResources {
|
||||
if !gs.manager.IsReadyResourceRunning() {
|
||||
utils.Info("系统配置启用自动处理待处理资源,启动定时任务")
|
||||
gs.manager.StartReadyResourceScheduler()
|
||||
}
|
||||
} else {
|
||||
if gs.manager.IsReadyResourceRunning() {
|
||||
utils.Info("系统配置禁用自动处理待处理资源,停止定时任务")
|
||||
gs.manager.StopReadyResourceScheduler()
|
||||
}
|
||||
}
|
||||
|
||||
// 处理自动转存功能
|
||||
if autoTransferEnabled {
|
||||
if !gs.manager.IsAutoTransferRunning() {
|
||||
utils.Info("系统配置启用自动转存,启动定时任务")
|
||||
gs.manager.StartAutoTransferScheduler()
|
||||
}
|
||||
} else {
|
||||
if gs.manager.IsAutoTransferRunning() {
|
||||
utils.Info("系统配置禁用自动转存,停止定时任务")
|
||||
gs.manager.StopAutoTransferScheduler()
|
||||
}
|
||||
}
|
||||
}
|
||||
235
scheduler/hot_drama.go
Normal file
@@ -0,0 +1,235 @@
|
||||
package scheduler
|
||||
|
||||
import (
|
||||
"fmt"
|
||||
"strings"
|
||||
"sync"
|
||||
"time"
|
||||
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
)
|
||||
|
||||
// HotDramaScheduler 热播剧调度器
|
||||
type HotDramaScheduler struct {
|
||||
*BaseScheduler
|
||||
doubanService *utils.DoubanService
|
||||
hotDramaMutex sync.Mutex // 防止热播剧任务重叠执行
|
||||
}
|
||||
|
||||
// NewHotDramaScheduler 创建热播剧调度器
|
||||
func NewHotDramaScheduler(base *BaseScheduler) *HotDramaScheduler {
|
||||
return &HotDramaScheduler{
|
||||
BaseScheduler: base,
|
||||
doubanService: utils.NewDoubanService(),
|
||||
hotDramaMutex: sync.Mutex{},
|
||||
}
|
||||
}
|
||||
|
||||
// Start 启动热播剧定时任务
|
||||
func (h *HotDramaScheduler) Start() {
|
||||
if h.IsRunning() {
|
||||
utils.Info("热播剧定时任务已在运行中")
|
||||
return
|
||||
}
|
||||
|
||||
h.SetRunning(true)
|
||||
utils.Info("启动热播剧定时任务")
|
||||
|
||||
go func() {
|
||||
ticker := time.NewTicker(12 * time.Hour) // 每12小时执行一次
|
||||
defer ticker.Stop()
|
||||
|
||||
// 立即执行一次
|
||||
h.fetchHotDramaData()
|
||||
|
||||
for {
|
||||
select {
|
||||
case <-ticker.C:
|
||||
// 使用TryLock防止任务重叠执行
|
||||
if h.hotDramaMutex.TryLock() {
|
||||
go func() {
|
||||
defer h.hotDramaMutex.Unlock()
|
||||
h.fetchHotDramaData()
|
||||
}()
|
||||
} else {
|
||||
utils.Info("上一次热播剧任务还在执行中,跳过本次执行")
|
||||
}
|
||||
case <-h.GetStopChan():
|
||||
utils.Info("停止热播剧定时任务")
|
||||
return
|
||||
}
|
||||
}
|
||||
}()
|
||||
}
|
||||
|
||||
// Stop 停止热播剧定时任务
|
||||
func (h *HotDramaScheduler) Stop() {
|
||||
if !h.IsRunning() {
|
||||
utils.Info("热播剧定时任务未在运行")
|
||||
return
|
||||
}
|
||||
|
||||
h.GetStopChan() <- true
|
||||
h.SetRunning(false)
|
||||
utils.Info("已发送停止信号给热播剧定时任务")
|
||||
}
|
||||
|
||||
// fetchHotDramaData 获取热播剧数据
|
||||
func (h *HotDramaScheduler) fetchHotDramaData() {
|
||||
utils.Info("开始获取热播剧数据...")
|
||||
|
||||
// 直接处理电影和电视剧数据,不再需要FetchHotDramaNames
|
||||
h.processHotDramaNames([]string{})
|
||||
}
|
||||
|
||||
// processHotDramaNames 处理热播剧名称
|
||||
func (h *HotDramaScheduler) processHotDramaNames(dramaNames []string) {
|
||||
utils.Info("开始处理热播剧数据,共 %d 个", len(dramaNames))
|
||||
|
||||
// 收集所有数据
|
||||
var allDramas []*entity.HotDrama
|
||||
|
||||
// 获取电影数据
|
||||
movieDramas := h.processMovieData()
|
||||
allDramas = append(allDramas, movieDramas...)
|
||||
|
||||
// 获取电视剧数据
|
||||
tvDramas := h.processTvData()
|
||||
allDramas = append(allDramas, tvDramas...)
|
||||
|
||||
// 清空数据库
|
||||
utils.Info("准备清空数据库,当前共有 %d 条数据", len(allDramas))
|
||||
if err := h.hotDramaRepo.DeleteAll(); err != nil {
|
||||
utils.Error(fmt.Sprintf("清空数据库失败: %v", err))
|
||||
return
|
||||
}
|
||||
utils.Info("数据库清空完成")
|
||||
|
||||
// 批量插入所有数据
|
||||
if len(allDramas) > 0 {
|
||||
utils.Info("开始批量插入 %d 条数据", len(allDramas))
|
||||
if err := h.hotDramaRepo.BatchCreate(allDramas); err != nil {
|
||||
utils.Error(fmt.Sprintf("批量插入数据失败: %v", err))
|
||||
} else {
|
||||
utils.Info("成功批量插入 %d 条数据", len(allDramas))
|
||||
}
|
||||
} else {
|
||||
utils.Info("没有数据需要插入")
|
||||
}
|
||||
|
||||
utils.Info("热播剧数据处理完成")
|
||||
}
|
||||
|
||||
// processMovieData 处理电影数据
|
||||
func (h *HotDramaScheduler) processMovieData() []*entity.HotDrama {
|
||||
utils.Info("开始处理电影数据...")
|
||||
|
||||
var movieDramas []*entity.HotDrama
|
||||
|
||||
// 使用GetTypePage方法获取电影数据
|
||||
movieResult, err := h.doubanService.GetTypePage("热门", "全部")
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("获取电影榜单失败: %v", err))
|
||||
return movieDramas
|
||||
}
|
||||
|
||||
if movieResult.Success && movieResult.Data != nil {
|
||||
utils.Info("电影获取到 %d 个数据", len(movieResult.Data.Items))
|
||||
|
||||
for _, item := range movieResult.Data.Items {
|
||||
drama := &entity.HotDrama{
|
||||
Title: item.Title,
|
||||
CardSubtitle: item.CardSubtitle,
|
||||
EpisodesInfo: item.EpisodesInfo,
|
||||
IsNew: item.IsNew,
|
||||
Rating: item.Rating.Value,
|
||||
RatingCount: item.Rating.Count,
|
||||
Year: item.Year,
|
||||
Region: item.Region,
|
||||
Genres: strings.Join(item.Genres, ", "),
|
||||
Directors: strings.Join(item.Directors, ", "),
|
||||
Actors: strings.Join(item.Actors, ", "),
|
||||
PosterURL: item.Pic.Normal,
|
||||
Category: "电影",
|
||||
SubType: "热门",
|
||||
Source: "douban",
|
||||
DoubanID: item.ID,
|
||||
DoubanURI: item.URI,
|
||||
}
|
||||
|
||||
movieDramas = append(movieDramas, drama)
|
||||
utils.Info("收集电影: %s (评分: %.1f, 年份: %s, 地区: %s)",
|
||||
item.Title, item.Rating.Value, item.Year, item.Region)
|
||||
}
|
||||
} else {
|
||||
utils.Warn("电影获取数据失败或为空")
|
||||
}
|
||||
|
||||
utils.Info("电影数据处理完成,共收集 %d 条数据", len(movieDramas))
|
||||
return movieDramas
|
||||
}
|
||||
|
||||
// processTvData 处理电视剧数据
|
||||
func (h *HotDramaScheduler) processTvData() []*entity.HotDrama {
|
||||
utils.Info("开始处理电视剧数据...")
|
||||
|
||||
var tvDramas []*entity.HotDrama
|
||||
|
||||
// 获取所有tv类型
|
||||
tvTypes := h.doubanService.GetAllTvTypes()
|
||||
utils.Info("获取到 %d 个tv类型: %v", len(tvTypes), tvTypes)
|
||||
|
||||
// 遍历每个type,分别请求数据
|
||||
for _, tvType := range tvTypes {
|
||||
utils.Info("正在处理tv类型: %s", tvType)
|
||||
|
||||
// 使用GetTypePage方法请求数据
|
||||
tvResult, err := h.doubanService.GetTypePage("tv", tvType)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("获取tv类型 %s 数据失败: %v", tvType, err))
|
||||
continue
|
||||
}
|
||||
|
||||
if tvResult.Success && tvResult.Data != nil {
|
||||
utils.Info("tv类型 %s 获取到 %d 个数据", tvType, len(tvResult.Data.Items))
|
||||
|
||||
for _, item := range tvResult.Data.Items {
|
||||
drama := &entity.HotDrama{
|
||||
Title: item.Title,
|
||||
CardSubtitle: item.CardSubtitle,
|
||||
EpisodesInfo: item.EpisodesInfo,
|
||||
IsNew: item.IsNew,
|
||||
Rating: item.Rating.Value,
|
||||
RatingCount: item.Rating.Count,
|
||||
Year: item.Year,
|
||||
Region: item.Region,
|
||||
Genres: strings.Join(item.Genres, ", "),
|
||||
Directors: strings.Join(item.Directors, ", "),
|
||||
Actors: strings.Join(item.Actors, ", "),
|
||||
PosterURL: item.Pic.Normal,
|
||||
Category: "电视剧",
|
||||
SubType: tvType, // 使用具体的tv类型
|
||||
Source: "douban",
|
||||
DoubanID: item.ID,
|
||||
DoubanURI: item.URI,
|
||||
}
|
||||
|
||||
tvDramas = append(tvDramas, drama)
|
||||
utils.Info("收集tv类型 %s: %s (评分: %.1f, 年份: %s, 地区: %s)",
|
||||
tvType, item.Title, item.Rating.Value, item.Year, item.Region)
|
||||
}
|
||||
} else {
|
||||
utils.Warn("tv类型 %s 获取数据失败或为空", tvType)
|
||||
}
|
||||
}
|
||||
|
||||
utils.Info("电视剧数据处理完成,共收集 %d 条数据", len(tvDramas))
|
||||
return tvDramas
|
||||
}
|
||||
|
||||
// GetHotDramaNames 获取热播剧名称列表(公共方法)
|
||||
func (h *HotDramaScheduler) GetHotDramaNames() ([]string, error) {
|
||||
// 由于删除了FetchHotDramaNames方法,返回空数组
|
||||
return []string{}, nil
|
||||
}
|
||||
141
scheduler/manager.go
Normal file
@@ -0,0 +1,141 @@
|
||||
package scheduler
|
||||
|
||||
import (
|
||||
"github.com/ctwj/urldb/db/repo"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
)
|
||||
|
||||
// Manager 调度器管理器
|
||||
type Manager struct {
|
||||
baseScheduler *BaseScheduler
|
||||
hotDramaScheduler *HotDramaScheduler
|
||||
readyResourceScheduler *ReadyResourceScheduler
|
||||
autoTransferScheduler *AutoTransferScheduler
|
||||
}
|
||||
|
||||
// NewManager 创建调度器管理器
|
||||
func NewManager(
|
||||
hotDramaRepo repo.HotDramaRepository,
|
||||
readyResourceRepo repo.ReadyResourceRepository,
|
||||
resourceRepo repo.ResourceRepository,
|
||||
systemConfigRepo repo.SystemConfigRepository,
|
||||
panRepo repo.PanRepository,
|
||||
cksRepo repo.CksRepository,
|
||||
tagRepo repo.TagRepository,
|
||||
categoryRepo repo.CategoryRepository,
|
||||
) *Manager {
|
||||
// 创建基础调度器
|
||||
baseScheduler := NewBaseScheduler(
|
||||
hotDramaRepo,
|
||||
readyResourceRepo,
|
||||
resourceRepo,
|
||||
systemConfigRepo,
|
||||
panRepo,
|
||||
cksRepo,
|
||||
tagRepo,
|
||||
categoryRepo,
|
||||
)
|
||||
|
||||
// 创建各个具体的调度器
|
||||
hotDramaScheduler := NewHotDramaScheduler(baseScheduler)
|
||||
readyResourceScheduler := NewReadyResourceScheduler(baseScheduler)
|
||||
autoTransferScheduler := NewAutoTransferScheduler(baseScheduler)
|
||||
|
||||
return &Manager{
|
||||
baseScheduler: baseScheduler,
|
||||
hotDramaScheduler: hotDramaScheduler,
|
||||
readyResourceScheduler: readyResourceScheduler,
|
||||
autoTransferScheduler: autoTransferScheduler,
|
||||
}
|
||||
}
|
||||
|
||||
// StartAll 启动所有调度任务
|
||||
func (m *Manager) StartAll() {
|
||||
utils.Info("启动所有调度任务")
|
||||
|
||||
// 启动热播剧调度任务
|
||||
m.hotDramaScheduler.Start()
|
||||
|
||||
// 启动待处理资源调度任务
|
||||
m.readyResourceScheduler.Start()
|
||||
|
||||
// 启动自动转存调度任务
|
||||
m.autoTransferScheduler.Start()
|
||||
|
||||
utils.Info("所有调度任务已启动")
|
||||
}
|
||||
|
||||
// StopAll 停止所有调度任务
|
||||
func (m *Manager) StopAll() {
|
||||
utils.Info("停止所有调度任务")
|
||||
|
||||
// 停止热播剧调度任务
|
||||
m.hotDramaScheduler.Stop()
|
||||
|
||||
// 停止待处理资源调度任务
|
||||
m.readyResourceScheduler.Stop()
|
||||
|
||||
// 停止自动转存调度任务
|
||||
m.autoTransferScheduler.Stop()
|
||||
|
||||
utils.Info("所有调度任务已停止")
|
||||
}
|
||||
|
||||
// StartHotDramaScheduler 启动热播剧调度任务
|
||||
func (m *Manager) StartHotDramaScheduler() {
|
||||
m.hotDramaScheduler.Start()
|
||||
}
|
||||
|
||||
// StopHotDramaScheduler 停止热播剧调度任务
|
||||
func (m *Manager) StopHotDramaScheduler() {
|
||||
m.hotDramaScheduler.Stop()
|
||||
}
|
||||
|
||||
// IsHotDramaRunning 检查热播剧调度任务是否正在运行
|
||||
func (m *Manager) IsHotDramaRunning() bool {
|
||||
return m.hotDramaScheduler.IsRunning()
|
||||
}
|
||||
|
||||
// StartReadyResourceScheduler 启动待处理资源调度任务
|
||||
func (m *Manager) StartReadyResourceScheduler() {
|
||||
m.readyResourceScheduler.Start()
|
||||
}
|
||||
|
||||
// StopReadyResourceScheduler 停止待处理资源调度任务
|
||||
func (m *Manager) StopReadyResourceScheduler() {
|
||||
m.readyResourceScheduler.Stop()
|
||||
}
|
||||
|
||||
// IsReadyResourceRunning 检查待处理资源调度任务是否正在运行
|
||||
func (m *Manager) IsReadyResourceRunning() bool {
|
||||
return m.readyResourceScheduler.IsReadyResourceRunning()
|
||||
}
|
||||
|
||||
// StartAutoTransferScheduler 启动自动转存调度任务
|
||||
func (m *Manager) StartAutoTransferScheduler() {
|
||||
m.autoTransferScheduler.Start()
|
||||
}
|
||||
|
||||
// StopAutoTransferScheduler 停止自动转存调度任务
|
||||
func (m *Manager) StopAutoTransferScheduler() {
|
||||
m.autoTransferScheduler.Stop()
|
||||
}
|
||||
|
||||
// IsAutoTransferRunning 检查自动转存调度任务是否正在运行
|
||||
func (m *Manager) IsAutoTransferRunning() bool {
|
||||
return m.autoTransferScheduler.IsAutoTransferRunning()
|
||||
}
|
||||
|
||||
// GetHotDramaNames 获取热播剧名称列表
|
||||
func (m *Manager) GetHotDramaNames() ([]string, error) {
|
||||
return m.hotDramaScheduler.GetHotDramaNames()
|
||||
}
|
||||
|
||||
// GetStatus 获取所有调度任务的状态
|
||||
func (m *Manager) GetStatus() map[string]bool {
|
||||
return map[string]bool{
|
||||
"hot_drama": m.IsHotDramaRunning(),
|
||||
"ready_resource": m.IsReadyResourceRunning(),
|
||||
"auto_transfer": m.IsAutoTransferRunning(),
|
||||
}
|
||||
}
|
||||
490
scheduler/ready_resource.go
Normal file
@@ -0,0 +1,490 @@
|
||||
package scheduler
|
||||
|
||||
import (
|
||||
"fmt"
|
||||
"strings"
|
||||
"sync"
|
||||
"time"
|
||||
|
||||
panutils "github.com/ctwj/urldb/common"
|
||||
commonutils "github.com/ctwj/urldb/common/utils"
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
)
|
||||
|
||||
// ReadyResourceScheduler 待处理资源调度器
|
||||
type ReadyResourceScheduler struct {
|
||||
*BaseScheduler
|
||||
readyResourceRunning bool
|
||||
processingMutex sync.Mutex // 防止ready_resource任务重叠执行
|
||||
}
|
||||
|
||||
// NewReadyResourceScheduler 创建待处理资源调度器
|
||||
func NewReadyResourceScheduler(base *BaseScheduler) *ReadyResourceScheduler {
|
||||
return &ReadyResourceScheduler{
|
||||
BaseScheduler: base,
|
||||
readyResourceRunning: false,
|
||||
processingMutex: sync.Mutex{},
|
||||
}
|
||||
}
|
||||
|
||||
// Start 启动待处理资源定时任务
|
||||
func (r *ReadyResourceScheduler) Start() {
|
||||
if r.readyResourceRunning {
|
||||
utils.Info("待处理资源自动处理任务已在运行中")
|
||||
return
|
||||
}
|
||||
|
||||
r.readyResourceRunning = true
|
||||
utils.Info("启动待处理资源自动处理任务")
|
||||
|
||||
go func() {
|
||||
// 获取系统配置中的间隔时间
|
||||
interval := 3 * time.Minute // 默认3分钟
|
||||
if autoProcessInterval, err := r.systemConfigRepo.GetConfigInt(entity.ConfigKeyAutoProcessInterval); err == nil && autoProcessInterval > 0 {
|
||||
interval = time.Duration(autoProcessInterval) * time.Minute
|
||||
}
|
||||
|
||||
ticker := time.NewTicker(interval)
|
||||
defer ticker.Stop()
|
||||
|
||||
utils.Info(fmt.Sprintf("待处理资源自动处理任务已启动,间隔时间: %v", interval))
|
||||
|
||||
// 立即执行一次
|
||||
r.processReadyResources()
|
||||
|
||||
for {
|
||||
select {
|
||||
case <-ticker.C:
|
||||
// 使用TryLock防止任务重叠执行
|
||||
if r.processingMutex.TryLock() {
|
||||
go func() {
|
||||
defer r.processingMutex.Unlock()
|
||||
r.processReadyResources()
|
||||
}()
|
||||
} else {
|
||||
utils.Info("上一次待处理资源任务还在执行中,跳过本次执行")
|
||||
}
|
||||
case <-r.GetStopChan():
|
||||
utils.Info("停止待处理资源自动处理任务")
|
||||
return
|
||||
}
|
||||
}
|
||||
}()
|
||||
}
|
||||
|
||||
// Stop 停止待处理资源定时任务
|
||||
func (r *ReadyResourceScheduler) Stop() {
|
||||
if !r.readyResourceRunning {
|
||||
utils.Info("待处理资源自动处理任务未在运行")
|
||||
return
|
||||
}
|
||||
|
||||
r.GetStopChan() <- true
|
||||
r.readyResourceRunning = false
|
||||
utils.Info("已发送停止信号给待处理资源自动处理任务")
|
||||
}
|
||||
|
||||
// IsReadyResourceRunning 检查待处理资源任务是否正在运行
|
||||
func (r *ReadyResourceScheduler) IsReadyResourceRunning() bool {
|
||||
return r.readyResourceRunning
|
||||
}
|
||||
|
||||
// processReadyResources 处理待处理资源
|
||||
func (r *ReadyResourceScheduler) processReadyResources() {
|
||||
utils.Info("开始处理待处理资源...")
|
||||
|
||||
// 检查系统配置,确认是否启用自动处理
|
||||
autoProcess, err := r.systemConfigRepo.GetConfigBool(entity.ConfigKeyAutoProcessReadyResources)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("获取系统配置失败: %v", err))
|
||||
return
|
||||
}
|
||||
|
||||
if !autoProcess {
|
||||
utils.Info("自动处理待处理资源功能已禁用")
|
||||
return
|
||||
}
|
||||
|
||||
// 获取所有没有错误的待处理资源
|
||||
readyResources, err := r.readyResourceRepo.FindAll()
|
||||
// readyResources, err := r.readyResourceRepo.FindWithoutErrors()
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("获取待处理资源失败: %v", err))
|
||||
return
|
||||
}
|
||||
|
||||
if len(readyResources) == 0 {
|
||||
utils.Info("没有待处理的资源")
|
||||
return
|
||||
}
|
||||
|
||||
utils.Info(fmt.Sprintf("找到 %d 个待处理资源,开始处理...", len(readyResources)))
|
||||
|
||||
processedCount := 0
|
||||
factory := panutils.GetInstance() // 使用单例模式
|
||||
for _, readyResource := range readyResources {
|
||||
|
||||
//readyResource.URL 是 查重
|
||||
exits, err := r.resourceRepo.FindExists(readyResource.URL)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("查重失败: %v", err))
|
||||
continue
|
||||
}
|
||||
if exits {
|
||||
utils.Info(fmt.Sprintf("资源已存在: %s", readyResource.URL))
|
||||
r.readyResourceRepo.Delete(readyResource.ID)
|
||||
continue
|
||||
}
|
||||
|
||||
if err := r.convertReadyResourceToResource(readyResource, factory); err != nil {
|
||||
utils.Error(fmt.Sprintf("处理资源失败 (ID: %d): %v", readyResource.ID, err))
|
||||
|
||||
// 保存完整的错误信息
|
||||
readyResource.ErrorMsg = err.Error()
|
||||
|
||||
if updateErr := r.readyResourceRepo.Update(&readyResource); updateErr != nil {
|
||||
utils.Error(fmt.Sprintf("更新错误信息失败 (ID: %d): %v", readyResource.ID, updateErr))
|
||||
} else {
|
||||
utils.Info(fmt.Sprintf("已保存错误信息到资源 (ID: %d): %s", readyResource.ID, err.Error()))
|
||||
}
|
||||
|
||||
// 处理失败后删除资源,避免重复处理
|
||||
r.readyResourceRepo.Delete(readyResource.ID)
|
||||
} else {
|
||||
// 处理成功,删除readyResource
|
||||
r.readyResourceRepo.Delete(readyResource.ID)
|
||||
processedCount++
|
||||
utils.Info(fmt.Sprintf("成功处理资源: %s", readyResource.URL))
|
||||
}
|
||||
}
|
||||
|
||||
utils.Info(fmt.Sprintf("待处理资源处理完成,共处理 %d 个资源", processedCount))
|
||||
}
|
||||
|
||||
// convertReadyResourceToResource 将待处理资源转换为正式资源
|
||||
func (r *ReadyResourceScheduler) convertReadyResourceToResource(readyResource entity.ReadyResource, factory *panutils.PanFactory) error {
|
||||
utils.Debug(fmt.Sprintf("开始处理资源: %s", readyResource.URL))
|
||||
|
||||
// 提取分享ID和服务类型
|
||||
shareID, serviceType := panutils.ExtractShareId(readyResource.URL)
|
||||
if serviceType == panutils.NotFound {
|
||||
utils.Warn(fmt.Sprintf("不支持的链接地址: %s", readyResource.URL))
|
||||
return fmt.Errorf("不支持的链接地址: %s", readyResource.URL)
|
||||
}
|
||||
|
||||
utils.Debug(fmt.Sprintf("检测到服务类型: %s, 分享ID: %s", serviceType.String(), shareID))
|
||||
|
||||
resource := &entity.Resource{
|
||||
Title: derefString(readyResource.Title),
|
||||
Description: readyResource.Description,
|
||||
URL: readyResource.URL,
|
||||
Cover: readyResource.Img,
|
||||
IsValid: true,
|
||||
IsPublic: true,
|
||||
Key: readyResource.Key,
|
||||
PanID: r.getPanIDByServiceType(serviceType),
|
||||
}
|
||||
|
||||
// 检查违禁词
|
||||
forbiddenWords, err := r.systemConfigRepo.GetConfigValue(entity.ConfigKeyForbiddenWords)
|
||||
if err == nil && forbiddenWords != "" {
|
||||
words := strings.Split(forbiddenWords, ",")
|
||||
var matchedWords []string
|
||||
title := strings.ToLower(resource.Title)
|
||||
description := strings.ToLower(resource.Description)
|
||||
|
||||
for _, word := range words {
|
||||
word = strings.TrimSpace(word)
|
||||
if word != "" {
|
||||
wordLower := strings.ToLower(word)
|
||||
if strings.Contains(title, wordLower) || strings.Contains(description, wordLower) {
|
||||
matchedWords = append(matchedWords, word)
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
if len(matchedWords) > 0 {
|
||||
utils.Warn(fmt.Sprintf("资源包含违禁词: %s, 违禁词: %s", resource.Title, strings.Join(matchedWords, ", ")))
|
||||
return fmt.Errorf("存在违禁词: %s", strings.Join(matchedWords, ", "))
|
||||
}
|
||||
}
|
||||
|
||||
// 不是夸克,直接保存
|
||||
if serviceType != panutils.Quark {
|
||||
// 检测是否有效
|
||||
checkResult, err := commonutils.CheckURL(readyResource.URL)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("链接检查失败: %v", err))
|
||||
return fmt.Errorf("链接检查失败: %v", err)
|
||||
}
|
||||
if !checkResult.Status {
|
||||
utils.Warn(fmt.Sprintf("链接无效: %s", readyResource.URL))
|
||||
return fmt.Errorf("链接无效: %s", readyResource.URL)
|
||||
}
|
||||
} else {
|
||||
// 获取夸克网盘账号的 cookie
|
||||
panID := r.getPanIDByServiceType(serviceType)
|
||||
if panID == nil {
|
||||
utils.Error("未找到对应的平台ID")
|
||||
return fmt.Errorf("未找到对应的平台ID")
|
||||
}
|
||||
|
||||
accounts, err := r.cksRepo.FindByPanID(*panID)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("获取夸克网盘账号失败: %v", err))
|
||||
return fmt.Errorf("获取网盘账号失败: %v", err)
|
||||
}
|
||||
|
||||
if len(accounts) == 0 {
|
||||
utils.Error("没有可用的夸克网盘账号")
|
||||
return fmt.Errorf("没有可用的夸克网盘账号")
|
||||
}
|
||||
|
||||
// 选择第一个有效的账号
|
||||
var selectedAccount *entity.Cks
|
||||
for _, account := range accounts {
|
||||
if account.IsValid {
|
||||
selectedAccount = &account
|
||||
break
|
||||
}
|
||||
}
|
||||
|
||||
if selectedAccount == nil {
|
||||
utils.Error("没有有效的夸克网盘账号")
|
||||
return fmt.Errorf("没有有效的夸克网盘账号")
|
||||
}
|
||||
|
||||
utils.Debug(fmt.Sprintf("使用夸克网盘账号: %d, Cookie: %s", selectedAccount.ID, selectedAccount.Ck[:20]+"..."))
|
||||
|
||||
// 准备配置
|
||||
config := &panutils.PanConfig{
|
||||
URL: readyResource.URL,
|
||||
Code: "", // 可以从readyResource中获取
|
||||
IsType: 1, // 转存并分享后的资源信息 0 转存后分享, 1 只获取基本信息
|
||||
ExpiredType: 1, // 永久分享
|
||||
AdFid: "",
|
||||
Stoken: "",
|
||||
Cookie: selectedAccount.Ck, // 添加 cookie
|
||||
}
|
||||
|
||||
// 通过工厂获取对应的网盘服务单例
|
||||
panService, err := factory.CreatePanService(readyResource.URL, config)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("获取网盘服务失败: %v", err))
|
||||
return fmt.Errorf("获取网盘服务失败: %v", err)
|
||||
}
|
||||
|
||||
// 统一处理:尝试转存获取标题
|
||||
result, err := panService.Transfer(shareID)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("网盘信息获取失败: %v", err))
|
||||
return fmt.Errorf("网盘信息获取失败: %v", err)
|
||||
}
|
||||
|
||||
if !result.Success {
|
||||
utils.Error(fmt.Sprintf("网盘信息获取失败: %s", result.Message))
|
||||
return fmt.Errorf("网盘信息获取失败: %s", result.Message)
|
||||
}
|
||||
|
||||
// 从结果中提取标题等信息
|
||||
if result.Data != nil {
|
||||
if data, ok := result.Data.(map[string]interface{}); ok {
|
||||
if title, ok := data["title"].(string); ok && title != "" {
|
||||
resource.Title = title
|
||||
}
|
||||
if description, ok := data["description"].(string); ok && description != "" {
|
||||
resource.Description = description
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
// 处理分类
|
||||
if readyResource.Category != "" {
|
||||
categoryID, err := r.resolveCategory(readyResource.Category, nil)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("解析分类失败: %v", err))
|
||||
} else {
|
||||
resource.CategoryID = categoryID
|
||||
}
|
||||
}
|
||||
|
||||
// 处理标签
|
||||
if readyResource.Tags != "" {
|
||||
tagIDs, err := r.handleTags(readyResource.Tags)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("处理标签失败: %v", err))
|
||||
} else {
|
||||
// 保存资源
|
||||
err = r.resourceRepo.Create(resource)
|
||||
if err != nil {
|
||||
return fmt.Errorf("创建资源失败: %v", err)
|
||||
}
|
||||
|
||||
// 创建资源标签关联
|
||||
for _, tagID := range tagIDs {
|
||||
resourceTag := &entity.ResourceTag{
|
||||
ResourceID: resource.ID,
|
||||
TagID: tagID,
|
||||
}
|
||||
err = r.resourceRepo.CreateResourceTag(resourceTag)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("创建资源标签关联失败: %v", err))
|
||||
}
|
||||
}
|
||||
}
|
||||
} else {
|
||||
// 保存资源
|
||||
err := r.resourceRepo.Create(resource)
|
||||
if err != nil {
|
||||
return fmt.Errorf("创建资源失败: %v", err)
|
||||
}
|
||||
}
|
||||
|
||||
return nil
|
||||
}
|
||||
|
||||
// initPanCache 初始化平台缓存
|
||||
func (r *ReadyResourceScheduler) initPanCache() {
|
||||
r.panCacheOnce.Do(func() {
|
||||
// 获取所有平台数据
|
||||
pans, err := r.panRepo.FindAll()
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("初始化平台缓存失败: %v", err))
|
||||
return
|
||||
}
|
||||
|
||||
// 建立 ServiceType 到 PanID 的映射
|
||||
serviceTypeToPanName := map[string]string{
|
||||
"quark": "quark",
|
||||
"alipan": "aliyun", // 阿里云盘在数据库中的名称是 aliyun
|
||||
"baidu": "baidu",
|
||||
"uc": "uc",
|
||||
"xunlei": "xunlei",
|
||||
"tianyi": "tianyi",
|
||||
"123pan": "123pan",
|
||||
"115": "115",
|
||||
"unknown": "other",
|
||||
}
|
||||
|
||||
// 创建平台名称到ID的映射
|
||||
panNameToID := make(map[string]*uint)
|
||||
for _, pan := range pans {
|
||||
panID := pan.ID
|
||||
panNameToID[pan.Name] = &panID
|
||||
}
|
||||
|
||||
// 建立 ServiceType 到 PanID 的映射
|
||||
for serviceType, panName := range serviceTypeToPanName {
|
||||
if panID, exists := panNameToID[panName]; exists {
|
||||
r.panCache[serviceType] = panID
|
||||
utils.Info(fmt.Sprintf("平台映射缓存: %s -> %s (ID: %d)", serviceType, panName, *panID))
|
||||
} else {
|
||||
utils.Error(fmt.Sprintf("警告: 未找到平台 %s 对应的数据库记录", panName))
|
||||
}
|
||||
}
|
||||
|
||||
// 确保有默认的 other 平台
|
||||
if otherID, exists := panNameToID["other"]; exists {
|
||||
r.panCache["unknown"] = otherID
|
||||
}
|
||||
|
||||
utils.Info(fmt.Sprintf("平台映射缓存初始化完成,共 %d 个映射", len(r.panCache)))
|
||||
})
|
||||
}
|
||||
|
||||
// getPanIDByServiceType 根据服务类型获取平台ID
|
||||
func (r *ReadyResourceScheduler) getPanIDByServiceType(serviceType panutils.ServiceType) *uint {
|
||||
r.initPanCache()
|
||||
|
||||
serviceTypeStr := serviceType.String()
|
||||
if panID, exists := r.panCache[serviceTypeStr]; exists {
|
||||
return panID
|
||||
}
|
||||
|
||||
// 如果找不到,返回 other 平台的ID
|
||||
if otherID, exists := r.panCache["other"]; exists {
|
||||
utils.Error(fmt.Sprintf("未找到服务类型 %s 的映射,使用默认平台 other", serviceTypeStr))
|
||||
return otherID
|
||||
}
|
||||
|
||||
utils.Error(fmt.Sprintf("未找到服务类型 %s 的映射,且没有默认平台,返回nil", serviceTypeStr))
|
||||
return nil
|
||||
}
|
||||
|
||||
// handleTags 处理标签
|
||||
func (r *ReadyResourceScheduler) handleTags(tagStr string) ([]uint, error) {
|
||||
if tagStr == "" {
|
||||
return nil, nil
|
||||
}
|
||||
|
||||
tagNames := splitTags(tagStr)
|
||||
var tagIDs []uint
|
||||
|
||||
for _, tagName := range tagNames {
|
||||
tagName = strings.TrimSpace(tagName)
|
||||
if tagName == "" {
|
||||
continue
|
||||
}
|
||||
|
||||
// 查找或创建标签
|
||||
tag, err := r.tagRepo.FindByName(tagName)
|
||||
if err != nil {
|
||||
// 标签不存在,创建新标签
|
||||
tag = &entity.Tag{
|
||||
Name: tagName,
|
||||
}
|
||||
err = r.tagRepo.Create(tag)
|
||||
if err != nil {
|
||||
utils.Error(fmt.Sprintf("创建标签失败: %v", err))
|
||||
continue
|
||||
}
|
||||
}
|
||||
|
||||
tagIDs = append(tagIDs, tag.ID)
|
||||
}
|
||||
|
||||
return tagIDs, nil
|
||||
}
|
||||
|
||||
// resolveCategory 解析分类
|
||||
func (r *ReadyResourceScheduler) resolveCategory(categoryName string, tagIDs []uint) (*uint, error) {
|
||||
if categoryName == "" {
|
||||
return nil, nil
|
||||
}
|
||||
|
||||
// 查找分类
|
||||
category, err := r.categoryRepo.FindByName(categoryName)
|
||||
if err != nil {
|
||||
// 分类不存在,创建新分类
|
||||
category = &entity.Category{
|
||||
Name: categoryName,
|
||||
}
|
||||
err = r.categoryRepo.Create(category)
|
||||
if err != nil {
|
||||
return nil, fmt.Errorf("创建分类失败: %v", err)
|
||||
}
|
||||
}
|
||||
|
||||
return &category.ID, nil
|
||||
}
|
||||
|
||||
// splitTags 分割标签字符串
|
||||
func splitTags(tagStr string) []string {
|
||||
// 支持多种分隔符
|
||||
tagStr = strings.ReplaceAll(tagStr, ",", ",")
|
||||
tagStr = strings.ReplaceAll(tagStr, ";", ",")
|
||||
tagStr = strings.ReplaceAll(tagStr, ";", ",")
|
||||
tagStr = strings.ReplaceAll(tagStr, "、", ",")
|
||||
|
||||
return strings.Split(tagStr, ",")
|
||||
}
|
||||
|
||||
// derefString 解引用字符串指针
|
||||
func derefString(s *string) string {
|
||||
if s == nil {
|
||||
return ""
|
||||
}
|
||||
return *s
|
||||
}
|
||||
433
task/task_processor.go
Normal file
@@ -0,0 +1,433 @@
|
||||
package task
|
||||
|
||||
import (
|
||||
"context"
|
||||
"encoding/json"
|
||||
"fmt"
|
||||
"sync"
|
||||
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/ctwj/urldb/db/repo"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
)
|
||||
|
||||
// TaskProcessor 任务处理器接口
|
||||
type TaskProcessor interface {
|
||||
Process(ctx context.Context, taskID uint, item *entity.TaskItem) error
|
||||
GetTaskType() string
|
||||
}
|
||||
|
||||
// TaskManager 任务管理器
|
||||
type TaskManager struct {
|
||||
processors map[string]TaskProcessor
|
||||
repoMgr *repo.RepositoryManager
|
||||
mu sync.RWMutex
|
||||
running map[uint]context.CancelFunc // 正在运行的任务
|
||||
}
|
||||
|
||||
// NewTaskManager 创建任务管理器
|
||||
func NewTaskManager(repoMgr *repo.RepositoryManager) *TaskManager {
|
||||
return &TaskManager{
|
||||
processors: make(map[string]TaskProcessor),
|
||||
repoMgr: repoMgr,
|
||||
running: make(map[uint]context.CancelFunc),
|
||||
}
|
||||
}
|
||||
|
||||
// RegisterProcessor 注册任务处理器
|
||||
func (tm *TaskManager) RegisterProcessor(processor TaskProcessor) {
|
||||
tm.mu.Lock()
|
||||
defer tm.mu.Unlock()
|
||||
tm.processors[processor.GetTaskType()] = processor
|
||||
utils.Info("注册任务处理器: %s", processor.GetTaskType())
|
||||
}
|
||||
|
||||
// getRegisteredProcessors 获取已注册的处理器列表(用于调试)
|
||||
func (tm *TaskManager) getRegisteredProcessors() []string {
|
||||
var types []string
|
||||
for taskType := range tm.processors {
|
||||
types = append(types, taskType)
|
||||
}
|
||||
return types
|
||||
}
|
||||
|
||||
// StartTask 启动任务
|
||||
func (tm *TaskManager) StartTask(taskID uint) error {
|
||||
tm.mu.Lock()
|
||||
defer tm.mu.Unlock()
|
||||
|
||||
utils.Info("StartTask: 尝试启动任务 %d", taskID)
|
||||
|
||||
// 检查任务是否已在运行
|
||||
if _, exists := tm.running[taskID]; exists {
|
||||
utils.Info("任务 %d 已在运行中", taskID)
|
||||
return fmt.Errorf("任务 %d 已在运行中", taskID)
|
||||
}
|
||||
|
||||
// 获取任务信息
|
||||
task, err := tm.repoMgr.TaskRepository.GetByID(taskID)
|
||||
if err != nil {
|
||||
utils.Error("获取任务失败: %v", err)
|
||||
return fmt.Errorf("获取任务失败: %v", err)
|
||||
}
|
||||
|
||||
utils.Info("StartTask: 获取到任务 %d, 类型: %s, 状态: %s", task.ID, task.Type, task.Status)
|
||||
|
||||
// 获取处理器
|
||||
processor, exists := tm.processors[string(task.Type)]
|
||||
if !exists {
|
||||
utils.Error("未找到任务类型 %s 的处理器, 已注册的处理器: %v", task.Type, tm.getRegisteredProcessors())
|
||||
return fmt.Errorf("未找到任务类型 %s 的处理器", task.Type)
|
||||
}
|
||||
|
||||
utils.Info("StartTask: 找到处理器 %s", task.Type)
|
||||
|
||||
// 创建上下文
|
||||
ctx, cancel := context.WithCancel(context.Background())
|
||||
tm.running[taskID] = cancel
|
||||
|
||||
utils.Info("StartTask: 启动后台任务协程")
|
||||
// 启动后台任务
|
||||
go tm.processTask(ctx, task, processor)
|
||||
|
||||
utils.Info("StartTask: 任务 %d 启动成功", taskID)
|
||||
return nil
|
||||
}
|
||||
|
||||
// PauseTask 暂停任务
|
||||
func (tm *TaskManager) PauseTask(taskID uint) error {
|
||||
tm.mu.Lock()
|
||||
defer tm.mu.Unlock()
|
||||
|
||||
utils.Info("PauseTask: 尝试暂停任务 %d", taskID)
|
||||
|
||||
// 检查任务是否在运行
|
||||
cancel, exists := tm.running[taskID]
|
||||
if !exists {
|
||||
// 检查数据库中任务状态
|
||||
task, err := tm.repoMgr.TaskRepository.GetByID(taskID)
|
||||
if err != nil {
|
||||
utils.Error("获取任务信息失败: %v", err)
|
||||
return fmt.Errorf("获取任务信息失败: %v", err)
|
||||
}
|
||||
|
||||
// 如果数据库中的状态是running,说明服务器重启了,直接更新状态
|
||||
if task.Status == "running" {
|
||||
utils.Info("任务 %d 在数据库中状态为running,但内存中不存在,可能是服务器重启,直接更新状态为paused", taskID)
|
||||
err := tm.repoMgr.TaskRepository.UpdateStatus(taskID, "paused")
|
||||
if err != nil {
|
||||
utils.Error("更新任务状态为暂停失败: %v", err)
|
||||
return fmt.Errorf("更新任务状态失败: %v", err)
|
||||
}
|
||||
utils.Info("任务 %d 暂停成功(服务器重启恢复)", taskID)
|
||||
return nil
|
||||
}
|
||||
|
||||
utils.Info("任务 %d 未在运行,无法暂停", taskID)
|
||||
return fmt.Errorf("任务 %d 未在运行", taskID)
|
||||
}
|
||||
|
||||
// 停止任务(类似stop,但状态标记为paused)
|
||||
cancel()
|
||||
delete(tm.running, taskID)
|
||||
|
||||
// 更新任务状态为暂停
|
||||
err := tm.repoMgr.TaskRepository.UpdateStatus(taskID, "paused")
|
||||
if err != nil {
|
||||
utils.Error("更新任务状态为暂停失败: %v", err)
|
||||
return fmt.Errorf("更新任务状态失败: %v", err)
|
||||
}
|
||||
|
||||
utils.Info("任务 %d 暂停成功", taskID)
|
||||
return nil
|
||||
}
|
||||
|
||||
// StopTask 停止任务
|
||||
func (tm *TaskManager) StopTask(taskID uint) error {
|
||||
tm.mu.Lock()
|
||||
defer tm.mu.Unlock()
|
||||
|
||||
cancel, exists := tm.running[taskID]
|
||||
if !exists {
|
||||
// 检查数据库中任务状态
|
||||
task, err := tm.repoMgr.TaskRepository.GetByID(taskID)
|
||||
if err != nil {
|
||||
utils.Error("获取任务信息失败: %v", err)
|
||||
return fmt.Errorf("获取任务信息失败: %v", err)
|
||||
}
|
||||
|
||||
// 如果数据库中的状态是running,说明服务器重启了,直接更新状态
|
||||
if task.Status == "running" {
|
||||
utils.Info("任务 %d 在数据库中状态为running,但内存中不存在,可能是服务器重启,直接更新状态为paused", taskID)
|
||||
err := tm.repoMgr.TaskRepository.UpdateStatus(taskID, "paused")
|
||||
if err != nil {
|
||||
utils.Error("更新任务状态失败: %v", err)
|
||||
return fmt.Errorf("更新任务状态失败: %v", err)
|
||||
}
|
||||
utils.Info("任务 %d 停止成功(服务器重启恢复)", taskID)
|
||||
return nil
|
||||
}
|
||||
|
||||
return fmt.Errorf("任务 %d 未在运行", taskID)
|
||||
}
|
||||
|
||||
cancel()
|
||||
delete(tm.running, taskID)
|
||||
|
||||
// 更新任务状态为暂停
|
||||
err := tm.repoMgr.TaskRepository.UpdateStatus(taskID, "paused")
|
||||
if err != nil {
|
||||
utils.Error("更新任务状态失败: %v", err)
|
||||
}
|
||||
|
||||
return nil
|
||||
}
|
||||
|
||||
// processTask 处理任务
|
||||
func (tm *TaskManager) processTask(ctx context.Context, task *entity.Task, processor TaskProcessor) {
|
||||
defer func() {
|
||||
tm.mu.Lock()
|
||||
delete(tm.running, task.ID)
|
||||
tm.mu.Unlock()
|
||||
utils.Info("processTask: 任务 %d 处理完成,清理资源", task.ID)
|
||||
}()
|
||||
|
||||
utils.Info("processTask: 开始处理任务: %d, 类型: %s", task.ID, task.Type)
|
||||
|
||||
// 更新任务状态为运行中
|
||||
err := tm.repoMgr.TaskRepository.UpdateStatus(task.ID, "running")
|
||||
if err != nil {
|
||||
utils.Error("更新任务状态失败: %v", err)
|
||||
return
|
||||
}
|
||||
|
||||
// 获取任务项统计信息,用于计算正确的进度
|
||||
stats, err := tm.repoMgr.TaskItemRepository.GetStatsByTaskID(task.ID)
|
||||
if err != nil {
|
||||
utils.Error("获取任务项统计失败: %v", err)
|
||||
stats = map[string]int{
|
||||
"total": 0,
|
||||
"pending": 0,
|
||||
"processing": 0,
|
||||
"completed": 0,
|
||||
"failed": 0,
|
||||
}
|
||||
}
|
||||
|
||||
// 获取待处理的任务项
|
||||
items, err := tm.repoMgr.TaskItemRepository.GetByTaskIDAndStatus(task.ID, "pending")
|
||||
if err != nil {
|
||||
utils.Error("获取任务项失败: %v", err)
|
||||
tm.markTaskFailed(task.ID, fmt.Sprintf("获取任务项失败: %v", err))
|
||||
return
|
||||
}
|
||||
|
||||
// 计算总任务项数和已完成的项数
|
||||
totalItems := stats["total"]
|
||||
completedItems := stats["completed"]
|
||||
initialFailedItems := stats["failed"]
|
||||
processingItems := stats["processing"]
|
||||
|
||||
// 如果当前批次有处理中的任务项,重置它们为pending状态(服务器重启恢复)
|
||||
if processingItems > 0 {
|
||||
utils.Info("任务 %d 发现 %d 个处理中的任务项,重置为pending状态", task.ID, processingItems)
|
||||
err = tm.repoMgr.TaskItemRepository.ResetProcessingItems(task.ID)
|
||||
if err != nil {
|
||||
utils.Error("重置处理中任务项失败: %v", err)
|
||||
}
|
||||
// 重新获取待处理的任务项
|
||||
items, err = tm.repoMgr.TaskItemRepository.GetByTaskIDAndStatus(task.ID, "pending")
|
||||
if err != nil {
|
||||
utils.Error("重新获取任务项失败: %v", err)
|
||||
tm.markTaskFailed(task.ID, fmt.Sprintf("重新获取任务项失败: %v", err))
|
||||
return
|
||||
}
|
||||
}
|
||||
|
||||
currentBatchItems := len(items)
|
||||
processedItems := completedItems + initialFailedItems // 已经处理的项目数
|
||||
successItems := completedItems
|
||||
failedItems := initialFailedItems
|
||||
|
||||
utils.Info("任务 %d 统计信息: 总计=%d, 已完成=%d, 已失败=%d, 待处理=%d",
|
||||
task.ID, totalItems, completedItems, failedItems, currentBatchItems)
|
||||
|
||||
for _, item := range items {
|
||||
select {
|
||||
case <-ctx.Done():
|
||||
utils.Info("任务 %d 被取消", task.ID)
|
||||
return
|
||||
default:
|
||||
// 处理单个任务项
|
||||
err := tm.processTaskItem(ctx, task.ID, item, processor)
|
||||
processedItems++
|
||||
|
||||
if err != nil {
|
||||
failedItems++
|
||||
utils.Error("处理任务项 %d 失败: %v", item.ID, err)
|
||||
} else {
|
||||
successItems++
|
||||
}
|
||||
|
||||
// 更新任务进度(基于总任务项数)
|
||||
if totalItems > 0 {
|
||||
progress := float64(processedItems) / float64(totalItems) * 100
|
||||
tm.updateTaskProgress(task.ID, progress, processedItems, successItems, failedItems)
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
// 任务完成
|
||||
status := "completed"
|
||||
message := fmt.Sprintf("任务完成,共处理 %d 项,成功 %d 项,失败 %d 项", processedItems, successItems, failedItems)
|
||||
|
||||
if failedItems > 0 && successItems == 0 {
|
||||
status = "failed"
|
||||
message = fmt.Sprintf("任务失败,共处理 %d 项,全部失败", processedItems)
|
||||
} else if failedItems > 0 {
|
||||
status = "partial_success"
|
||||
message = fmt.Sprintf("任务部分成功,共处理 %d 项,成功 %d 项,失败 %d 项", processedItems, successItems, failedItems)
|
||||
}
|
||||
|
||||
err = tm.repoMgr.TaskRepository.UpdateStatusAndMessage(task.ID, status, message)
|
||||
if err != nil {
|
||||
utils.Error("更新任务状态失败: %v", err)
|
||||
}
|
||||
|
||||
utils.Info("任务 %d 处理完成: %s", task.ID, message)
|
||||
}
|
||||
|
||||
// processTaskItem 处理单个任务项
|
||||
func (tm *TaskManager) processTaskItem(ctx context.Context, taskID uint, item *entity.TaskItem, processor TaskProcessor) error {
|
||||
// 更新任务项状态为处理中
|
||||
err := tm.repoMgr.TaskItemRepository.UpdateStatus(item.ID, "processing")
|
||||
if err != nil {
|
||||
return fmt.Errorf("更新任务项状态失败: %v", err)
|
||||
}
|
||||
|
||||
// 处理任务项
|
||||
err = processor.Process(ctx, taskID, item)
|
||||
|
||||
if err != nil {
|
||||
// 处理失败
|
||||
outputData := map[string]interface{}{
|
||||
"error": err.Error(),
|
||||
"time": utils.GetCurrentTime(),
|
||||
}
|
||||
outputJSON, _ := json.Marshal(outputData)
|
||||
|
||||
updateErr := tm.repoMgr.TaskItemRepository.UpdateStatusAndOutput(item.ID, "failed", string(outputJSON))
|
||||
if updateErr != nil {
|
||||
utils.Error("更新失败任务项状态失败: %v", updateErr)
|
||||
}
|
||||
return err
|
||||
}
|
||||
|
||||
// 处理成功
|
||||
outputData := map[string]interface{}{
|
||||
"success": true,
|
||||
"time": utils.GetCurrentTime(),
|
||||
}
|
||||
outputJSON, _ := json.Marshal(outputData)
|
||||
|
||||
err = tm.repoMgr.TaskItemRepository.UpdateStatusAndOutput(item.ID, "completed", string(outputJSON))
|
||||
if err != nil {
|
||||
utils.Error("更新成功任务项状态失败: %v", err)
|
||||
}
|
||||
|
||||
return nil
|
||||
}
|
||||
|
||||
// updateTaskProgress 更新任务进度
|
||||
func (tm *TaskManager) updateTaskProgress(taskID uint, progress float64, processed, success, failed int) {
|
||||
// 更新任务统计信息
|
||||
err := tm.repoMgr.TaskRepository.UpdateTaskStats(taskID, processed, success, failed)
|
||||
if err != nil {
|
||||
utils.Error("更新任务统计信息失败: %v", err)
|
||||
}
|
||||
|
||||
// 更新进度数据(用于兼容性)
|
||||
progressData := map[string]interface{}{
|
||||
"progress": progress,
|
||||
"processed": processed,
|
||||
"success": success,
|
||||
"failed": failed,
|
||||
"time": utils.GetCurrentTime(),
|
||||
}
|
||||
|
||||
progressJSON, _ := json.Marshal(progressData)
|
||||
|
||||
err = tm.repoMgr.TaskRepository.UpdateProgress(taskID, progress, string(progressJSON))
|
||||
if err != nil {
|
||||
utils.Error("更新任务进度数据失败: %v", err)
|
||||
}
|
||||
}
|
||||
|
||||
// markTaskFailed 标记任务失败
|
||||
func (tm *TaskManager) markTaskFailed(taskID uint, message string) {
|
||||
err := tm.repoMgr.TaskRepository.UpdateStatusAndMessage(taskID, "failed", message)
|
||||
if err != nil {
|
||||
utils.Error("标记任务失败状态失败: %v", err)
|
||||
}
|
||||
}
|
||||
|
||||
// GetTaskStatus 获取任务状态
|
||||
func (tm *TaskManager) GetTaskStatus(taskID uint) (string, error) {
|
||||
task, err := tm.repoMgr.TaskRepository.GetByID(taskID)
|
||||
if err != nil {
|
||||
return "", err
|
||||
}
|
||||
return string(task.Status), nil
|
||||
}
|
||||
|
||||
// IsTaskRunning 检查任务是否在运行
|
||||
func (tm *TaskManager) IsTaskRunning(taskID uint) bool {
|
||||
tm.mu.RLock()
|
||||
defer tm.mu.RUnlock()
|
||||
_, exists := tm.running[taskID]
|
||||
return exists
|
||||
}
|
||||
|
||||
// RecoverRunningTasks 恢复运行中的任务(服务器重启后调用)
|
||||
func (tm *TaskManager) RecoverRunningTasks() error {
|
||||
tm.mu.Lock()
|
||||
defer tm.mu.Unlock()
|
||||
|
||||
utils.Info("开始恢复运行中的任务...")
|
||||
|
||||
// 获取数据库中状态为running的任务
|
||||
tasks, _, err := tm.repoMgr.TaskRepository.GetList(1, 1000, "", "running")
|
||||
if err != nil {
|
||||
utils.Error("获取运行中任务失败: %v", err)
|
||||
return fmt.Errorf("获取运行中任务失败: %v", err)
|
||||
}
|
||||
|
||||
recoveredCount := 0
|
||||
for _, task := range tasks {
|
||||
// 检查任务是否已在内存中运行
|
||||
if _, exists := tm.running[task.ID]; exists {
|
||||
utils.Info("任务 %d 已在内存中运行,跳过恢复", task.ID)
|
||||
continue
|
||||
}
|
||||
|
||||
// 获取处理器
|
||||
processor, exists := tm.processors[string(task.Type)]
|
||||
if !exists {
|
||||
utils.Error("未找到任务类型 %s 的处理器,跳过恢复任务 %d", task.Type, task.ID)
|
||||
// 将任务状态重置为pending,避免卡在running状态
|
||||
tm.repoMgr.TaskRepository.UpdateStatus(task.ID, "pending")
|
||||
continue
|
||||
}
|
||||
|
||||
// 创建上下文并恢复任务
|
||||
ctx, cancel := context.WithCancel(context.Background())
|
||||
tm.running[task.ID] = cancel
|
||||
|
||||
utils.Info("恢复任务 %d (类型: %s)", task.ID, task.Type)
|
||||
go tm.processTask(ctx, task, processor)
|
||||
recoveredCount++
|
||||
}
|
||||
|
||||
utils.Info("任务恢复完成,共恢复 %d 个任务", recoveredCount)
|
||||
return nil
|
||||
}
|
||||
513
task/transfer_processor.go
Normal file
@@ -0,0 +1,513 @@
|
||||
package task
|
||||
|
||||
import (
|
||||
"context"
|
||||
"encoding/json"
|
||||
"fmt"
|
||||
"regexp"
|
||||
"strings"
|
||||
"time"
|
||||
|
||||
pan "github.com/ctwj/urldb/common"
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/ctwj/urldb/db/repo"
|
||||
"github.com/ctwj/urldb/utils"
|
||||
)
|
||||
|
||||
// TransferProcessor 转存任务处理器
|
||||
type TransferProcessor struct {
|
||||
repoMgr *repo.RepositoryManager
|
||||
}
|
||||
|
||||
// NewTransferProcessor 创建转存任务处理器
|
||||
func NewTransferProcessor(repoMgr *repo.RepositoryManager) *TransferProcessor {
|
||||
return &TransferProcessor{
|
||||
repoMgr: repoMgr,
|
||||
}
|
||||
}
|
||||
|
||||
// GetTaskType 获取任务类型
|
||||
func (tp *TransferProcessor) GetTaskType() string {
|
||||
return "transfer"
|
||||
}
|
||||
|
||||
// TransferInput 转存任务输入数据结构
|
||||
type TransferInput struct {
|
||||
Title string `json:"title"`
|
||||
URL string `json:"url"`
|
||||
CategoryID uint `json:"category_id"`
|
||||
PanID uint `json:"pan_id"`
|
||||
Tags []uint `json:"tags"`
|
||||
}
|
||||
|
||||
// TransferOutput 转存任务输出数据结构
|
||||
type TransferOutput struct {
|
||||
ResourceID uint `json:"resource_id,omitempty"`
|
||||
SaveURL string `json:"save_url,omitempty"`
|
||||
Error string `json:"error,omitempty"`
|
||||
Success bool `json:"success"`
|
||||
Time string `json:"time"`
|
||||
}
|
||||
|
||||
// Process 处理转存任务项
|
||||
func (tp *TransferProcessor) Process(ctx context.Context, taskID uint, item *entity.TaskItem) error {
|
||||
utils.Info("开始处理转存任务项: %d", item.ID)
|
||||
|
||||
// 解析输入数据
|
||||
var input TransferInput
|
||||
if err := json.Unmarshal([]byte(item.InputData), &input); err != nil {
|
||||
return fmt.Errorf("解析输入数据失败: %v", err)
|
||||
}
|
||||
|
||||
// 验证输入数据
|
||||
if err := tp.validateInput(&input); err != nil {
|
||||
return fmt.Errorf("输入数据验证失败: %v", err)
|
||||
}
|
||||
|
||||
// 获取任务配置中的账号信息
|
||||
var selectedAccounts []uint
|
||||
task, err := tp.repoMgr.TaskRepository.GetByID(taskID)
|
||||
if err == nil && task.Config != "" {
|
||||
var taskConfig map[string]interface{}
|
||||
if err := json.Unmarshal([]byte(task.Config), &taskConfig); err == nil {
|
||||
if accounts, ok := taskConfig["selected_accounts"].([]interface{}); ok {
|
||||
for _, acc := range accounts {
|
||||
if accID, ok := acc.(float64); ok {
|
||||
selectedAccounts = append(selectedAccounts, uint(accID))
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
// 检查资源是否已存在
|
||||
exists, existingResource, err := tp.checkResourceExists(input.URL)
|
||||
if err != nil {
|
||||
utils.Error("检查资源是否存在失败: %v", err)
|
||||
}
|
||||
|
||||
if exists {
|
||||
// 检查已存在的资源是否有有效的转存链接
|
||||
if existingResource.SaveURL == "" {
|
||||
// 资源存在但没有转存链接,需要重新转存
|
||||
utils.Info("资源已存在但无转存链接,重新转存: %s", input.Title)
|
||||
} else {
|
||||
// 资源已存在且有转存链接,跳过转存
|
||||
output := TransferOutput{
|
||||
ResourceID: existingResource.ID,
|
||||
SaveURL: existingResource.SaveURL,
|
||||
Success: true,
|
||||
Time: utils.GetCurrentTimeString(),
|
||||
}
|
||||
|
||||
outputJSON, _ := json.Marshal(output)
|
||||
item.OutputData = string(outputJSON)
|
||||
|
||||
utils.Info("资源已存在且有转存链接,跳过转存: %s", input.Title)
|
||||
return nil
|
||||
}
|
||||
}
|
||||
|
||||
// 执行转存操作
|
||||
resourceID, saveURL, err := tp.performTransfer(ctx, &input, selectedAccounts)
|
||||
if err != nil {
|
||||
// 转存失败,更新输出数据
|
||||
output := TransferOutput{
|
||||
Error: err.Error(),
|
||||
Success: false,
|
||||
Time: utils.GetCurrentTimeString(),
|
||||
}
|
||||
|
||||
outputJSON, _ := json.Marshal(output)
|
||||
item.OutputData = string(outputJSON)
|
||||
|
||||
utils.Error("转存任务项处理失败: %d, 错误: %v", item.ID, err)
|
||||
return fmt.Errorf("转存失败: %v", err)
|
||||
}
|
||||
|
||||
// 验证转存结果
|
||||
if saveURL == "" {
|
||||
output := TransferOutput{
|
||||
Error: "转存成功但未获取到分享链接",
|
||||
Success: false,
|
||||
Time: utils.GetCurrentTimeString(),
|
||||
}
|
||||
|
||||
outputJSON, _ := json.Marshal(output)
|
||||
item.OutputData = string(outputJSON)
|
||||
|
||||
utils.Error("转存任务项处理失败: %d, 未获取到分享链接", item.ID)
|
||||
return fmt.Errorf("转存成功但未获取到分享链接")
|
||||
}
|
||||
|
||||
// 转存成功,更新输出数据
|
||||
output := TransferOutput{
|
||||
ResourceID: resourceID,
|
||||
SaveURL: saveURL,
|
||||
Success: true,
|
||||
Time: utils.GetCurrentTimeString(),
|
||||
}
|
||||
|
||||
outputJSON, _ := json.Marshal(output)
|
||||
item.OutputData = string(outputJSON)
|
||||
|
||||
utils.Info("转存任务项处理完成: %d, 资源ID: %d, 转存链接: %s", item.ID, resourceID, saveURL)
|
||||
return nil
|
||||
}
|
||||
|
||||
// validateInput 验证输入数据
|
||||
func (tp *TransferProcessor) validateInput(input *TransferInput) error {
|
||||
if strings.TrimSpace(input.Title) == "" {
|
||||
return fmt.Errorf("标题不能为空")
|
||||
}
|
||||
|
||||
if strings.TrimSpace(input.URL) == "" {
|
||||
return fmt.Errorf("链接不能为空")
|
||||
}
|
||||
|
||||
// 验证URL格式
|
||||
if !tp.isValidURL(input.URL) {
|
||||
return fmt.Errorf("链接格式不正确")
|
||||
}
|
||||
|
||||
return nil
|
||||
}
|
||||
|
||||
// isValidURL 验证URL格式
|
||||
func (tp *TransferProcessor) isValidURL(url string) bool {
|
||||
// 简单的URL验证,可以根据需要扩展
|
||||
quarkPattern := `https://pan\.quark\.cn/s/[a-zA-Z0-9]+`
|
||||
matched, _ := regexp.MatchString(quarkPattern, url)
|
||||
return matched
|
||||
}
|
||||
|
||||
// checkResourceExists 检查资源是否已存在
|
||||
func (tp *TransferProcessor) checkResourceExists(url string) (bool, *entity.Resource, error) {
|
||||
// 根据URL查找资源
|
||||
resource, err := tp.repoMgr.ResourceRepository.GetByURL(url)
|
||||
if err != nil {
|
||||
// 如果是未找到记录的错误,则表示资源不存在
|
||||
if strings.Contains(err.Error(), "record not found") {
|
||||
return false, nil, nil
|
||||
}
|
||||
return false, nil, err
|
||||
}
|
||||
|
||||
return true, resource, nil
|
||||
}
|
||||
|
||||
// performTransfer 执行转存操作
|
||||
func (tp *TransferProcessor) performTransfer(ctx context.Context, input *TransferInput, selectedAccounts []uint) (uint, string, error) {
|
||||
// 解析URL获取分享信息
|
||||
shareInfo, err := tp.parseShareURL(input.URL)
|
||||
if err != nil {
|
||||
return 0, "", fmt.Errorf("解析分享链接失败: %v", err)
|
||||
}
|
||||
|
||||
// 先执行转存操作
|
||||
saveURL, err := tp.transferToCloud(ctx, shareInfo, selectedAccounts)
|
||||
if err != nil {
|
||||
utils.Error("云端转存失败: %v", err)
|
||||
return 0, "", fmt.Errorf("转存失败: %v", err)
|
||||
}
|
||||
|
||||
// 验证转存链接是否有效
|
||||
if saveURL == "" {
|
||||
utils.Error("转存成功但未获取到分享链接")
|
||||
return 0, "", fmt.Errorf("转存成功但未获取到分享链接")
|
||||
}
|
||||
|
||||
// 转存成功,创建资源记录
|
||||
var categoryID *uint
|
||||
if input.CategoryID != 0 {
|
||||
categoryID = &input.CategoryID
|
||||
}
|
||||
|
||||
// 确定平台ID
|
||||
var panID uint
|
||||
if input.PanID != 0 {
|
||||
// 使用指定的平台ID
|
||||
panID = input.PanID
|
||||
utils.Info("使用指定的平台ID: %d", panID)
|
||||
} else {
|
||||
// 如果没有指定,默认使用夸克平台ID
|
||||
quarkPanID, err := tp.getQuarkPanID()
|
||||
if err != nil {
|
||||
utils.Error("获取夸克平台ID失败: %v", err)
|
||||
return 0, "", fmt.Errorf("获取夸克平台ID失败: %v", err)
|
||||
}
|
||||
panID = quarkPanID
|
||||
utils.Info("使用默认夸克平台ID: %d", panID)
|
||||
}
|
||||
|
||||
resource := &entity.Resource{
|
||||
Title: input.Title,
|
||||
URL: input.URL,
|
||||
CategoryID: categoryID,
|
||||
PanID: &panID, // 设置平台ID
|
||||
SaveURL: saveURL, // 直接设置转存链接
|
||||
CreatedAt: time.Now(),
|
||||
UpdatedAt: time.Now(),
|
||||
}
|
||||
|
||||
// 保存资源到数据库
|
||||
err = tp.repoMgr.ResourceRepository.Create(resource)
|
||||
if err != nil {
|
||||
utils.Error("保存转存成功的资源失败: %v", err)
|
||||
return 0, "", fmt.Errorf("保存资源失败: %v", err)
|
||||
}
|
||||
|
||||
// 添加标签关联
|
||||
if len(input.Tags) > 0 {
|
||||
err = tp.addResourceTags(resource.ID, input.Tags)
|
||||
if err != nil {
|
||||
utils.Error("添加资源标签失败: %v", err)
|
||||
// 标签添加失败不影响资源创建,只记录错误
|
||||
}
|
||||
}
|
||||
|
||||
utils.Info("转存成功,资源已创建 - 资源ID: %d, 转存链接: %s", resource.ID, saveURL)
|
||||
return resource.ID, saveURL, nil
|
||||
}
|
||||
|
||||
// ShareInfo 分享信息结构
|
||||
type ShareInfo struct {
|
||||
PanType string
|
||||
ShareID string
|
||||
URL string
|
||||
}
|
||||
|
||||
// parseShareURL 解析分享链接
|
||||
func (tp *TransferProcessor) parseShareURL(url string) (*ShareInfo, error) {
|
||||
// 解析夸克网盘链接
|
||||
quarkPattern := `https://pan\.quark\.cn/s/([a-zA-Z0-9]+)`
|
||||
re := regexp.MustCompile(quarkPattern)
|
||||
matches := re.FindStringSubmatch(url)
|
||||
|
||||
if len(matches) >= 2 {
|
||||
return &ShareInfo{
|
||||
PanType: "quark",
|
||||
ShareID: matches[1],
|
||||
URL: url,
|
||||
}, nil
|
||||
}
|
||||
|
||||
return nil, fmt.Errorf("不支持的分享链接格式: %s", url)
|
||||
}
|
||||
|
||||
// addResourceTags 添加资源标签
|
||||
func (tp *TransferProcessor) addResourceTags(resourceID uint, tagIDs []uint) error {
|
||||
for _, tagID := range tagIDs {
|
||||
// 创建资源标签关联
|
||||
resourceTag := &entity.ResourceTag{
|
||||
ResourceID: resourceID,
|
||||
TagID: tagID,
|
||||
}
|
||||
|
||||
err := tp.repoMgr.ResourceRepository.CreateResourceTag(resourceTag)
|
||||
if err != nil {
|
||||
return fmt.Errorf("创建资源标签关联失败: %v", err)
|
||||
}
|
||||
}
|
||||
return nil
|
||||
}
|
||||
|
||||
// transferToCloud 执行云端转存
|
||||
func (tp *TransferProcessor) transferToCloud(ctx context.Context, shareInfo *ShareInfo, selectedAccounts []uint) (string, error) {
|
||||
// 转存任务独立于自动转存开关,直接执行转存逻辑
|
||||
// 获取转存相关的配置(如最小存储空间等),但不检查自动转存开关
|
||||
|
||||
// 如果指定了账号,使用指定的账号
|
||||
if len(selectedAccounts) > 0 {
|
||||
utils.Info("使用指定的账号进行转存,账号数量: %d", len(selectedAccounts))
|
||||
|
||||
// 获取指定的账号
|
||||
var validAccounts []entity.Cks
|
||||
for _, accountID := range selectedAccounts {
|
||||
account, err := tp.repoMgr.CksRepository.FindByID(accountID)
|
||||
if err != nil {
|
||||
utils.Error("获取账号 %d 失败: %v", accountID, err)
|
||||
continue
|
||||
}
|
||||
|
||||
if !account.IsValid {
|
||||
utils.Error("账号 %d 无效", accountID)
|
||||
continue
|
||||
}
|
||||
|
||||
validAccounts = append(validAccounts, *account)
|
||||
}
|
||||
|
||||
if len(validAccounts) == 0 {
|
||||
return "", fmt.Errorf("指定的账号都无效或不存在")
|
||||
}
|
||||
|
||||
utils.Info("找到 %d 个有效账号,开始转存处理...", len(validAccounts))
|
||||
|
||||
// 使用第一个有效账号进行转存
|
||||
account := validAccounts[0]
|
||||
|
||||
// 创建网盘服务工厂
|
||||
factory := pan.NewPanFactory()
|
||||
|
||||
// 执行转存
|
||||
result := tp.transferSingleResource(shareInfo, account, factory)
|
||||
if !result.Success {
|
||||
return "", fmt.Errorf("转存失败: %s", result.ErrorMsg)
|
||||
}
|
||||
|
||||
return result.SaveURL, nil
|
||||
}
|
||||
|
||||
// 如果没有指定账号,使用原来的逻辑(自动选择)
|
||||
utils.Info("未指定账号,使用自动选择逻辑")
|
||||
|
||||
// 获取夸克平台ID
|
||||
quarkPanID, err := tp.getQuarkPanID()
|
||||
if err != nil {
|
||||
return "", fmt.Errorf("获取夸克平台ID失败: %v", err)
|
||||
}
|
||||
|
||||
// 获取可用的夸克账号
|
||||
accounts, err := tp.repoMgr.CksRepository.FindAll()
|
||||
if err != nil {
|
||||
return "", fmt.Errorf("获取网盘账号失败: %v", err)
|
||||
}
|
||||
|
||||
// 获取最小存储空间配置(转存任务需要关注此配置)
|
||||
autoTransferMinSpace, err := tp.repoMgr.SystemConfigRepository.GetConfigInt("auto_transfer_min_space")
|
||||
if err != nil {
|
||||
utils.Error("获取最小存储空间配置失败: %v", err)
|
||||
autoTransferMinSpace = 5 // 默认5GB
|
||||
}
|
||||
|
||||
// 过滤:只保留已激活、夸克平台、剩余空间足够的账号
|
||||
minSpaceBytes := int64(autoTransferMinSpace) * 1024 * 1024 * 1024
|
||||
var validAccounts []entity.Cks
|
||||
for _, acc := range accounts {
|
||||
if acc.IsValid && acc.PanID == quarkPanID && acc.LeftSpace >= minSpaceBytes {
|
||||
validAccounts = append(validAccounts, acc)
|
||||
}
|
||||
}
|
||||
|
||||
if len(validAccounts) == 0 {
|
||||
return "", fmt.Errorf("没有可用的夸克网盘账号(需要剩余空间 >= %d GB)", autoTransferMinSpace)
|
||||
}
|
||||
|
||||
utils.Info("找到 %d 个可用夸克网盘账号,开始转存处理...", len(validAccounts))
|
||||
|
||||
// 使用第一个可用账号进行转存
|
||||
account := validAccounts[0]
|
||||
|
||||
// 创建网盘服务工厂
|
||||
factory := pan.NewPanFactory()
|
||||
|
||||
// 执行转存
|
||||
result := tp.transferSingleResource(shareInfo, account, factory)
|
||||
if !result.Success {
|
||||
return "", fmt.Errorf("转存失败: %s", result.ErrorMsg)
|
||||
}
|
||||
|
||||
return result.SaveURL, nil
|
||||
}
|
||||
|
||||
// getQuarkPanID 获取夸克网盘ID
|
||||
func (tp *TransferProcessor) getQuarkPanID() (uint, error) {
|
||||
// 通过FindAll方法查找所有平台,然后过滤出quark平台
|
||||
pans, err := tp.repoMgr.PanRepository.FindAll()
|
||||
if err != nil {
|
||||
return 0, fmt.Errorf("查询平台信息失败: %v", err)
|
||||
}
|
||||
|
||||
for _, p := range pans {
|
||||
if p.Name == "quark" {
|
||||
return p.ID, nil
|
||||
}
|
||||
}
|
||||
|
||||
return 0, fmt.Errorf("未找到quark平台")
|
||||
}
|
||||
|
||||
// TransferResult 转存结果
|
||||
type TransferResult struct {
|
||||
Success bool `json:"success"`
|
||||
SaveURL string `json:"save_url"`
|
||||
ErrorMsg string `json:"error_msg"`
|
||||
}
|
||||
|
||||
// transferSingleResource 转存单个资源
|
||||
func (tp *TransferProcessor) transferSingleResource(shareInfo *ShareInfo, account entity.Cks, factory *pan.PanFactory) TransferResult {
|
||||
utils.Info("开始转存资源 - 分享ID: %s, 账号: %s", shareInfo.ShareID, account.Username)
|
||||
|
||||
service, err := factory.CreatePanService(shareInfo.URL, &pan.PanConfig{
|
||||
URL: shareInfo.URL,
|
||||
ExpiredType: 0,
|
||||
IsType: 0,
|
||||
Cookie: account.Ck,
|
||||
})
|
||||
if err != nil {
|
||||
utils.Error("创建网盘服务失败: %v", err)
|
||||
return TransferResult{
|
||||
Success: false,
|
||||
ErrorMsg: fmt.Sprintf("创建网盘服务失败: %v", err),
|
||||
}
|
||||
}
|
||||
|
||||
// 执行转存
|
||||
transferResult, err := service.Transfer(shareInfo.ShareID)
|
||||
if err != nil {
|
||||
utils.Error("转存失败: %v", err)
|
||||
return TransferResult{
|
||||
Success: false,
|
||||
ErrorMsg: fmt.Sprintf("转存失败: %v", err),
|
||||
}
|
||||
}
|
||||
|
||||
if transferResult == nil || !transferResult.Success {
|
||||
errMsg := "转存失败"
|
||||
if transferResult != nil && transferResult.Message != "" {
|
||||
errMsg = transferResult.Message
|
||||
}
|
||||
utils.Error("转存失败: %s", errMsg)
|
||||
return TransferResult{
|
||||
Success: false,
|
||||
ErrorMsg: errMsg,
|
||||
}
|
||||
}
|
||||
|
||||
// 提取转存链接
|
||||
var saveURL string
|
||||
if data, ok := transferResult.Data.(map[string]interface{}); ok {
|
||||
if v, ok := data["shareUrl"]; ok {
|
||||
saveURL, _ = v.(string)
|
||||
}
|
||||
}
|
||||
if saveURL == "" {
|
||||
saveURL = transferResult.ShareURL
|
||||
}
|
||||
|
||||
// 验证转存链接是否有效
|
||||
if saveURL == "" {
|
||||
utils.Error("转存成功但未获取到分享链接 - 分享ID: %s", shareInfo.ShareID)
|
||||
return TransferResult{
|
||||
Success: false,
|
||||
ErrorMsg: "转存成功但未获取到分享链接",
|
||||
}
|
||||
}
|
||||
|
||||
// 验证链接格式
|
||||
if !strings.HasPrefix(saveURL, "http") {
|
||||
utils.Error("转存链接格式无效 - 分享ID: %s, 链接: %s", shareInfo.ShareID, saveURL)
|
||||
return TransferResult{
|
||||
Success: false,
|
||||
ErrorMsg: "转存链接格式无效",
|
||||
}
|
||||
}
|
||||
|
||||
utils.Info("转存成功 - 分享ID: %s, 转存链接: %s", shareInfo.ShareID, saveURL)
|
||||
|
||||
return TransferResult{
|
||||
Success: true,
|
||||
SaveURL: saveURL,
|
||||
}
|
||||
}
|
||||
153
utils/errors.go
Normal file
@@ -0,0 +1,153 @@
|
||||
package utils
|
||||
|
||||
import "fmt"
|
||||
|
||||
// ErrorType 错误类型枚举
|
||||
type ErrorType string
|
||||
|
||||
const (
|
||||
// ErrorTypeUnsupportedLink 不支持的链接
|
||||
ErrorTypeUnsupportedLink ErrorType = "UNSUPPORTED_LINK"
|
||||
// ErrorTypeInvalidLink 无效链接
|
||||
ErrorTypeInvalidLink ErrorType = "INVALID_LINK"
|
||||
// ErrorTypeNoAccount 没有可用账号
|
||||
ErrorTypeNoAccount ErrorType = "NO_ACCOUNT"
|
||||
// ErrorTypeNoValidAccount 没有有效账号
|
||||
ErrorTypeNoValidAccount ErrorType = "NO_VALID_ACCOUNT"
|
||||
// ErrorTypeServiceCreation 服务创建失败
|
||||
ErrorTypeServiceCreation ErrorType = "SERVICE_CREATION_FAILED"
|
||||
// ErrorTypeTransferFailed 转存失败
|
||||
ErrorTypeTransferFailed ErrorType = "TRANSFER_FAILED"
|
||||
// ErrorTypeTagProcessing 标签处理失败
|
||||
ErrorTypeTagProcessing ErrorType = "TAG_PROCESSING_FAILED"
|
||||
// ErrorTypeCategoryProcessing 分类处理失败
|
||||
ErrorTypeCategoryProcessing ErrorType = "CATEGORY_PROCESSING_FAILED"
|
||||
// ErrorTypeResourceSave 资源保存失败
|
||||
ErrorTypeResourceSave ErrorType = "RESOURCE_SAVE_FAILED"
|
||||
// ErrorTypePlatformNotFound 平台未找到
|
||||
ErrorTypePlatformNotFound ErrorType = "PLATFORM_NOT_FOUND"
|
||||
// ErrorTypeLinkCheckFailed 链接检查失败
|
||||
ErrorTypeLinkCheckFailed ErrorType = "LINK_CHECK_FAILED"
|
||||
)
|
||||
|
||||
// ResourceError 资源处理错误
|
||||
type ResourceError struct {
|
||||
Type ErrorType `json:"type"`
|
||||
Message string `json:"message"`
|
||||
URL string `json:"url,omitempty"`
|
||||
Details string `json:"details,omitempty"`
|
||||
}
|
||||
|
||||
// Error 实现error接口
|
||||
func (e *ResourceError) Error() string {
|
||||
if e.Details != "" {
|
||||
return fmt.Sprintf("[%s] %s: %s", e.Type, e.Message, e.Details)
|
||||
}
|
||||
return fmt.Sprintf("[%s] %s", e.Type, e.Message)
|
||||
}
|
||||
|
||||
// NewResourceError 创建新的资源错误
|
||||
func NewResourceError(errorType ErrorType, message string, url string, details string) *ResourceError {
|
||||
return &ResourceError{
|
||||
Type: errorType,
|
||||
Message: message,
|
||||
URL: url,
|
||||
Details: details,
|
||||
}
|
||||
}
|
||||
|
||||
// NewUnsupportedLinkError 创建不支持的链接错误
|
||||
func NewUnsupportedLinkError(url string) *ResourceError {
|
||||
return NewResourceError(ErrorTypeUnsupportedLink, "不支持的链接地址", url, "")
|
||||
}
|
||||
|
||||
// NewInvalidLinkError 创建无效链接错误
|
||||
func NewInvalidLinkError(url string, details string) *ResourceError {
|
||||
return NewResourceError(ErrorTypeInvalidLink, "链接无效", url, details)
|
||||
}
|
||||
|
||||
// NewNoAccountError 创建没有账号错误
|
||||
func NewNoAccountError(platform string) *ResourceError {
|
||||
return NewResourceError(ErrorTypeNoAccount, "没有可用的网盘账号", "", fmt.Sprintf("平台: %s", platform))
|
||||
}
|
||||
|
||||
// NewNoValidAccountError 创建没有有效账号错误
|
||||
func NewNoValidAccountError(platform string) *ResourceError {
|
||||
return NewResourceError(ErrorTypeNoValidAccount, "没有有效的网盘账号", "", fmt.Sprintf("平台: %s", platform))
|
||||
}
|
||||
|
||||
// NewServiceCreationError 创建服务创建失败错误
|
||||
func NewServiceCreationError(url string, details string) *ResourceError {
|
||||
return NewResourceError(ErrorTypeServiceCreation, "创建网盘服务失败", url, details)
|
||||
}
|
||||
|
||||
// NewTransferFailedError 创建转存失败错误
|
||||
func NewTransferFailedError(url string, details string) *ResourceError {
|
||||
return NewResourceError(ErrorTypeTransferFailed, "网盘信息获取失败", url, details)
|
||||
}
|
||||
|
||||
// NewTagProcessingError 创建标签处理失败错误
|
||||
func NewTagProcessingError(details string) *ResourceError {
|
||||
return NewResourceError(ErrorTypeTagProcessing, "处理标签失败", "", details)
|
||||
}
|
||||
|
||||
// NewCategoryProcessingError 创建分类处理失败错误
|
||||
func NewCategoryProcessingError(details string) *ResourceError {
|
||||
return NewResourceError(ErrorTypeCategoryProcessing, "处理分类失败", "", details)
|
||||
}
|
||||
|
||||
// NewResourceSaveError 创建资源保存失败错误
|
||||
func NewResourceSaveError(url string, details string) *ResourceError {
|
||||
return NewResourceError(ErrorTypeResourceSave, "资源保存失败", url, details)
|
||||
}
|
||||
|
||||
// NewPlatformNotFoundError 创建平台未找到错误
|
||||
func NewPlatformNotFoundError(platform string) *ResourceError {
|
||||
return NewResourceError(ErrorTypePlatformNotFound, "未找到对应的平台ID", "", fmt.Sprintf("平台: %s", platform))
|
||||
}
|
||||
|
||||
// NewLinkCheckError 创建链接检查失败错误
|
||||
func NewLinkCheckError(url string, details string) *ResourceError {
|
||||
return NewResourceError(ErrorTypeLinkCheckFailed, "链接检查失败", url, details)
|
||||
}
|
||||
|
||||
// IsResourceError 检查是否为资源错误
|
||||
func IsResourceError(err error) bool {
|
||||
_, ok := err.(*ResourceError)
|
||||
return ok
|
||||
}
|
||||
|
||||
// GetResourceError 获取资源错误
|
||||
func GetResourceError(err error) *ResourceError {
|
||||
if resourceErr, ok := err.(*ResourceError); ok {
|
||||
return resourceErr
|
||||
}
|
||||
return nil
|
||||
}
|
||||
|
||||
// GetErrorType 获取错误类型
|
||||
func GetErrorType(err error) ErrorType {
|
||||
if resourceErr := GetResourceError(err); resourceErr != nil {
|
||||
return resourceErr.Type
|
||||
}
|
||||
return ""
|
||||
}
|
||||
|
||||
// IsRetryableError 检查是否为可重试的错误
|
||||
func IsRetryableError(err error) bool {
|
||||
errorType := GetErrorType(err)
|
||||
switch errorType {
|
||||
case ErrorTypeNoAccount, ErrorTypeNoValidAccount, ErrorTypeTransferFailed, ErrorTypeLinkCheckFailed:
|
||||
return true
|
||||
default:
|
||||
return false
|
||||
}
|
||||
}
|
||||
|
||||
// GetErrorSummary 获取错误摘要
|
||||
func GetErrorSummary(err error) string {
|
||||
if resourceErr := GetResourceError(err); resourceErr != nil {
|
||||
return fmt.Sprintf("%s: %s", resourceErr.Type, resourceErr.Message)
|
||||
}
|
||||
return err.Error()
|
||||
}
|
||||
@@ -1,229 +0,0 @@
|
||||
package utils
|
||||
|
||||
import (
|
||||
"sync"
|
||||
|
||||
"github.com/ctwj/urldb/db/repo"
|
||||
)
|
||||
|
||||
// GlobalScheduler 全局调度器管理器
|
||||
type GlobalScheduler struct {
|
||||
scheduler *Scheduler
|
||||
mutex sync.RWMutex
|
||||
}
|
||||
|
||||
var (
|
||||
globalScheduler *GlobalScheduler
|
||||
once sync.Once
|
||||
)
|
||||
|
||||
// GetGlobalScheduler 获取全局调度器实例(单例模式)
|
||||
func GetGlobalScheduler(hotDramaRepo repo.HotDramaRepository, readyResourceRepo repo.ReadyResourceRepository, resourceRepo repo.ResourceRepository, systemConfigRepo repo.SystemConfigRepository, panRepo repo.PanRepository, cksRepo repo.CksRepository) *GlobalScheduler {
|
||||
once.Do(func() {
|
||||
globalScheduler = &GlobalScheduler{
|
||||
scheduler: NewScheduler(hotDramaRepo, readyResourceRepo, resourceRepo, systemConfigRepo, panRepo, cksRepo),
|
||||
}
|
||||
})
|
||||
return globalScheduler
|
||||
}
|
||||
|
||||
// StartHotDramaScheduler 启动热播剧定时任务
|
||||
func (gs *GlobalScheduler) StartHotDramaScheduler() {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
if gs.scheduler.IsRunning() {
|
||||
Info("热播剧定时任务已在运行中")
|
||||
return
|
||||
}
|
||||
|
||||
gs.scheduler.StartHotDramaScheduler()
|
||||
Info("全局调度器已启动热播剧定时任务")
|
||||
}
|
||||
|
||||
// StopHotDramaScheduler 停止热播剧定时任务
|
||||
func (gs *GlobalScheduler) StopHotDramaScheduler() {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
if !gs.scheduler.IsRunning() {
|
||||
Info("热播剧定时任务未在运行")
|
||||
return
|
||||
}
|
||||
|
||||
gs.scheduler.StopHotDramaScheduler()
|
||||
Info("全局调度器已停止热播剧定时任务")
|
||||
}
|
||||
|
||||
// IsHotDramaSchedulerRunning 检查热播剧定时任务是否在运行
|
||||
func (gs *GlobalScheduler) IsHotDramaSchedulerRunning() bool {
|
||||
gs.mutex.RLock()
|
||||
defer gs.mutex.RUnlock()
|
||||
return gs.scheduler.IsRunning()
|
||||
}
|
||||
|
||||
// GetHotDramaNames 手动获取热播剧名字
|
||||
func (gs *GlobalScheduler) GetHotDramaNames() ([]string, error) {
|
||||
return gs.scheduler.GetHotDramaNames()
|
||||
}
|
||||
|
||||
// StartReadyResourceScheduler 启动待处理资源自动处理任务
|
||||
func (gs *GlobalScheduler) StartReadyResourceScheduler() {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
if gs.scheduler.IsReadyResourceRunning() {
|
||||
Info("待处理资源自动处理任务已在运行中")
|
||||
return
|
||||
}
|
||||
|
||||
gs.scheduler.StartReadyResourceScheduler()
|
||||
Info("全局调度器已启动待处理资源自动处理任务")
|
||||
}
|
||||
|
||||
// StopReadyResourceScheduler 停止待处理资源自动处理任务
|
||||
func (gs *GlobalScheduler) StopReadyResourceScheduler() {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
if !gs.scheduler.IsReadyResourceRunning() {
|
||||
Info("待处理资源自动处理任务未在运行")
|
||||
return
|
||||
}
|
||||
|
||||
gs.scheduler.StopReadyResourceScheduler()
|
||||
Info("全局调度器已停止待处理资源自动处理任务")
|
||||
}
|
||||
|
||||
// IsReadyResourceRunning 检查待处理资源自动处理任务是否在运行
|
||||
func (gs *GlobalScheduler) IsReadyResourceRunning() bool {
|
||||
gs.mutex.RLock()
|
||||
defer gs.mutex.RUnlock()
|
||||
return gs.scheduler.IsReadyResourceRunning()
|
||||
}
|
||||
|
||||
// ProcessReadyResources 手动触发待处理资源处理
|
||||
func (gs *GlobalScheduler) ProcessReadyResources() {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
gs.scheduler.processReadyResources()
|
||||
}
|
||||
|
||||
// UpdateSchedulerStatus 根据系统配置更新调度器状态
|
||||
func (gs *GlobalScheduler) UpdateSchedulerStatus(autoFetchHotDramaEnabled bool, autoProcessReadyResources bool) {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
// 处理热播剧自动拉取功能
|
||||
if autoFetchHotDramaEnabled {
|
||||
if !gs.scheduler.IsRunning() {
|
||||
Info("系统配置启用自动拉取热播剧,启动定时任务")
|
||||
gs.scheduler.StartHotDramaScheduler()
|
||||
}
|
||||
} else {
|
||||
if gs.scheduler.IsRunning() {
|
||||
Info("系统配置禁用自动拉取热播剧,停止定时任务")
|
||||
gs.scheduler.StopHotDramaScheduler()
|
||||
}
|
||||
}
|
||||
|
||||
// 处理待处理资源自动处理功能
|
||||
if autoProcessReadyResources {
|
||||
if !gs.scheduler.IsReadyResourceRunning() {
|
||||
Info("系统配置启用自动处理待处理资源,启动定时任务")
|
||||
gs.scheduler.StartReadyResourceScheduler()
|
||||
}
|
||||
} else {
|
||||
if gs.scheduler.IsReadyResourceRunning() {
|
||||
Info("系统配置禁用自动处理待处理资源,停止定时任务")
|
||||
gs.scheduler.StopReadyResourceScheduler()
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
// StartAutoTransferScheduler 启动自动转存定时任务
|
||||
func (gs *GlobalScheduler) StartAutoTransferScheduler() {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
if gs.scheduler.IsAutoTransferRunning() {
|
||||
Info("自动转存定时任务已在运行中")
|
||||
return
|
||||
}
|
||||
|
||||
gs.scheduler.StartAutoTransferScheduler()
|
||||
Info("全局调度器已启动自动转存定时任务")
|
||||
}
|
||||
|
||||
// StopAutoTransferScheduler 停止自动转存定时任务
|
||||
func (gs *GlobalScheduler) StopAutoTransferScheduler() {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
if !gs.scheduler.IsAutoTransferRunning() {
|
||||
Info("自动转存定时任务未在运行")
|
||||
return
|
||||
}
|
||||
|
||||
gs.scheduler.StopAutoTransferScheduler()
|
||||
Info("全局调度器已停止自动转存定时任务")
|
||||
}
|
||||
|
||||
// IsAutoTransferRunning 检查自动转存定时任务是否在运行
|
||||
func (gs *GlobalScheduler) IsAutoTransferRunning() bool {
|
||||
gs.mutex.RLock()
|
||||
defer gs.mutex.RUnlock()
|
||||
return gs.scheduler.IsAutoTransferRunning()
|
||||
}
|
||||
|
||||
// ProcessAutoTransfer 手动触发自动转存处理
|
||||
func (gs *GlobalScheduler) ProcessAutoTransfer() {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
gs.scheduler.processAutoTransfer()
|
||||
}
|
||||
|
||||
// UpdateSchedulerStatusWithAutoTransfer 根据系统配置更新调度器状态(包含自动转存)
|
||||
func (gs *GlobalScheduler) UpdateSchedulerStatusWithAutoTransfer(autoFetchHotDramaEnabled bool, autoProcessReadyResources bool, autoTransferEnabled bool) {
|
||||
gs.mutex.Lock()
|
||||
defer gs.mutex.Unlock()
|
||||
|
||||
// 处理热播剧自动拉取功能
|
||||
if autoFetchHotDramaEnabled {
|
||||
if !gs.scheduler.IsRunning() {
|
||||
Info("系统配置启用自动拉取热播剧,启动定时任务")
|
||||
gs.scheduler.StartHotDramaScheduler()
|
||||
}
|
||||
} else {
|
||||
if gs.scheduler.IsRunning() {
|
||||
Info("系统配置禁用自动拉取热播剧,停止定时任务")
|
||||
gs.scheduler.StopHotDramaScheduler()
|
||||
}
|
||||
}
|
||||
|
||||
// 处理待处理资源自动处理功能
|
||||
if autoProcessReadyResources {
|
||||
if !gs.scheduler.IsReadyResourceRunning() {
|
||||
Info("系统配置启用自动处理待处理资源,启动定时任务")
|
||||
gs.scheduler.StartReadyResourceScheduler()
|
||||
}
|
||||
} else {
|
||||
if gs.scheduler.IsReadyResourceRunning() {
|
||||
Info("系统配置禁用自动处理待处理资源,停止定时任务")
|
||||
gs.scheduler.StopReadyResourceScheduler()
|
||||
}
|
||||
}
|
||||
|
||||
// 处理自动转存功能
|
||||
if autoTransferEnabled {
|
||||
if !gs.scheduler.IsAutoTransferRunning() {
|
||||
Info("系统配置启用自动转存,启动定时任务")
|
||||
gs.scheduler.StartAutoTransferScheduler()
|
||||
}
|
||||
} else {
|
||||
if gs.scheduler.IsAutoTransferRunning() {
|
||||
Info("系统配置禁用自动转存,停止定时任务")
|
||||
gs.scheduler.StopAutoTransferScheduler()
|
||||
}
|
||||
}
|
||||
}
|
||||
@@ -269,7 +269,7 @@ func (lv *LogViewer) CleanOldLogs(days int) error {
|
||||
return err
|
||||
}
|
||||
|
||||
cutoffTime := time.Now().AddDate(0, 0, -days)
|
||||
cutoffTime := GetCurrentTime().AddDate(0, 0, -days)
|
||||
deletedCount := 0
|
||||
|
||||
for _, file := range files {
|
||||
|
||||
@@ -153,7 +153,7 @@ func (l *Logger) initLogFile() error {
|
||||
}
|
||||
|
||||
// 创建新的日志文件
|
||||
logFile := filepath.Join(l.config.LogDir, fmt.Sprintf("app_%s.log", time.Now().Format("2006-01-02")))
|
||||
logFile := filepath.Join(l.config.LogDir, fmt.Sprintf("app_%s.log", GetCurrentTime().Format("2006-01-02")))
|
||||
file, err := os.OpenFile(logFile, os.O_CREATE|os.O_WRONLY|os.O_APPEND, 0666)
|
||||
if err != nil {
|
||||
return fmt.Errorf("创建日志文件失败: %v", err)
|
||||
@@ -291,8 +291,8 @@ func (l *Logger) rotateLog() {
|
||||
}
|
||||
|
||||
// 重命名当前日志文件
|
||||
currentLogFile := filepath.Join(l.config.LogDir, fmt.Sprintf("app_%s.log", time.Now().Format("2006-01-02")))
|
||||
backupLogFile := filepath.Join(l.config.LogDir, fmt.Sprintf("app_%s_%s.log", time.Now().Format("2006-01-02"), time.Now().Format("15-04-05")))
|
||||
currentLogFile := filepath.Join(l.config.LogDir, fmt.Sprintf("app_%s.log", GetCurrentTime().Format("2006-01-02")))
|
||||
backupLogFile := filepath.Join(l.config.LogDir, fmt.Sprintf("app_%s_%s.log", GetCurrentTime().Format("2006-01-02"), GetCurrentTime().Format("15-04-05")))
|
||||
|
||||
if _, err := os.Stat(currentLogFile); err == nil {
|
||||
os.Rename(currentLogFile, backupLogFile)
|
||||
@@ -314,7 +314,7 @@ func (l *Logger) cleanOldLogs() {
|
||||
return
|
||||
}
|
||||
|
||||
cutoffTime := time.Now().AddDate(0, 0, -l.config.MaxAge)
|
||||
cutoffTime := GetCurrentTime().AddDate(0, 0, -l.config.MaxAge)
|
||||
|
||||
for _, file := range files {
|
||||
fileInfo, err := os.Stat(file)
|
||||
|
||||
@@ -1,802 +0,0 @@
|
||||
package utils
|
||||
|
||||
import (
|
||||
"fmt"
|
||||
"strings"
|
||||
"sync"
|
||||
"time"
|
||||
|
||||
panutils "github.com/ctwj/urldb/common"
|
||||
commonutils "github.com/ctwj/urldb/common/utils"
|
||||
"github.com/ctwj/urldb/db/entity"
|
||||
"github.com/ctwj/urldb/db/repo"
|
||||
)
|
||||
|
||||
// Scheduler 定时任务管理器
|
||||
type Scheduler struct {
|
||||
doubanService *DoubanService
|
||||
hotDramaRepo repo.HotDramaRepository
|
||||
readyResourceRepo repo.ReadyResourceRepository
|
||||
resourceRepo repo.ResourceRepository
|
||||
systemConfigRepo repo.SystemConfigRepository
|
||||
panRepo repo.PanRepository
|
||||
cksRepo repo.CksRepository
|
||||
stopChan chan bool
|
||||
isRunning bool
|
||||
readyResourceRunning bool
|
||||
autoTransferRunning bool
|
||||
processingMutex sync.Mutex // 防止ready_resource任务重叠执行
|
||||
hotDramaMutex sync.Mutex // 防止热播剧任务重叠执行
|
||||
autoTransferMutex sync.Mutex // 防止自动转存任务重叠执行
|
||||
|
||||
// 平台映射缓存
|
||||
panCache map[string]*uint // serviceType -> panID
|
||||
panCacheOnce sync.Once
|
||||
}
|
||||
|
||||
// NewScheduler 创建新的定时任务管理器
|
||||
func NewScheduler(hotDramaRepo repo.HotDramaRepository, readyResourceRepo repo.ReadyResourceRepository, resourceRepo repo.ResourceRepository, systemConfigRepo repo.SystemConfigRepository, panRepo repo.PanRepository, cksRepo repo.CksRepository) *Scheduler {
|
||||
return &Scheduler{
|
||||
doubanService: NewDoubanService(),
|
||||
hotDramaRepo: hotDramaRepo,
|
||||
readyResourceRepo: readyResourceRepo,
|
||||
resourceRepo: resourceRepo,
|
||||
systemConfigRepo: systemConfigRepo,
|
||||
panRepo: panRepo,
|
||||
cksRepo: cksRepo,
|
||||
stopChan: make(chan bool),
|
||||
isRunning: false,
|
||||
readyResourceRunning: false,
|
||||
autoTransferRunning: false,
|
||||
processingMutex: sync.Mutex{},
|
||||
hotDramaMutex: sync.Mutex{},
|
||||
autoTransferMutex: sync.Mutex{},
|
||||
panCache: make(map[string]*uint),
|
||||
}
|
||||
}
|
||||
|
||||
// StartHotDramaScheduler 启动热播剧定时任务
|
||||
func (s *Scheduler) StartHotDramaScheduler() {
|
||||
if s.isRunning {
|
||||
Info("热播剧定时任务已在运行中")
|
||||
return
|
||||
}
|
||||
|
||||
s.isRunning = true
|
||||
Info("启动热播剧定时任务")
|
||||
|
||||
go func() {
|
||||
ticker := time.NewTicker(12 * time.Hour) // 每12小时执行一次
|
||||
defer ticker.Stop()
|
||||
|
||||
// 立即执行一次
|
||||
s.fetchHotDramaData()
|
||||
|
||||
for {
|
||||
select {
|
||||
case <-ticker.C:
|
||||
// 使用TryLock防止任务重叠执行
|
||||
if s.hotDramaMutex.TryLock() {
|
||||
go func() {
|
||||
defer s.hotDramaMutex.Unlock()
|
||||
s.fetchHotDramaData()
|
||||
}()
|
||||
} else {
|
||||
Info("上一次热播剧任务还在执行中,跳过本次执行")
|
||||
}
|
||||
case <-s.stopChan:
|
||||
Info("停止热播剧定时任务")
|
||||
return
|
||||
}
|
||||
}
|
||||
}()
|
||||
}
|
||||
|
||||
// StopHotDramaScheduler 停止热播剧定时任务
|
||||
func (s *Scheduler) StopHotDramaScheduler() {
|
||||
if !s.isRunning {
|
||||
Info("热播剧定时任务未在运行")
|
||||
return
|
||||
}
|
||||
|
||||
s.stopChan <- true
|
||||
s.isRunning = false
|
||||
Info("已发送停止信号给热播剧定时任务")
|
||||
}
|
||||
|
||||
// fetchHotDramaData 获取热播剧数据
|
||||
func (s *Scheduler) fetchHotDramaData() {
|
||||
Info("开始获取热播剧数据...")
|
||||
|
||||
// 直接处理电影和电视剧数据,不再需要FetchHotDramaNames
|
||||
s.processHotDramaNames([]string{})
|
||||
}
|
||||
|
||||
// processHotDramaNames 处理热播剧名字
|
||||
func (s *Scheduler) processHotDramaNames(dramaNames []string) {
|
||||
Info("开始处理热播剧数据,共 %d 个", len(dramaNames))
|
||||
|
||||
// 收集所有数据
|
||||
var allDramas []*entity.HotDrama
|
||||
|
||||
// 获取电影数据
|
||||
movieDramas := s.processMovieData()
|
||||
allDramas = append(allDramas, movieDramas...)
|
||||
|
||||
// 获取电视剧数据
|
||||
tvDramas := s.processTvData()
|
||||
allDramas = append(allDramas, tvDramas...)
|
||||
|
||||
// 清空数据库
|
||||
Info("准备清空数据库,当前共有 %d 条数据", len(allDramas))
|
||||
if err := s.hotDramaRepo.DeleteAll(); err != nil {
|
||||
Error("清空数据库失败: %v", err)
|
||||
return
|
||||
}
|
||||
Info("数据库清空完成")
|
||||
|
||||
// 批量插入所有数据
|
||||
if len(allDramas) > 0 {
|
||||
Info("开始批量插入 %d 条数据", len(allDramas))
|
||||
if err := s.hotDramaRepo.BatchCreate(allDramas); err != nil {
|
||||
Error("批量插入数据失败: %v", err)
|
||||
} else {
|
||||
Info("成功批量插入 %d 条数据", len(allDramas))
|
||||
}
|
||||
} else {
|
||||
Info("没有数据需要插入")
|
||||
}
|
||||
|
||||
Info("热播剧数据处理完成")
|
||||
}
|
||||
|
||||
// processMovieData 处理电影数据
|
||||
func (s *Scheduler) processMovieData() []*entity.HotDrama {
|
||||
Info("开始处理电影数据...")
|
||||
|
||||
var movieDramas []*entity.HotDrama
|
||||
|
||||
// 使用GetTypePage方法获取电影数据
|
||||
movieResult, err := s.doubanService.GetTypePage("热门", "全部")
|
||||
if err != nil {
|
||||
Error("获取电影榜单失败: %v", err)
|
||||
return movieDramas
|
||||
}
|
||||
|
||||
if movieResult.Success && movieResult.Data != nil {
|
||||
Info("电影获取到 %d 个数据", len(movieResult.Data.Items))
|
||||
|
||||
for _, item := range movieResult.Data.Items {
|
||||
drama := &entity.HotDrama{
|
||||
Title: item.Title,
|
||||
CardSubtitle: item.CardSubtitle,
|
||||
EpisodesInfo: item.EpisodesInfo,
|
||||
IsNew: item.IsNew,
|
||||
Rating: item.Rating.Value,
|
||||
RatingCount: item.Rating.Count,
|
||||
Year: item.Year,
|
||||
Region: item.Region,
|
||||
Genres: strings.Join(item.Genres, ", "),
|
||||
Directors: strings.Join(item.Directors, ", "),
|
||||
Actors: strings.Join(item.Actors, ", "),
|
||||
PosterURL: item.Pic.Normal,
|
||||
Category: "电影",
|
||||
SubType: "热门",
|
||||
Source: "douban",
|
||||
DoubanID: item.ID,
|
||||
DoubanURI: item.URI,
|
||||
}
|
||||
|
||||
movieDramas = append(movieDramas, drama)
|
||||
Info("收集电影: %s (评分: %.1f, 年份: %s, 地区: %s)",
|
||||
item.Title, item.Rating.Value, item.Year, item.Region)
|
||||
}
|
||||
} else {
|
||||
Warn("电影获取数据失败或为空")
|
||||
}
|
||||
|
||||
Info("电影数据处理完成,共收集 %d 条数据", len(movieDramas))
|
||||
return movieDramas
|
||||
}
|
||||
|
||||
// processTvData 处理电视剧数据
|
||||
func (s *Scheduler) processTvData() []*entity.HotDrama {
|
||||
Info("开始处理电视剧数据...")
|
||||
|
||||
var tvDramas []*entity.HotDrama
|
||||
|
||||
// 获取所有tv类型
|
||||
tvTypes := s.doubanService.GetAllTvTypes()
|
||||
Info("获取到 %d 个tv类型: %v", len(tvTypes), tvTypes)
|
||||
|
||||
// 遍历每个type,分别请求数据
|
||||
for _, tvType := range tvTypes {
|
||||
Info("正在处理tv类型: %s", tvType)
|
||||
|
||||
// 使用GetTypePage方法请求数据
|
||||
tvResult, err := s.doubanService.GetTypePage("tv", tvType)
|
||||
if err != nil {
|
||||
Error("获取tv类型 %s 数据失败: %v", tvType, err)
|
||||
continue
|
||||
}
|
||||
|
||||
if tvResult.Success && tvResult.Data != nil {
|
||||
Info("tv类型 %s 获取到 %d 个数据", tvType, len(tvResult.Data.Items))
|
||||
|
||||
for _, item := range tvResult.Data.Items {
|
||||
drama := &entity.HotDrama{
|
||||
Title: item.Title,
|
||||
CardSubtitle: item.CardSubtitle,
|
||||
EpisodesInfo: item.EpisodesInfo,
|
||||
IsNew: item.IsNew,
|
||||
Rating: item.Rating.Value,
|
||||
RatingCount: item.Rating.Count,
|
||||
Year: item.Year,
|
||||
Region: item.Region,
|
||||
Genres: strings.Join(item.Genres, ", "),
|
||||
Directors: strings.Join(item.Directors, ", "),
|
||||
Actors: strings.Join(item.Actors, ", "),
|
||||
PosterURL: item.Pic.Normal,
|
||||
Category: "电视剧",
|
||||
SubType: tvType, // 使用具体的tv类型
|
||||
Source: "douban",
|
||||
DoubanID: item.ID,
|
||||
DoubanURI: item.URI,
|
||||
}
|
||||
|
||||
tvDramas = append(tvDramas, drama)
|
||||
Info("收集tv类型 %s: %s (评分: %.1f, 年份: %s, 地区: %s)",
|
||||
tvType, item.Title, item.Rating.Value, item.Year, item.Region)
|
||||
}
|
||||
} else {
|
||||
Warn("tv类型 %s 获取数据失败或为空", tvType)
|
||||
}
|
||||
|
||||
// 每个type请求间隔1秒,避免请求过于频繁
|
||||
time.Sleep(1 * time.Second)
|
||||
}
|
||||
|
||||
Info("电视剧数据处理完成,共收集 %d 条数据", len(tvDramas))
|
||||
return tvDramas
|
||||
}
|
||||
|
||||
// IsRunning 检查定时任务是否在运行
|
||||
func (s *Scheduler) IsRunning() bool {
|
||||
return s.isRunning
|
||||
}
|
||||
|
||||
// GetHotDramaNames 手动获取热播剧名字(用于测试或手动调用)
|
||||
func (s *Scheduler) GetHotDramaNames() ([]string, error) {
|
||||
// 由于删除了FetchHotDramaNames方法,返回空数组
|
||||
return []string{}, nil
|
||||
}
|
||||
|
||||
// StartReadyResourceScheduler 启动待处理资源自动处理任务
|
||||
func (s *Scheduler) StartReadyResourceScheduler() {
|
||||
if s.readyResourceRunning {
|
||||
Info("待处理资源自动处理任务已在运行中")
|
||||
return
|
||||
}
|
||||
|
||||
s.readyResourceRunning = true
|
||||
Info("启动待处理资源自动处理任务")
|
||||
|
||||
go func() {
|
||||
// 获取系统配置中的间隔时间
|
||||
config, err := s.systemConfigRepo.GetOrCreateDefault()
|
||||
interval := 5 * time.Minute // 默认5分钟
|
||||
if err == nil && config.AutoProcessInterval > 0 {
|
||||
interval = time.Duration(config.AutoProcessInterval) * time.Minute
|
||||
}
|
||||
|
||||
ticker := time.NewTicker(interval)
|
||||
defer ticker.Stop()
|
||||
|
||||
Info("待处理资源自动处理任务已启动,间隔时间: %v", interval)
|
||||
|
||||
// 立即执行一次
|
||||
s.processReadyResources()
|
||||
|
||||
for {
|
||||
select {
|
||||
case <-ticker.C:
|
||||
// 使用TryLock防止任务重叠执行
|
||||
if s.processingMutex.TryLock() {
|
||||
go func() {
|
||||
defer s.processingMutex.Unlock()
|
||||
s.processReadyResources()
|
||||
}()
|
||||
} else {
|
||||
Info("上一次待处理资源任务还在执行中,跳过本次执行")
|
||||
}
|
||||
case <-s.stopChan:
|
||||
Info("停止待处理资源自动处理任务")
|
||||
return
|
||||
}
|
||||
}
|
||||
}()
|
||||
}
|
||||
|
||||
// StopReadyResourceScheduler 停止待处理资源自动处理任务
|
||||
func (s *Scheduler) StopReadyResourceScheduler() {
|
||||
if !s.readyResourceRunning {
|
||||
Info("待处理资源自动处理任务未在运行")
|
||||
return
|
||||
}
|
||||
|
||||
s.stopChan <- true
|
||||
s.readyResourceRunning = false
|
||||
Info("已发送停止信号给待处理资源自动处理任务")
|
||||
}
|
||||
|
||||
// processReadyResources 处理待处理资源
|
||||
func (s *Scheduler) processReadyResources() {
|
||||
Info("开始处理待处理资源...")
|
||||
|
||||
// 检查系统配置,确认是否启用自动处理
|
||||
config, err := s.systemConfigRepo.GetOrCreateDefault()
|
||||
if err != nil {
|
||||
Error("获取系统配置失败: %v", err)
|
||||
return
|
||||
}
|
||||
|
||||
if !config.AutoProcessReadyResources {
|
||||
Info("自动处理待处理资源功能已禁用")
|
||||
return
|
||||
}
|
||||
|
||||
// 获取所有待处理资源
|
||||
readyResources, err := s.readyResourceRepo.FindAll()
|
||||
if err != nil {
|
||||
Error("获取待处理资源失败: %v", err)
|
||||
return
|
||||
}
|
||||
|
||||
if len(readyResources) == 0 {
|
||||
Info("没有待处理的资源")
|
||||
return
|
||||
}
|
||||
|
||||
Info("找到 %d 个待处理资源,开始处理...", len(readyResources))
|
||||
|
||||
processedCount := 0
|
||||
factory := panutils.GetInstance() // 使用单例模式
|
||||
for _, readyResource := range readyResources {
|
||||
|
||||
//readyResource.URL 是 查重
|
||||
exits, err := s.resourceRepo.FindExists(readyResource.URL)
|
||||
if err != nil {
|
||||
Error("查重失败: %v", err)
|
||||
continue
|
||||
}
|
||||
if exits {
|
||||
Info("资源已存在: %s", readyResource.URL)
|
||||
s.readyResourceRepo.Delete(readyResource.ID)
|
||||
continue
|
||||
}
|
||||
|
||||
if err := s.convertReadyResourceToResource(readyResource, factory); err != nil {
|
||||
Error("处理资源失败 (ID: %d): %v", readyResource.ID, err)
|
||||
}
|
||||
s.readyResourceRepo.Delete(readyResource.ID)
|
||||
processedCount++
|
||||
Info("成功处理资源: %s", readyResource.URL)
|
||||
}
|
||||
|
||||
Info("待处理资源处理完成,共处理 %d 个资源", processedCount)
|
||||
}
|
||||
|
||||
// convertReadyResourceToResource 将待处理资源转换为正式资源
|
||||
func (s *Scheduler) convertReadyResourceToResource(readyResource entity.ReadyResource, factory *panutils.PanFactory) error {
|
||||
Debug("开始处理资源: %s", readyResource.URL)
|
||||
|
||||
// 提取分享ID和服务类型
|
||||
shareID, serviceType := panutils.ExtractShareId(readyResource.URL)
|
||||
if serviceType == panutils.NotFound {
|
||||
Warn("不支持的链接地址: %s", readyResource.URL)
|
||||
return nil
|
||||
}
|
||||
|
||||
Debug("检测到服务类型: %s, 分享ID: %s", serviceType.String(), shareID)
|
||||
|
||||
// 不是夸克,直接保存,
|
||||
if serviceType != panutils.Quark {
|
||||
// 检测是否有效
|
||||
checkResult, _ := commonutils.CheckURL(readyResource.URL)
|
||||
if !checkResult.Status {
|
||||
Warn("链接无效: %s", readyResource.URL)
|
||||
return nil
|
||||
}
|
||||
|
||||
// 入库
|
||||
}
|
||||
|
||||
// 准备配置
|
||||
config := &panutils.PanConfig{
|
||||
URL: readyResource.URL,
|
||||
Code: "", // 可以从readyResource中获取
|
||||
IsType: 1, // 转存并分享后的资源信息 0 转存后分享, 1 只获取基本信息
|
||||
ExpiredType: 1, // 永久分享
|
||||
AdFid: "",
|
||||
Stoken: "",
|
||||
}
|
||||
|
||||
// 通过工厂获取对应的网盘服务单例
|
||||
panService, err := factory.CreatePanService(readyResource.URL, config)
|
||||
if err != nil {
|
||||
Error("获取网盘服务失败: %v", err)
|
||||
return err
|
||||
}
|
||||
|
||||
// 阿里云盘特殊处理:检查URL有效性
|
||||
// if serviceType == panutils.Alipan {
|
||||
// checkResult, _ := CheckURL(readyResource.URL)
|
||||
// if !checkResult.Status {
|
||||
// log.Printf("阿里云盘链接无效: %s", readyResource.URL)
|
||||
// return nil
|
||||
// }
|
||||
|
||||
// // 如果有标题,直接创建资源
|
||||
// if readyResource.Title != nil && *readyResource.Title != "" {
|
||||
// resource := &entity.Resource{
|
||||
// Title: *readyResource.Title,
|
||||
// Description: readyResource.Description,
|
||||
// URL: readyResource.URL,
|
||||
// PanID: s.determinePanID(readyResource.URL),
|
||||
// IsValid: true,
|
||||
// IsPublic: true,
|
||||
// }
|
||||
|
||||
// // 如果有分类信息,尝试查找或创建分类
|
||||
// if readyResource.Category != "" {
|
||||
// categoryID, err := s.getOrCreateCategory(readyResource.Category)
|
||||
// if err == nil {
|
||||
// resource.CategoryID = &categoryID
|
||||
// }
|
||||
// }
|
||||
|
||||
// return s.resourceRepo.Create(resource)
|
||||
// }
|
||||
// }
|
||||
|
||||
// 统一处理:尝试转存获取标题
|
||||
result, err := panService.Transfer(shareID)
|
||||
if err != nil {
|
||||
Error("网盘信息获取失败: %v", err)
|
||||
return err
|
||||
}
|
||||
|
||||
if !result.Success {
|
||||
Error("网盘信息获取失败: %s", result.Message)
|
||||
return nil
|
||||
}
|
||||
|
||||
// 提取转存结果
|
||||
if resultData, ok := result.Data.(map[string]interface{}); ok {
|
||||
title := resultData["title"].(string)
|
||||
shareURL := resultData["shareUrl"].(string)
|
||||
// fid := resultData["fid"].(string) // 暂时未使用
|
||||
|
||||
// 创建资源记录
|
||||
resource := &entity.Resource{
|
||||
Title: title,
|
||||
Description: readyResource.Description,
|
||||
URL: shareURL,
|
||||
PanID: s.getPanIDByServiceType(serviceType),
|
||||
IsValid: true,
|
||||
IsPublic: true,
|
||||
}
|
||||
|
||||
// 如果有分类信息,尝试查找或创建分类
|
||||
if readyResource.Category != "" {
|
||||
categoryID, err := s.getOrCreateCategory(readyResource.Category)
|
||||
if err == nil {
|
||||
resource.CategoryID = &categoryID
|
||||
}
|
||||
}
|
||||
|
||||
return s.resourceRepo.Create(resource)
|
||||
}
|
||||
|
||||
Error("转存结果格式异常")
|
||||
return nil
|
||||
}
|
||||
|
||||
// getOrCreateCategory 获取或创建分类
|
||||
func (s *Scheduler) getOrCreateCategory(categoryName string) (uint, error) {
|
||||
// 这里需要实现分类的查找和创建逻辑
|
||||
// 由于没有CategoryRepository的注入,这里先返回0
|
||||
// 你可以根据需要添加CategoryRepository的依赖
|
||||
return 0, nil
|
||||
}
|
||||
|
||||
// initPanCache 初始化平台映射缓存
|
||||
func (s *Scheduler) initPanCache() {
|
||||
s.panCacheOnce.Do(func() {
|
||||
// 获取所有平台数据
|
||||
pans, err := s.panRepo.FindAll()
|
||||
if err != nil {
|
||||
Error("初始化平台缓存失败: %v", err)
|
||||
return
|
||||
}
|
||||
|
||||
// 建立 ServiceType 到 PanID 的映射
|
||||
serviceTypeToPanName := map[string]string{
|
||||
"quark": "quark",
|
||||
"alipan": "aliyun", // 阿里云盘在数据库中的名称是 aliyun
|
||||
"baidu": "baidu",
|
||||
"uc": "uc",
|
||||
"unknown": "other",
|
||||
}
|
||||
|
||||
// 创建平台名称到ID的映射
|
||||
panNameToID := make(map[string]*uint)
|
||||
for _, pan := range pans {
|
||||
panID := pan.ID
|
||||
panNameToID[pan.Name] = &panID
|
||||
}
|
||||
|
||||
// 建立 ServiceType 到 PanID 的映射
|
||||
for serviceType, panName := range serviceTypeToPanName {
|
||||
if panID, exists := panNameToID[panName]; exists {
|
||||
s.panCache[serviceType] = panID
|
||||
Debug("平台映射缓存: %s -> %s (ID: %d)", serviceType, panName, *panID)
|
||||
} else {
|
||||
Warn("警告: 未找到平台 %s 对应的数据库记录", panName)
|
||||
}
|
||||
}
|
||||
|
||||
// 确保有默认的 other 平台
|
||||
if otherID, exists := panNameToID["other"]; exists {
|
||||
s.panCache["unknown"] = otherID
|
||||
}
|
||||
|
||||
Info("平台映射缓存初始化完成,共 %d 个映射", len(s.panCache))
|
||||
})
|
||||
}
|
||||
|
||||
// getPanIDByServiceType 根据服务类型获取平台ID
|
||||
func (s *Scheduler) getPanIDByServiceType(serviceType panutils.ServiceType) *uint {
|
||||
s.initPanCache()
|
||||
|
||||
serviceTypeStr := serviceType.String()
|
||||
if panID, exists := s.panCache[serviceTypeStr]; exists {
|
||||
return panID
|
||||
}
|
||||
|
||||
// 如果找不到,返回 other 平台的ID
|
||||
if otherID, exists := s.panCache["other"]; exists {
|
||||
Warn("未找到服务类型 %s 的映射,使用默认平台 other", serviceTypeStr)
|
||||
return otherID
|
||||
}
|
||||
|
||||
Warn("未找到服务类型 %s 的映射,且没有默认平台,返回nil", serviceTypeStr)
|
||||
return nil
|
||||
}
|
||||
|
||||
// IsReadyResourceRunning 检查待处理资源自动处理任务是否在运行
|
||||
func (s *Scheduler) IsReadyResourceRunning() bool {
|
||||
return s.readyResourceRunning
|
||||
}
|
||||
|
||||
// StartAutoTransferScheduler 启动自动转存定时任务
|
||||
func (s *Scheduler) StartAutoTransferScheduler() {
|
||||
if s.autoTransferRunning {
|
||||
Info("自动转存定时任务已在运行中")
|
||||
return
|
||||
}
|
||||
|
||||
s.autoTransferRunning = true
|
||||
Info("启动自动转存定时任务")
|
||||
|
||||
go func() {
|
||||
// 获取系统配置中的间隔时间
|
||||
config, err := s.systemConfigRepo.GetOrCreateDefault()
|
||||
interval := 5 * time.Minute // 默认5分钟
|
||||
if err == nil && config.AutoProcessInterval > 0 {
|
||||
interval = time.Duration(config.AutoProcessInterval) * time.Minute
|
||||
}
|
||||
|
||||
ticker := time.NewTicker(interval)
|
||||
defer ticker.Stop()
|
||||
|
||||
Info("自动转存定时任务已启动,间隔时间: %v", interval)
|
||||
|
||||
// 立即执行一次
|
||||
s.processAutoTransfer()
|
||||
|
||||
for {
|
||||
select {
|
||||
case <-ticker.C:
|
||||
// 使用TryLock防止任务重叠执行
|
||||
if s.autoTransferMutex.TryLock() {
|
||||
go func() {
|
||||
defer s.autoTransferMutex.Unlock()
|
||||
s.processAutoTransfer()
|
||||
}()
|
||||
} else {
|
||||
Info("上一次自动转存任务还在执行中,跳过本次执行")
|
||||
}
|
||||
case <-s.stopChan:
|
||||
Info("停止自动转存定时任务")
|
||||
return
|
||||
}
|
||||
}
|
||||
}()
|
||||
}
|
||||
|
||||
// StopAutoTransferScheduler 停止自动转存定时任务
|
||||
func (s *Scheduler) StopAutoTransferScheduler() {
|
||||
if !s.autoTransferRunning {
|
||||
Info("自动转存定时任务未在运行")
|
||||
return
|
||||
}
|
||||
|
||||
s.stopChan <- true
|
||||
s.autoTransferRunning = false
|
||||
Info("已发送停止信号给自动转存定时任务")
|
||||
}
|
||||
|
||||
// IsAutoTransferRunning 检查自动转存定时任务是否在运行
|
||||
func (s *Scheduler) IsAutoTransferRunning() bool {
|
||||
return s.autoTransferRunning
|
||||
}
|
||||
|
||||
// processAutoTransfer 处理自动转存
|
||||
func (s *Scheduler) processAutoTransfer() {
|
||||
Info("开始处理自动转存...")
|
||||
|
||||
// 检查系统配置,确认是否启用自动转存
|
||||
config, err := s.systemConfigRepo.GetOrCreateDefault()
|
||||
if err != nil {
|
||||
Error("获取系统配置失败: %v", err)
|
||||
return
|
||||
}
|
||||
|
||||
if !config.AutoTransferEnabled {
|
||||
Info("自动转存功能已禁用")
|
||||
return
|
||||
}
|
||||
|
||||
// 获取所有有效的网盘账号
|
||||
accounts, err := s.cksRepo.FindAll()
|
||||
if err != nil {
|
||||
Error("获取网盘账号失败: %v", err)
|
||||
return
|
||||
}
|
||||
|
||||
if len(accounts) == 0 {
|
||||
Info("没有可用的网盘账号")
|
||||
return
|
||||
}
|
||||
|
||||
Info("找到 %d 个网盘账号,开始自动转存处理...", len(accounts))
|
||||
|
||||
// 获取需要转存的资源
|
||||
resources, err := s.getResourcesForTransfer(config)
|
||||
if err != nil {
|
||||
Error("获取需要转存的资源失败: %v", err)
|
||||
return
|
||||
}
|
||||
|
||||
if len(resources) == 0 {
|
||||
Info("没有需要转存的资源")
|
||||
return
|
||||
}
|
||||
|
||||
Info("找到 %d 个需要转存的资源", len(resources))
|
||||
|
||||
// 执行自动转存
|
||||
transferCount := 0
|
||||
for _, resource := range resources {
|
||||
if err := s.transferResource(resource, accounts, config); err != nil {
|
||||
Error("转存资源失败 (ID: %d): %v", resource.ID, err)
|
||||
} else {
|
||||
transferCount++
|
||||
Info("成功转存资源: %s", resource.Title)
|
||||
}
|
||||
}
|
||||
|
||||
Info("自动转存处理完成,共转存 %d 个资源", transferCount)
|
||||
}
|
||||
|
||||
// getResourcesForTransfer 获取需要转存的资源
|
||||
func (s *Scheduler) getResourcesForTransfer(config *entity.SystemConfig) ([]*entity.Resource, error) {
|
||||
// TODO: 实现获取需要转存的资源逻辑
|
||||
// 1. 获取所有有效的资源
|
||||
// 2. 根据配置的转存限制天数过滤资源
|
||||
// 3. 排除已经转存过的资源
|
||||
// 4. 按优先级排序(可以根据浏览次数、创建时间等)
|
||||
|
||||
Info("获取需要转存的资源 - 限制天数: %d", config.AutoTransferLimitDays)
|
||||
|
||||
// 临时返回空数组,等待具体实现
|
||||
return []*entity.Resource{}, nil
|
||||
}
|
||||
|
||||
// transferResource 转存单个资源
|
||||
func (s *Scheduler) transferResource(resource *entity.Resource, accounts []entity.Cks, config *entity.SystemConfig) error {
|
||||
// TODO: 实现单个资源的转存逻辑
|
||||
// 1. 选择合适的网盘账号(根据剩余空间、VIP状态等)
|
||||
// 2. 检查账号剩余空间是否满足最小空间要求
|
||||
// 3. 调用网盘API进行转存
|
||||
// 4. 更新资源状态和转存记录
|
||||
// 5. 更新账号使用空间
|
||||
|
||||
Info("开始转存资源: %s (ID: %d)", resource.Title, resource.ID)
|
||||
|
||||
// 选择最佳账号
|
||||
selectedAccount := s.selectBestAccount(accounts, config)
|
||||
if selectedAccount == nil {
|
||||
return fmt.Errorf("没有合适的网盘账号")
|
||||
}
|
||||
|
||||
Info("选择账号: %s (剩余空间: %d GB)", selectedAccount.Username, selectedAccount.LeftSpace/1024/1024/1024)
|
||||
|
||||
// TODO: 执行实际的转存操作
|
||||
// 这里需要调用网盘API进行转存
|
||||
|
||||
return nil
|
||||
}
|
||||
|
||||
// selectBestAccount 选择最佳网盘账号
|
||||
func (s *Scheduler) selectBestAccount(accounts []entity.Cks, config *entity.SystemConfig) *entity.Cks {
|
||||
// TODO: 实现账号选择逻辑
|
||||
// 1. 过滤出有效的账号
|
||||
// 2. 检查剩余空间是否满足最小要求
|
||||
// 3. 优先选择VIP账号
|
||||
// 4. 优先选择剩余空间大的账号
|
||||
// 5. 考虑账号的使用频率(避免单个账号过度使用)
|
||||
|
||||
minSpaceBytes := int64(config.AutoTransferMinSpace) * 1024 * 1024 * 1024 // 转换为字节
|
||||
|
||||
var bestAccount *entity.Cks
|
||||
var maxScore int64 = -1
|
||||
|
||||
for _, account := range accounts {
|
||||
if !account.IsValid {
|
||||
continue
|
||||
}
|
||||
|
||||
// 检查剩余空间
|
||||
if account.LeftSpace < minSpaceBytes {
|
||||
continue
|
||||
}
|
||||
|
||||
// 计算账号评分
|
||||
score := s.calculateAccountScore(&account)
|
||||
if score > maxScore {
|
||||
maxScore = score
|
||||
bestAccount = &account
|
||||
}
|
||||
}
|
||||
|
||||
return bestAccount
|
||||
}
|
||||
|
||||
// calculateAccountScore 计算账号评分
|
||||
func (s *Scheduler) calculateAccountScore(account *entity.Cks) int64 {
|
||||
// TODO: 实现账号评分算法
|
||||
// 1. VIP账号加分
|
||||
// 2. 剩余空间大的账号加分
|
||||
// 3. 使用率低的账号加分
|
||||
// 4. 可以根据历史使用情况调整评分
|
||||
|
||||
score := int64(0)
|
||||
|
||||
// VIP账号加分
|
||||
if account.VipStatus {
|
||||
score += 1000
|
||||
}
|
||||
|
||||
// 剩余空间加分(每GB加1分)
|
||||
score += account.LeftSpace / (1024 * 1024 * 1024)
|
||||
|
||||
// 使用率加分(使用率越低分数越高)
|
||||
if account.Space > 0 {
|
||||
usageRate := float64(account.UsedSpace) / float64(account.Space)
|
||||
score += int64((1 - usageRate) * 500) // 使用率越低,加分越多
|
||||
}
|
||||
|
||||
return score
|
||||
}
|
||||
77
utils/timezone.go
Normal file
@@ -0,0 +1,77 @@
|
||||
package utils
|
||||
|
||||
import (
|
||||
"os"
|
||||
"time"
|
||||
)
|
||||
|
||||
// 时间格式常量
|
||||
const (
|
||||
TimeFormatDate = "2006-01-02"
|
||||
TimeFormatDateTime = "2006-01-02 15:04:05"
|
||||
TimeFormatRFC3339 = time.RFC3339
|
||||
)
|
||||
|
||||
// InitTimezone 初始化时区设置
|
||||
func InitTimezone() {
|
||||
// 从环境变量获取时区配置
|
||||
timezone := os.Getenv("TIMEZONE")
|
||||
if timezone == "" {
|
||||
// 默认使用上海时间
|
||||
timezone = "Asia/Shanghai"
|
||||
Info("未配置时区,使用默认时区: %s", timezone)
|
||||
} else {
|
||||
Info("使用配置的时区: %s", timezone)
|
||||
}
|
||||
|
||||
// 设置时区
|
||||
loc, err := time.LoadLocation(timezone)
|
||||
if err != nil {
|
||||
Error("加载时区失败: %v,使用系统默认时区", err)
|
||||
return
|
||||
}
|
||||
|
||||
// 设置全局时区
|
||||
time.Local = loc
|
||||
Info("时区设置成功: %s", timezone)
|
||||
}
|
||||
|
||||
// GetCurrentTime 获取当前时间(使用配置的时区)
|
||||
func GetCurrentTime() time.Time {
|
||||
return time.Now()
|
||||
}
|
||||
|
||||
// GetCurrentTimeString 获取当前时间字符串(使用配置的时区)
|
||||
func GetCurrentTimeString() string {
|
||||
return time.Now().Format(TimeFormatDateTime)
|
||||
}
|
||||
|
||||
// GetCurrentTimeRFC3339 获取当前时间RFC3339格式(使用配置的时区)
|
||||
func GetCurrentTimeRFC3339() string {
|
||||
return time.Now().Format(TimeFormatRFC3339)
|
||||
}
|
||||
|
||||
// ParseTime 解析时间字符串(使用配置的时区)
|
||||
func ParseTime(timeStr string) (time.Time, error) {
|
||||
return time.Parse(TimeFormatDateTime, timeStr)
|
||||
}
|
||||
|
||||
// FormatTime 格式化时间(使用配置的时区)
|
||||
func FormatTime(t time.Time, layout string) string {
|
||||
return t.Format(layout)
|
||||
}
|
||||
|
||||
// GetTodayString 获取今日日期字符串
|
||||
func GetTodayString() string {
|
||||
return time.Now().Format(TimeFormatDate)
|
||||
}
|
||||
|
||||
// GetCurrentTimestamp 获取当前时间戳
|
||||
func GetCurrentTimestamp() int64 {
|
||||
return time.Now().Unix()
|
||||
}
|
||||
|
||||
// GetCurrentTimestampNano 获取当前纳秒时间戳
|
||||
func GetCurrentTimestampNano() int64 {
|
||||
return time.Now().UnixNano()
|
||||
}
|
||||
@@ -24,7 +24,7 @@ type VersionInfo struct {
|
||||
// 编译时注入的版本信息
|
||||
var (
|
||||
Version = getVersionFromFile()
|
||||
BuildTime = time.Now().Format("2006-01-02 15:04:05")
|
||||
BuildTime = GetCurrentTimeString()
|
||||
GitCommit = "unknown"
|
||||
GitBranch = "unknown"
|
||||
)
|
||||
@@ -40,7 +40,7 @@ func getVersionFromFile() string {
|
||||
|
||||
// GetVersionInfo 获取版本信息
|
||||
func GetVersionInfo() *VersionInfo {
|
||||
buildTime, _ := time.Parse("2006-01-02 15:04:05", BuildTime)
|
||||
buildTime, _ := ParseTime(BuildTime)
|
||||
|
||||
return &VersionInfo{
|
||||
Version: Version,
|
||||
@@ -72,7 +72,7 @@ func GetFullVersionInfo() string {
|
||||
Node版本: %s
|
||||
平台: %s/%s`,
|
||||
info.Version,
|
||||
info.BuildTime.Format("2006-01-02 15:04:05"),
|
||||
FormatTime(info.BuildTime, TimeFormatDateTime),
|
||||
info.GitCommit,
|
||||
info.GitBranch,
|
||||
info.GoVersion,
|
||||
|
||||
2
web/.env
Normal file
@@ -0,0 +1,2 @@
|
||||
NUXT_PUBLIC_API_CLIENT=http://localhost:8080/api
|
||||
NUXT_PUBLIC_API_SERVER=http://localhost:8080/api
|
||||
BIN
web/assets/images/3dian.png
Normal file
|
After Width: | Height: | Size: 481 B |
BIN
web/assets/images/android.png
Normal file
|
After Width: | Height: | Size: 4.7 KiB |
BIN
web/assets/images/banner.png
Normal file
|
After Width: | Height: | Size: 31 KiB |
BIN
web/assets/images/banner.webp
Normal file
|
After Width: | Height: | Size: 21 KiB |
BIN
web/assets/images/footer-banner.webp
Normal file
|
After Width: | Height: | Size: 2.4 KiB |
BIN
web/assets/images/iphone.png
Normal file
|
After Width: | Height: | Size: 3.5 KiB |
29
web/components.d.ts
vendored
@@ -10,13 +10,38 @@ declare module 'vue' {
|
||||
export interface GlobalComponents {
|
||||
NA: typeof import('naive-ui')['NA']
|
||||
NAlert: typeof import('naive-ui')['NAlert']
|
||||
NAvatar: typeof import('naive-ui')['NAvatar']
|
||||
NButton: typeof import('naive-ui')['NButton']
|
||||
NIcon: typeof import('naive-ui')['NIcon']
|
||||
NButtonGroup: typeof import('naive-ui')['NButtonGroup']
|
||||
NCard: typeof import('naive-ui')['NCard']
|
||||
NCheckbox: typeof import('naive-ui')['NCheckbox']
|
||||
NDataTable: typeof import('naive-ui')['NDataTable']
|
||||
NDatePicker: typeof import('naive-ui')['NDatePicker']
|
||||
NDescriptions: typeof import('naive-ui')['NDescriptions']
|
||||
NDescriptionsItem: typeof import('naive-ui')['NDescriptionsItem']
|
||||
NDialogProvider: typeof import('naive-ui')['NDialogProvider']
|
||||
NEmpty: typeof import('naive-ui')['NEmpty']
|
||||
NForm: typeof import('naive-ui')['NForm']
|
||||
NFormItem: typeof import('naive-ui')['NFormItem']
|
||||
NInput: typeof import('naive-ui')['NInput']
|
||||
NInputGroup: typeof import('naive-ui')['NInputGroup']
|
||||
NInputNumber: typeof import('naive-ui')['NInputNumber']
|
||||
NList: typeof import('naive-ui')['NList']
|
||||
NListItem: typeof import('naive-ui')['NListItem']
|
||||
NMessageProvider: typeof import('naive-ui')['NMessageProvider']
|
||||
NModal: typeof import('naive-ui')['NModal']
|
||||
NNotificationProvider: typeof import('naive-ui')['NNotificationProvider']
|
||||
NPagination: typeof import('naive-ui')['NPagination']
|
||||
NProgress: typeof import('naive-ui')['NProgress']
|
||||
NSelect: typeof import('naive-ui')['NSelect']
|
||||
NSpace: typeof import('naive-ui')['NSpace']
|
||||
NSpin: typeof import('naive-ui')['NSpin']
|
||||
NSwitch: typeof import('naive-ui')['NSwitch']
|
||||
NTabPane: typeof import('naive-ui')['NTabPane']
|
||||
NTabs: typeof import('naive-ui')['NTabs']
|
||||
NTag: typeof import('naive-ui')['NTag']
|
||||
NText: typeof import('naive-ui')['NText']
|
||||
NThing: typeof import('naive-ui')['NThing']
|
||||
NVirtualList: typeof import('naive-ui')['NVirtualList']
|
||||
RouterLink: typeof import('vue-router')['RouterLink']
|
||||
RouterView: typeof import('vue-router')['RouterView']
|
||||
}
|
||||
|
||||
@@ -4,10 +4,11 @@
|
||||
<div class="mb-4 flex-1 w-1">
|
||||
<label class="block text-sm font-medium text-gray-700 dark:text-gray-300 mb-2">输入格式说明:</label>
|
||||
<div class="bg-gray-50 dark:bg-gray-800 p-3 rounded text-sm text-gray-600 dark:text-gray-300 mb-4">
|
||||
<p class="mb-2"><strong>格式要求:</strong>标题和URL两行为一组,标题为必填项</p>
|
||||
<p class="mb-2"><strong>格式要求:</strong>标题和URL为一组,标题必填, 同一标题URL支持多行</p>
|
||||
<pre class="bg-white dark:bg-gray-800 p-2 rounded border text-xs">
|
||||
电影标题1
|
||||
电影1
|
||||
https://pan.baidu.com/s/123456
|
||||
https://pan.quark.com/s/123456
|
||||
电影标题2
|
||||
https://pan.baidu.com/s/789012
|
||||
电视剧标题3
|
||||
@@ -20,9 +21,9 @@ https://pan.quark.cn/s/345678</pre>
|
||||
</div>
|
||||
<div class="mb-4 flex-1 w-1">
|
||||
<label class="block text-sm font-medium text-gray-700 dark:text-gray-300 mb-2">资源内容:</label>
|
||||
<textarea v-model="batchInput" rows="15"
|
||||
class="w-full px-3 py-2 border border-gray-300 dark:border-gray-700 rounded-md focus:outline-none focus:ring-2 focus:ring-blue-500 focus:border-blue-500 dark:bg-gray-900 dark:text-gray-100"
|
||||
placeholder="请输入资源内容,格式:标题和URL两行为一组..."></textarea>
|
||||
<n-input v-model:value="batchInput" type="textarea"
|
||||
:autosize="{ minRows: 10, maxRows: 15 }"
|
||||
placeholder="请输入资源内容,格式:标题和URL为一组..." />
|
||||
</div>
|
||||
</div>
|
||||
|
||||
@@ -44,6 +45,7 @@ const emit = defineEmits(['success', 'error', 'cancel'])
|
||||
|
||||
const loading = ref(false)
|
||||
const batchInput = ref('')
|
||||
const notification = useNotification()
|
||||
|
||||
const readyResourceApi = useReadyResourceApi()
|
||||
|
||||
@@ -59,30 +61,15 @@ const validateInput = () => {
|
||||
throw new Error('请输入有效的资源内容')
|
||||
}
|
||||
|
||||
// 检查是否为偶数行(标题+URL为一组)
|
||||
if (lines.length % 2 !== 0) {
|
||||
throw new Error('资源格式错误:标题和URL必须成对出现,请检查是否缺少标题或URL')
|
||||
}
|
||||
|
||||
// 检查每组的标题是否为空
|
||||
for (let i = 0; i < lines.length; i += 2) {
|
||||
const title = lines[i]
|
||||
const url = lines[i + 1]
|
||||
|
||||
if (!title) {
|
||||
throw new Error(`第${i + 1}行标题不能为空`)
|
||||
}
|
||||
|
||||
if (!url) {
|
||||
throw new Error(`第${i + 2}行URL不能为空`)
|
||||
}
|
||||
|
||||
// 验证URL格式
|
||||
try {
|
||||
new URL(url)
|
||||
} catch {
|
||||
throw new Error(`第${i + 2}行URL格式无效: ${url}`)
|
||||
}
|
||||
// 首行必须为标题
|
||||
if (/^https?:\/\//i.test(lines[0])) {
|
||||
// 你可以用 alert、ElMessage 或其它方式提示
|
||||
notification.error({
|
||||
title: '失败',
|
||||
content: '首行必须为标题,不能为链接!',
|
||||
duration: 3000
|
||||
})
|
||||
return
|
||||
}
|
||||
}
|
||||
|
||||
@@ -96,14 +83,30 @@ const handleSubmit = async () => {
|
||||
const lines = batchInput.value.split(/\r?\n/).map(line => line.trim()).filter(Boolean)
|
||||
const resources = []
|
||||
|
||||
for (let i = 0; i < lines.length; i += 2) {
|
||||
const title = lines[i]
|
||||
const url = lines[i + 1]
|
||||
let currentTitle = ''
|
||||
let currentUrls = []
|
||||
|
||||
for (const line of lines) {
|
||||
// 判断是否为 url(以 http/https 开头)
|
||||
if (/^https?:\/\//i.test(line)) {
|
||||
currentUrls.push(line)
|
||||
} else {
|
||||
// 新标题,先保存上一个
|
||||
if (currentTitle && currentUrls.length) {
|
||||
resources.push({
|
||||
title: currentTitle,
|
||||
url: currentUrls.slice()
|
||||
})
|
||||
}
|
||||
currentTitle = line
|
||||
currentUrls = []
|
||||
}
|
||||
}
|
||||
// 处理最后一组
|
||||
if (currentTitle && currentUrls.length) {
|
||||
resources.push({
|
||||
title: title,
|
||||
url: url,
|
||||
source: '批量添加'
|
||||
title: currentTitle,
|
||||
url: currentUrls.slice()
|
||||
})
|
||||
}
|
||||
|
||||
@@ -1,5 +1,5 @@
|
||||
<template>
|
||||
<div class="bg-slate-800 dark:bg-gray-800 text-white dark:text-gray-100 rounded-lg shadow-lg p-4 sm:p-8 text-center relative">
|
||||
<div class="header-container bg-slate-800 dark:bg-gray-800 text-white dark:text-gray-100 rounded-lg shadow-lg p-4 sm:p-8 text-center relative">
|
||||
<!-- 页面标题和面包屑 -->
|
||||
<div class="mb-4">
|
||||
<h1 class="text-2xl sm:text-3xl font-bold mb-2">
|
||||
@@ -18,10 +18,6 @@
|
||||
{{ currentPageTitle }}
|
||||
</span>
|
||||
</div>
|
||||
<!-- 页面描述 -->
|
||||
<!-- <div v-if="currentPageDescription && currentPageTitle !== '管理后台'" class="text-xs text-white/60 mt-1">
|
||||
{{ currentPageDescription }}
|
||||
</div> -->
|
||||
</div>
|
||||
|
||||
<div class="absolute left-4 top-4 flex items-center gap-2">
|
||||
@@ -37,7 +33,7 @@
|
||||
<!-- 用户信息 -->
|
||||
<div v-if="userStore.isAuthenticated" class="hidden sm:flex items-center gap-2">
|
||||
<span class="text-sm text-white/80">欢迎,{{ userStore.user?.username || '管理员' }}</span>
|
||||
<span class="px-2 py-1 bg-blue-600/80 rounded text-xs text-white">{{ userStore.user?.role || 'admin' }}</span>
|
||||
<n-tag type="success" size="small" round>{{ userStore.user?.role || '-' }}</n-tag>
|
||||
</div>
|
||||
|
||||
<!-- 操作按钮 -->
|
||||
@@ -116,6 +112,7 @@ const pageConfig = computed(() => {
|
||||
'/admin/users': { title: '用户管理', icon: 'fas fa-users', description: '管理系统用户' },
|
||||
'/admin/categories': { title: '分类管理', icon: 'fas fa-folder', description: '管理资源分类' },
|
||||
'/admin/tags': { title: '标签管理', icon: 'fas fa-tags', description: '管理资源标签' },
|
||||
'/admin/tasks': { title: '任务管理', icon: 'fas fa-tasks', description: '管理系统任务' },
|
||||
'/admin/system-config': { title: '系统配置', icon: 'fas fa-cog', description: '系统参数设置' },
|
||||
'/admin/resources': { title: '资源管理', icon: 'fas fa-database', description: '管理网盘资源' },
|
||||
'/admin/cks': { title: '平台账号管理', icon: 'fas fa-key', description: '管理第三方平台账号' },
|
||||
@@ -125,7 +122,8 @@ const pageConfig = computed(() => {
|
||||
'/monitor': { title: '系统监控', icon: 'fas fa-desktop', description: '系统性能监控' },
|
||||
'/admin/add-resource': { title: '添加资源', icon: 'fas fa-plus', description: '添加新资源' },
|
||||
'/api-docs': { title: 'API文档', icon: 'fas fa-book', description: '接口文档说明' },
|
||||
'/admin/version': { title: '版本信息', icon: 'fas fa-code-branch', description: '系统版本详情' }
|
||||
'/admin/version': { title: '版本信息', icon: 'fas fa-code-branch', description: '系统版本详情' },
|
||||
'/admin/failed-resources': { title: '错误资源', icon: 'fas fa-code-branch', description: '错误资源' }
|
||||
}
|
||||
return configs[route.path] || { title: props.title, icon: 'fas fa-cog', description: '管理页面' }
|
||||
})
|
||||
@@ -138,7 +136,7 @@ const systemConfigStore = useSystemConfigStore()
|
||||
const systemConfig = computed(() => systemConfigStore.config)
|
||||
|
||||
onMounted(() => {
|
||||
systemConfigStore.initConfig()
|
||||
systemConfigStore.initConfig(false, true)
|
||||
})
|
||||
|
||||
// 退出登录
|
||||
@@ -150,4 +148,12 @@ const logout = async () => {
|
||||
|
||||
<style scoped>
|
||||
/* 确保样式与首页完全一致 */
|
||||
.header-container {
|
||||
background: url(/assets/images/banner.webp) center top/cover no-repeat,
|
||||
linear-gradient(
|
||||
to bottom,
|
||||
rgba(0,0,0,0.1) 0%,
|
||||
rgba(0,0,0,0.25) 100%
|
||||
);
|
||||
}
|
||||
</style>
|
||||
572
web/components/Admin/ManualBatchTransfer.vue
Normal file
@@ -0,0 +1,572 @@
|
||||
<template>
|
||||
<div class="space-y-6">
|
||||
|
||||
<!-- 输入区域 -->
|
||||
<n-card title="批量转存资源列表">
|
||||
<div class="grid grid-cols-1 md:grid-cols-2 gap-6">
|
||||
<!-- 左侧:资源输入 -->
|
||||
<div class="space-y-4">
|
||||
<div>
|
||||
<label class="block text-sm font-medium text-gray-700 dark:text-gray-300 mb-2">
|
||||
资源内容 <span class="text-red-500">*</span>
|
||||
</label>
|
||||
<n-input
|
||||
v-model:value="resourceText"
|
||||
type="textarea"
|
||||
placeholder="请输入资源内容,格式:标题和URL为一组..."
|
||||
:autosize="{ minRows: 10, maxRows: 15 }"
|
||||
show-count
|
||||
:maxlength="100000"
|
||||
/>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- 右侧:配置选项 -->
|
||||
<div class="space-y-4">
|
||||
<div>
|
||||
<label class="block text-sm font-medium text-gray-700 dark:text-gray-300 mb-2">
|
||||
默认分类
|
||||
</label>
|
||||
<CategorySelector
|
||||
v-model="selectedCategory"
|
||||
placeholder="选择分类"
|
||||
clearable
|
||||
/>
|
||||
</div>
|
||||
|
||||
<div>
|
||||
<label class="block text-sm font-medium text-gray-700 dark:text-gray-300 mb-2">
|
||||
标签
|
||||
</label>
|
||||
<TagSelector
|
||||
v-model="selectedTags"
|
||||
placeholder="选择标签"
|
||||
multiple
|
||||
clearable
|
||||
/>
|
||||
</div>
|
||||
|
||||
<div>
|
||||
<label class="block text-sm font-medium text-gray-700 dark:text-gray-300 mb-2">
|
||||
网盘账号 <span class="text-red-500">*</span>
|
||||
</label>
|
||||
<n-select
|
||||
v-model:value="selectedAccounts"
|
||||
:options="accountOptions"
|
||||
placeholder="选择网盘账号"
|
||||
multiple
|
||||
filterable
|
||||
:loading="accountsLoading"
|
||||
@update:value="handleAccountChange"
|
||||
>
|
||||
<template #option="{ option: accountOption }">
|
||||
<div class="flex items-center justify-between w-full">
|
||||
<div class="flex items-center space-x-2">
|
||||
<span class="text-sm">{{ accountOption.label }}</span>
|
||||
<n-tag v-if="accountOption.is_valid" type="success" size="small">有效</n-tag>
|
||||
<n-tag v-else type="error" size="small">无效</n-tag>
|
||||
</div>
|
||||
<div class="text-xs text-gray-500">
|
||||
{{ formatSpace(accountOption.left_space) }}
|
||||
</div>
|
||||
</div>
|
||||
</template>
|
||||
</n-select>
|
||||
<div class="text-xs text-gray-500 mt-1">
|
||||
请选择要使用的网盘账号,系统将使用选中的账号进行转存操作
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- 操作按钮 -->
|
||||
<div class="space-y-3 pt-4">
|
||||
<n-button
|
||||
type="primary"
|
||||
block
|
||||
size="large"
|
||||
:loading="processing"
|
||||
:disabled="!resourceText.trim() || !selectedAccounts.length || processing"
|
||||
@click="handleBatchTransfer"
|
||||
>
|
||||
<template #icon>
|
||||
<i class="fas fa-upload"></i>
|
||||
</template>
|
||||
开始批量转存
|
||||
</n-button>
|
||||
|
||||
<n-button
|
||||
block
|
||||
@click="clearInput"
|
||||
:disabled="processing"
|
||||
>
|
||||
<template #icon>
|
||||
<i class="fas fa-trash"></i>
|
||||
</template>
|
||||
清空内容
|
||||
</n-button>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</n-card>
|
||||
|
||||
<!-- 处理结果 -->
|
||||
<n-card v-if="results.length > 0" title="转存结果">
|
||||
<div class="space-y-4">
|
||||
<!-- 结果统计 -->
|
||||
<div class="grid grid-cols-4 gap-4">
|
||||
<div class="text-center p-3 bg-blue-50 dark:bg-blue-900/20 rounded-lg">
|
||||
<div class="text-xl font-bold text-blue-600">{{ results.length }}</div>
|
||||
<div class="text-sm text-gray-600 dark:text-gray-400">总处理数</div>
|
||||
</div>
|
||||
<div class="text-center p-3 bg-green-50 dark:bg-green-900/20 rounded-lg">
|
||||
<div class="text-xl font-bold text-green-600">{{ successCount }}</div>
|
||||
<div class="text-sm text-gray-600 dark:text-gray-400">成功</div>
|
||||
</div>
|
||||
<div class="text-center p-3 bg-red-50 dark:bg-red-900/20 rounded-lg">
|
||||
<div class="text-xl font-bold text-red-600">{{ failedCount }}</div>
|
||||
<div class="text-sm text-gray-600 dark:text-gray-400">失败</div>
|
||||
</div>
|
||||
<div class="text-center p-3 bg-yellow-50 dark:bg-yellow-900/20 rounded-lg">
|
||||
<div class="text-xl font-bold text-yellow-600">{{ processingCount }}</div>
|
||||
<div class="text-sm text-gray-600 dark:text-gray-400">处理中</div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- 结果列表 -->
|
||||
<n-data-table
|
||||
:columns="resultColumns"
|
||||
:data="results"
|
||||
:pagination="false"
|
||||
max-height="300"
|
||||
size="small"
|
||||
/>
|
||||
</div>
|
||||
</n-card>
|
||||
</div>
|
||||
</template>
|
||||
|
||||
<script setup lang="ts">
|
||||
import { ref, computed, onMounted, onBeforeUnmount, h } from 'vue'
|
||||
import { usePanApi, useTaskApi, useCksApi } from '~/composables/useApi'
|
||||
import { useMessage } from 'naive-ui'
|
||||
|
||||
// 数据状态
|
||||
const resourceText = ref('')
|
||||
const processing = ref(false)
|
||||
const results = ref<any[]>([])
|
||||
|
||||
// 任务状态
|
||||
const currentTaskId = ref<number | null>(null)
|
||||
const taskStatus = ref<any>(null)
|
||||
const taskStats = ref({
|
||||
total: 0,
|
||||
pending: 0,
|
||||
processing: 0,
|
||||
completed: 0,
|
||||
failed: 0
|
||||
})
|
||||
const statusCheckInterval = ref<NodeJS.Timeout | null>(null)
|
||||
|
||||
// 配置选项
|
||||
const selectedCategory = ref(null)
|
||||
const selectedTags = ref([])
|
||||
const selectedPlatform = ref(null)
|
||||
const autoValidate = ref(true)
|
||||
const skipExisting = ref(true)
|
||||
const autoTransfer = ref(false)
|
||||
const selectedAccounts = ref<number[]>([])
|
||||
|
||||
// 选项数据
|
||||
const platformOptions = ref<any[]>([])
|
||||
const accountOptions = ref<any[]>([])
|
||||
const accountsLoading = ref(false)
|
||||
|
||||
// API实例
|
||||
const panApi = usePanApi()
|
||||
const taskApi = useTaskApi()
|
||||
const cksApi = useCksApi()
|
||||
const message = useMessage()
|
||||
|
||||
// 计算属性
|
||||
const totalLines = computed(() => {
|
||||
return resourceText.value ? resourceText.value.split('\n').filter(line => line.trim()).length : 0
|
||||
})
|
||||
|
||||
const validUrls = computed(() => {
|
||||
if (!resourceText.value) return 0
|
||||
const lines = resourceText.value.split('\n').filter(line => line.trim())
|
||||
return lines.filter(line => isValidUrl(line.trim())).length
|
||||
})
|
||||
|
||||
const invalidUrls = computed(() => {
|
||||
return totalLines.value - validUrls.value
|
||||
})
|
||||
|
||||
const successCount = computed(() => {
|
||||
return results.value.filter((r: any) => r.status === 'success').length
|
||||
})
|
||||
|
||||
const failedCount = computed(() => {
|
||||
return results.value.filter((r: any) => r.status === 'failed').length
|
||||
})
|
||||
|
||||
const processingCount = computed(() => {
|
||||
return results.value.filter((r: any) => r.status === 'processing').length
|
||||
})
|
||||
|
||||
// 结果表格列
|
||||
const resultColumns = [
|
||||
{
|
||||
title: '标题',
|
||||
key: 'title',
|
||||
width: 200,
|
||||
ellipsis: {
|
||||
tooltip: true
|
||||
}
|
||||
},
|
||||
{
|
||||
title: '链接',
|
||||
key: 'url',
|
||||
width: 250,
|
||||
ellipsis: {
|
||||
tooltip: true
|
||||
}
|
||||
},
|
||||
{
|
||||
title: '状态',
|
||||
key: 'status',
|
||||
width: 100,
|
||||
render: (row: any) => {
|
||||
const statusMap = {
|
||||
success: { color: 'success', text: '成功', icon: 'fas fa-check' },
|
||||
failed: { color: 'error', text: '失败', icon: 'fas fa-times' },
|
||||
processing: { color: 'info', text: '处理中', icon: 'fas fa-spinner fa-spin' },
|
||||
pending: { color: 'warning', text: '等待中', icon: 'fas fa-clock' }
|
||||
}
|
||||
const status = statusMap[row.status as keyof typeof statusMap] || statusMap.failed
|
||||
return h('n-tag', { type: status.color }, {
|
||||
icon: () => h('i', { class: status.icon }),
|
||||
default: () => status.text
|
||||
})
|
||||
}
|
||||
},
|
||||
{
|
||||
title: '消息',
|
||||
key: 'message',
|
||||
ellipsis: {
|
||||
tooltip: true
|
||||
}
|
||||
},
|
||||
{
|
||||
title: '转存链接',
|
||||
key: 'saveUrl',
|
||||
width: 200,
|
||||
ellipsis: {
|
||||
tooltip: true
|
||||
},
|
||||
render: (row: any) => {
|
||||
if (row.saveUrl) {
|
||||
return h('a', {
|
||||
href: row.saveUrl,
|
||||
target: '_blank',
|
||||
class: 'text-blue-500 hover:text-blue-700'
|
||||
}, '查看')
|
||||
}
|
||||
return '-'
|
||||
}
|
||||
}
|
||||
]
|
||||
|
||||
// URL验证
|
||||
const isValidUrl = (url: string) => {
|
||||
try {
|
||||
new URL(url)
|
||||
// 简单检查是否包含常见网盘域名
|
||||
const diskDomains = ['quark.cn', 'pan.baidu.com', 'aliyundrive.com']
|
||||
return diskDomains.some(domain => url.includes(domain))
|
||||
} catch {
|
||||
return false
|
||||
}
|
||||
}
|
||||
|
||||
// 获取平台选项
|
||||
const fetchPlatforms = async () => {
|
||||
try {
|
||||
const result = await panApi.getPans() as any
|
||||
if (result && Array.isArray(result)) {
|
||||
platformOptions.value = result.map((item: any) => ({
|
||||
label: item.remark || item.name,
|
||||
value: item.id
|
||||
}))
|
||||
}
|
||||
} catch (error) {
|
||||
console.error('获取平台失败:', error)
|
||||
}
|
||||
}
|
||||
|
||||
// 处理批量转存
|
||||
const handleBatchTransfer = async () => {
|
||||
if (!resourceText.value.trim()) {
|
||||
message.warning('请输入资源内容')
|
||||
return
|
||||
}
|
||||
|
||||
if (!selectedAccounts.value || selectedAccounts.value.length === 0) {
|
||||
message.warning('请选择至少一个网盘账号')
|
||||
return
|
||||
}
|
||||
|
||||
processing.value = true
|
||||
results.value = []
|
||||
|
||||
try {
|
||||
// 第一步:拆解资源信息,按照一行标题,一行链接的形式
|
||||
const resourceList = parseResourceText(resourceText.value)
|
||||
|
||||
if (resourceList.length === 0) {
|
||||
message.warning('没有找到有效的资源信息,请按照格式要求输入:标题和URL为一组,标题必填')
|
||||
return
|
||||
}
|
||||
|
||||
// 第二步:生成任务标题和数据
|
||||
const taskTitle = `批量转存任务_${new Date().toLocaleString('zh-CN')}`
|
||||
const taskData = {
|
||||
title: taskTitle,
|
||||
description: `批量转存 ${resourceList.length} 个资源,使用 ${selectedAccounts.value.length} 个账号`,
|
||||
resources: resourceList.map(item => {
|
||||
const resource: any = {
|
||||
title: item.title,
|
||||
url: item.url
|
||||
}
|
||||
if (selectedCategory.value) {
|
||||
resource.category_id = selectedCategory.value
|
||||
}
|
||||
if (selectedTags.value && selectedTags.value.length > 0) {
|
||||
resource.tags = selectedTags.value
|
||||
}
|
||||
return resource
|
||||
}),
|
||||
// 添加选择的账号信息
|
||||
selected_accounts: selectedAccounts.value
|
||||
}
|
||||
|
||||
console.log('创建任务数据:', taskData)
|
||||
|
||||
// 第三步:创建任务
|
||||
const taskResponse = await taskApi.createBatchTransferTask(taskData) as any
|
||||
console.log('任务创建响应:', taskResponse)
|
||||
|
||||
currentTaskId.value = taskResponse.task_id
|
||||
|
||||
// 第四步:启动任务
|
||||
await taskApi.startTask(currentTaskId.value!)
|
||||
|
||||
// 第五步:开始实时监控任务状态
|
||||
startTaskMonitoring()
|
||||
|
||||
message.success('任务已创建并启动,开始处理...')
|
||||
|
||||
} catch (error: any) {
|
||||
console.error('创建任务失败:', error)
|
||||
message.error('创建任务失败: ' + (error.message || '未知错误'))
|
||||
processing.value = false
|
||||
}
|
||||
}
|
||||
|
||||
// 解析资源文本,按照 标题\n链接 的格式(支持同一标题多个URL)
|
||||
const parseResourceText = (text: string) => {
|
||||
const lines = text.split('\n').filter((line: string) => line.trim())
|
||||
const resourceList = []
|
||||
|
||||
let currentTitle = ''
|
||||
let currentUrls = []
|
||||
|
||||
for (const line of lines) {
|
||||
// 判断是否为 url(以 http/https 开头)
|
||||
if (/^https?:\/\//i.test(line)) {
|
||||
currentUrls.push(line.trim())
|
||||
} else {
|
||||
// 新标题,先保存上一个
|
||||
if (currentTitle && currentUrls.length > 0) {
|
||||
// 为每个URL创建一个资源项
|
||||
for (const url of currentUrls) {
|
||||
if (isValidUrl(url)) {
|
||||
resourceList.push({
|
||||
title: currentTitle,
|
||||
url: url,
|
||||
category_id: selectedCategory.value || 0,
|
||||
tags: selectedTags.value || []
|
||||
})
|
||||
}
|
||||
}
|
||||
}
|
||||
currentTitle = line.trim()
|
||||
currentUrls = []
|
||||
}
|
||||
}
|
||||
|
||||
// 处理最后一组
|
||||
if (currentTitle && currentUrls.length > 0) {
|
||||
for (const url of currentUrls) {
|
||||
if (isValidUrl(url)) {
|
||||
resourceList.push({
|
||||
title: currentTitle,
|
||||
url: url,
|
||||
category_id: selectedCategory.value || 0,
|
||||
tags: selectedTags.value || []
|
||||
})
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
return resourceList
|
||||
}
|
||||
|
||||
// 开始任务监控
|
||||
const startTaskMonitoring = () => {
|
||||
if (statusCheckInterval.value) {
|
||||
clearInterval(statusCheckInterval.value)
|
||||
}
|
||||
|
||||
statusCheckInterval.value = setInterval(async () => {
|
||||
try {
|
||||
const status = await taskApi.getTaskStatus(currentTaskId.value!) as any
|
||||
console.log('任务状态更新:', status)
|
||||
|
||||
taskStatus.value = status
|
||||
taskStats.value = status.stats || {
|
||||
total: 0,
|
||||
pending: 0,
|
||||
processing: 0,
|
||||
completed: 0,
|
||||
failed: 0
|
||||
}
|
||||
|
||||
// 更新结果显示
|
||||
updateResultsDisplay()
|
||||
|
||||
// 如果任务完成,停止监控
|
||||
if (status.status === 'completed' || status.status === 'failed' || status.status === 'partial_success') {
|
||||
stopTaskMonitoring()
|
||||
processing.value = false
|
||||
|
||||
const { completed, failed } = taskStats.value
|
||||
message.success(`批量转存完成!成功: ${completed}, 失败: ${failed}`)
|
||||
}
|
||||
|
||||
} catch (error) {
|
||||
console.error('获取任务状态失败:', error)
|
||||
// 如果连续失败,停止监控
|
||||
stopTaskMonitoring()
|
||||
processing.value = false
|
||||
}
|
||||
}, 2000) // 每2秒检查一次
|
||||
}
|
||||
|
||||
// 停止任务监控
|
||||
const stopTaskMonitoring = () => {
|
||||
if (statusCheckInterval.value) {
|
||||
clearInterval(statusCheckInterval.value)
|
||||
statusCheckInterval.value = null
|
||||
}
|
||||
}
|
||||
|
||||
// 更新结果显示
|
||||
const updateResultsDisplay = () => {
|
||||
if (!taskStatus.value) return
|
||||
|
||||
// 如果还没有结果,初始化
|
||||
if (results.value.length === 0) {
|
||||
const resourceList = parseResourceText(resourceText.value)
|
||||
results.value = resourceList.map(item => ({
|
||||
title: item.title,
|
||||
url: item.url,
|
||||
status: 'pending',
|
||||
message: '等待处理...',
|
||||
saveUrl: null
|
||||
}))
|
||||
}
|
||||
|
||||
// 更新整体进度显示
|
||||
const { pending, processing, completed, failed } = taskStats.value
|
||||
const processed = completed + failed
|
||||
|
||||
// 简单的状态更新逻辑 - 这里可以根据需要获取详细的任务项状态
|
||||
for (let i = 0; i < results.value.length; i++) {
|
||||
const result = results.value[i]
|
||||
|
||||
if (i < completed) {
|
||||
// 已完成的项目
|
||||
result.status = 'success'
|
||||
result.message = '转存成功'
|
||||
} else if (i < completed + failed) {
|
||||
// 失败的项目
|
||||
result.status = 'failed'
|
||||
result.message = '转存失败'
|
||||
} else if (i < processed + processing) {
|
||||
// 正在处理的项目
|
||||
result.status = 'processing'
|
||||
result.message = '正在处理...'
|
||||
} else {
|
||||
// 等待处理的项目
|
||||
result.status = 'pending'
|
||||
result.message = '等待处理...'
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
// 获取网盘账号选项
|
||||
const getAccountOptions = async () => {
|
||||
accountsLoading.value = true
|
||||
try {
|
||||
const response = await cksApi.getCks() as any
|
||||
const accounts = Array.isArray(response) ? response : []
|
||||
|
||||
accountOptions.value = accounts.map((account: any) => ({
|
||||
label: `${account.username || '未知用户'} (${account.pan?.name || '未知平台'})`,
|
||||
value: account.id,
|
||||
is_valid: account.is_valid,
|
||||
left_space: account.left_space,
|
||||
username: account.username,
|
||||
pan_name: account.pan?.name || '未知平台'
|
||||
}))
|
||||
} catch (error) {
|
||||
console.error('获取网盘账号选项失败:', error)
|
||||
message.error('获取网盘账号失败')
|
||||
} finally {
|
||||
accountsLoading.value = false
|
||||
}
|
||||
}
|
||||
|
||||
// 处理账号选择变化
|
||||
const handleAccountChange = (value: number[]) => {
|
||||
selectedAccounts.value = value
|
||||
console.log('选择的账号:', value)
|
||||
}
|
||||
|
||||
// 格式化空间大小
|
||||
const formatSpace = (bytes: number) => {
|
||||
if (bytes === 0) return '0 B'
|
||||
const k = 1024
|
||||
const sizes = ['B', 'KB', 'MB', 'GB', 'TB']
|
||||
const i = Math.floor(Math.log(bytes) / Math.log(k))
|
||||
return parseFloat((bytes / Math.pow(k, i)).toFixed(2)) + ' ' + sizes[i]
|
||||
}
|
||||
|
||||
// 清空输入
|
||||
const clearInput = () => {
|
||||
resourceText.value = ''
|
||||
results.value = []
|
||||
selectedAccounts.value = []
|
||||
}
|
||||
|
||||
// 初始化
|
||||
onMounted(() => {
|
||||
fetchPlatforms()
|
||||
getAccountOptions()
|
||||
})
|
||||
|
||||
// 组件销毁时清理定时器
|
||||
onBeforeUnmount(() => {
|
||||
stopTaskMonitoring()
|
||||
})
|
||||
</script>
|
||||
147
web/components/Admin/NewHeader.vue
Normal file
@@ -0,0 +1,147 @@
|
||||
<template>
|
||||
<header class="bg-white dark:bg-gray-800 shadow-sm border-b border-gray-200 dark:border-gray-700">
|
||||
<div class="flex items-center justify-between px-6 py-4">
|
||||
<!-- 左侧:Logo和标题 -->
|
||||
<div class="flex items-center">
|
||||
<NuxtLink to="/admin" class="flex items-center space-x-3">
|
||||
<div class="w-8 h-8 bg-blue-600 rounded-lg flex items-center justify-center">
|
||||
<i class="fas fa-shield-alt text-white text-sm"></i>
|
||||
</div>
|
||||
<div>
|
||||
<h1 class="text-xl font-bold text-gray-900 dark:text-white">管理后台</h1>
|
||||
<p class="text-xs text-gray-500 dark:text-gray-400">老九网盘资源数据库</p>
|
||||
</div>
|
||||
</NuxtLink>
|
||||
</div>
|
||||
|
||||
<!-- 中间:状态信息 -->
|
||||
<div class="flex items-center space-x-6">
|
||||
<!-- 系统状态 -->
|
||||
<div class="flex items-center space-x-2">
|
||||
<div class="w-2 h-2 bg-green-500 rounded-full"></div>
|
||||
<span class="text-sm text-gray-600 dark:text-gray-300">系统正常</span>
|
||||
</div>
|
||||
|
||||
<!-- 自动处理状态 -->
|
||||
<div class="flex items-center space-x-2">
|
||||
<div :class="autoProcessEnabled ? 'w-2 h-2 bg-green-500 rounded-full' : 'w-2 h-2 bg-gray-400 rounded-full'"></div>
|
||||
<span class="text-sm text-gray-600 dark:text-gray-300">
|
||||
自动处理{{ autoProcessEnabled ? '已开启' : '已关闭' }}
|
||||
</span>
|
||||
</div>
|
||||
|
||||
<!-- 自动转存状态 -->
|
||||
<div class="flex items-center space-x-2">
|
||||
<div :class="autoTransferEnabled ? 'w-2 h-2 bg-blue-500 rounded-full' : 'w-2 h-2 bg-gray-400 rounded-full'"></div>
|
||||
<span class="text-sm text-gray-600 dark:text-gray-300">
|
||||
自动转存{{ autoTransferEnabled ? '已开启' : '已关闭' }}
|
||||
</span>
|
||||
</div>
|
||||
|
||||
<!-- 任务状态 -->
|
||||
<div v-if="taskStore.hasActiveTasks" class="flex items-center space-x-2">
|
||||
<div class="w-2 h-2 bg-orange-500 rounded-full animate-pulse"></div>
|
||||
<span class="text-sm text-gray-600 dark:text-gray-300">
|
||||
<template v-if="taskStore.runningTaskCount > 0">
|
||||
{{ taskStore.runningTaskCount }}个任务运行中
|
||||
</template>
|
||||
<template v-else>
|
||||
{{ taskStore.activeTaskCount }}个任务待处理
|
||||
</template>
|
||||
</span>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- 右侧:用户菜单 -->
|
||||
<div class="flex items-center space-x-4">
|
||||
<NuxtLink to="/" class="p-2 text-gray-400 hover:text-gray-600 dark:hover:text-gray-300 transition-colors">
|
||||
<i class="fas fa-home text-lg"></i>
|
||||
</NuxtLink>
|
||||
<NuxtLink to="/admin-old" class="p-2 text-gray-400 hover:text-gray-600 dark:hover:text-gray-300 transition-colors">
|
||||
<i class="fas fa-arrow-left text-lg"></i>
|
||||
</NuxtLink>
|
||||
<div class="flex items-center space-x-2 cursor-pointer p-2 rounded-lg hover:bg-gray-100 dark:hover:bg-gray-700 transition-colors">
|
||||
<div class="w-8 h-8 bg-blue-600 rounded-full flex items-center justify-center">
|
||||
<i class="fas fa-user text-white text-sm"></i>
|
||||
</div>
|
||||
<div class="hidden md:block text-left">
|
||||
<p class="text-sm font-medium text-gray-900 dark:text-white">管理员</p>
|
||||
<p class="text-xs text-gray-500 dark:text-gray-400">admin</p>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</header>
|
||||
</template>
|
||||
|
||||
<script setup lang="ts">
|
||||
import { ref, onMounted, onBeforeUnmount } from 'vue'
|
||||
import { useTaskStore } from '~/stores/task'
|
||||
import { useSystemConfigStore } from '~/stores/systemConfig'
|
||||
|
||||
// 任务状态管理
|
||||
const taskStore = useTaskStore()
|
||||
|
||||
// 系统配置状态管理
|
||||
const systemConfigStore = useSystemConfigStore()
|
||||
|
||||
// 自动处理和自动转存状态
|
||||
const autoProcessEnabled = ref(false)
|
||||
const autoTransferEnabled = ref(false)
|
||||
|
||||
// 获取系统配置状态
|
||||
const fetchSystemStatus = async () => {
|
||||
try {
|
||||
await systemConfigStore.initConfig(false, true)
|
||||
|
||||
// 从系统配置中获取自动处理和自动转存状态
|
||||
const config = systemConfigStore.config
|
||||
|
||||
if (config) {
|
||||
// 检查自动处理状态
|
||||
autoProcessEnabled.value = config.auto_process_ready_resources === '1' || config.auto_process_ready_resources === true
|
||||
|
||||
// 检查自动转存状态
|
||||
autoTransferEnabled.value = config.auto_transfer_enabled === '1' || config.auto_transfer_enabled === true
|
||||
}
|
||||
|
||||
} catch (error) {
|
||||
console.error('获取系统状态失败:', error)
|
||||
}
|
||||
}
|
||||
|
||||
// 组件挂载时启动
|
||||
onMounted(() => {
|
||||
// 启动任务状态自动更新
|
||||
taskStore.startAutoUpdate()
|
||||
|
||||
// 获取系统配置状态
|
||||
fetchSystemStatus()
|
||||
|
||||
// 定期更新系统配置状态(每30秒)
|
||||
const configInterval = setInterval(fetchSystemStatus, 30000)
|
||||
|
||||
// 保存定时器引用用于清理
|
||||
;(globalThis as any).__configInterval = configInterval
|
||||
})
|
||||
|
||||
// 组件销毁时清理
|
||||
onBeforeUnmount(() => {
|
||||
// 停止任务状态自动更新
|
||||
taskStore.stopAutoUpdate()
|
||||
|
||||
// 清理配置更新定时器
|
||||
if ((globalThis as any).__configInterval) {
|
||||
clearInterval((globalThis as any).__configInterval)
|
||||
delete (globalThis as any).__configInterval
|
||||
}
|
||||
})
|
||||
</script>
|
||||
|
||||
<style scoped>
|
||||
/* 确保Font Awesome图标正确显示 */
|
||||
.fas {
|
||||
font-family: 'Font Awesome 6 Free';
|
||||
font-weight: 900;
|
||||
}
|
||||
</style>
|
||||
188
web/components/Admin/NewSidebar.vue
Normal file
@@ -0,0 +1,188 @@
|
||||
<template>
|
||||
<aside class="w-64 bg-white dark:bg-gray-800 shadow-sm border-r border-gray-200 dark:border-gray-700 min-h-screen">
|
||||
<nav class="mt-8">
|
||||
<div class="px-4 space-y-2">
|
||||
<!-- 仪表盘 -->
|
||||
<NuxtLink
|
||||
:to="dashboardItem.to"
|
||||
class="flex items-center px-4 py-3 text-gray-700 dark:text-gray-300 hover:bg-blue-50 dark:hover:bg-blue-900/20 hover:text-blue-600 dark:hover:text-blue-400 rounded-lg transition-colors"
|
||||
:class="{ 'bg-blue-50 dark:bg-blue-900/20 text-blue-600 dark:text-blue-400': dashboardItem.active($route) }"
|
||||
>
|
||||
<i :class="dashboardItem.icon + ' w-5 h-5 mr-3'"></i>
|
||||
<span>{{ dashboardItem.label }}</span>
|
||||
</NuxtLink>
|
||||
|
||||
<!-- 运营管理分组 -->
|
||||
<div class="mt-6">
|
||||
<div class="px-4 py-2 text-xs font-semibold text-gray-500 dark:text-gray-400 uppercase tracking-wider">
|
||||
运营管理
|
||||
</div>
|
||||
<div class="space-y-1">
|
||||
<NuxtLink
|
||||
v-for="item in operationItems"
|
||||
:key="item.to"
|
||||
:to="item.to"
|
||||
class="flex items-center px-4 py-3 text-gray-700 dark:text-gray-300 hover:bg-blue-50 dark:hover:bg-blue-900/20 hover:text-blue-600 dark:hover:text-blue-400 rounded-lg transition-colors"
|
||||
:class="{ 'bg-blue-50 dark:bg-blue-900/20 text-blue-600 dark:text-blue-400': item.active($route) }"
|
||||
>
|
||||
<i :class="item.icon + ' w-5 h-5 mr-3'"></i>
|
||||
<span>{{ item.label }}</span>
|
||||
</NuxtLink>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- 统计分析分组 -->
|
||||
<div class="mt-6">
|
||||
<div class="px-4 py-2 text-xs font-semibold text-gray-500 dark:text-gray-400 uppercase tracking-wider">
|
||||
统计分析
|
||||
</div>
|
||||
<div class="space-y-1">
|
||||
<NuxtLink
|
||||
v-for="item in statisticsItems"
|
||||
:key="item.to"
|
||||
:to="item.to"
|
||||
class="flex items-center px-4 py-3 text-gray-700 dark:text-gray-300 hover:bg-blue-50 dark:hover:bg-blue-900/20 hover:text-blue-600 dark:hover:text-blue-400 rounded-lg transition-colors"
|
||||
:class="{ 'bg-blue-50 dark:bg-blue-900/20 text-blue-600 dark:text-blue-400': item.active($route) }"
|
||||
>
|
||||
<i :class="item.icon + ' w-5 h-5 mr-3'"></i>
|
||||
<span>{{ item.label }}</span>
|
||||
</NuxtLink>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- 系统管理分组 -->
|
||||
<div class="mt-6">
|
||||
<div class="px-4 py-2 text-xs font-semibold text-gray-500 dark:text-gray-400 uppercase tracking-wider">
|
||||
系统管理
|
||||
</div>
|
||||
<div class="space-y-1">
|
||||
<NuxtLink
|
||||
v-for="item in systemItems"
|
||||
:key="item.to"
|
||||
:to="item.to"
|
||||
class="flex items-center px-4 py-3 text-gray-700 dark:text-gray-300 hover:bg-blue-50 dark:hover:bg-blue-900/20 hover:text-blue-600 dark:hover:text-blue-400 rounded-lg transition-colors"
|
||||
:class="{ 'bg-blue-50 dark:bg-blue-900/20 text-blue-600 dark:text-blue-400': item.active($route) }"
|
||||
>
|
||||
<i :class="item.icon + ' w-5 h-5 mr-3'"></i>
|
||||
<span>{{ item.label }}</span>
|
||||
</NuxtLink>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</nav>
|
||||
</aside>
|
||||
</template>
|
||||
|
||||
<script setup lang="ts">
|
||||
// 仪表盘
|
||||
const dashboardItem = ref({
|
||||
to: '/admin',
|
||||
label: '仪表盘',
|
||||
icon: 'fas fa-tachometer-alt',
|
||||
active: (route: any) => route.path === '/admin'
|
||||
})
|
||||
|
||||
// 运营管理分组
|
||||
const operationItems = ref([
|
||||
{
|
||||
to: '/admin/resources',
|
||||
label: '资源管理',
|
||||
icon: 'fas fa-database',
|
||||
active: (route: any) => route.path.startsWith('/admin/resources')
|
||||
},
|
||||
{
|
||||
to: '/admin/ready-resources',
|
||||
label: '待处理资源',
|
||||
icon: 'fas fa-clock',
|
||||
active: (route: any) => route.path.startsWith('/admin/ready-resources')
|
||||
},
|
||||
{
|
||||
to: '/admin/categories',
|
||||
label: '分类管理',
|
||||
icon: 'fas fa-folder',
|
||||
active: (route: any) => route.path.startsWith('/admin/categories')
|
||||
},
|
||||
{
|
||||
to: '/admin/tags',
|
||||
label: '标签管理',
|
||||
icon: 'fas fa-tags',
|
||||
active: (route: any) => route.path.startsWith('/admin/tags')
|
||||
},
|
||||
{
|
||||
to: '/admin/platforms',
|
||||
label: '平台管理',
|
||||
icon: 'fas fa-cloud',
|
||||
active: (route: any) => route.path.startsWith('/admin/platforms')
|
||||
},
|
||||
{
|
||||
to: '/admin/accounts',
|
||||
label: '账号管理',
|
||||
icon: 'fas fa-user-shield',
|
||||
active: (route: any) => route.path.startsWith('/admin/accounts')
|
||||
},
|
||||
{
|
||||
to: '/admin/hot-dramas',
|
||||
label: '热播剧管理',
|
||||
icon: 'fas fa-film',
|
||||
active: (route: any) => route.path.startsWith('/admin/hot-dramas')
|
||||
},
|
||||
{
|
||||
to: '/admin/seo',
|
||||
label: 'SEO',
|
||||
icon: 'fas fa-search',
|
||||
active: (route: any) => route.path.startsWith('/admin/seo')
|
||||
},
|
||||
{
|
||||
to: '/admin/data-push',
|
||||
label: '数据推送',
|
||||
icon: 'fas fa-upload',
|
||||
active: (route: any) => route.path.startsWith('/admin/data-push')
|
||||
},
|
||||
{
|
||||
to: '/admin/bot',
|
||||
label: '机器人',
|
||||
icon: 'fas fa-robot',
|
||||
active: (route: any) => route.path.startsWith('/admin/bot')
|
||||
}
|
||||
])
|
||||
|
||||
// 统计分析分组
|
||||
const statisticsItems = ref([
|
||||
{
|
||||
to: '/admin/search-stats',
|
||||
label: '搜索统计',
|
||||
icon: 'fas fa-chart-line',
|
||||
active: (route: any) => route.path.startsWith('/admin/search-stats')
|
||||
},
|
||||
{
|
||||
to: '/admin/third-party-stats',
|
||||
label: '三方统计',
|
||||
icon: 'fas fa-chart-bar',
|
||||
active: (route: any) => route.path.startsWith('/admin/third-party-stats')
|
||||
}
|
||||
])
|
||||
|
||||
// 系统管理分组
|
||||
const systemItems = ref([
|
||||
{
|
||||
to: '/admin/users',
|
||||
label: '用户管理',
|
||||
icon: 'fas fa-users',
|
||||
active: (route: any) => route.path.startsWith('/admin/users')
|
||||
},
|
||||
{
|
||||
to: '/admin/system-config',
|
||||
label: '系统配置',
|
||||
icon: 'fas fa-cog',
|
||||
active: (route: any) => route.path.startsWith('/admin/system-config')
|
||||
}
|
||||
])
|
||||
</script>
|
||||
|
||||
<style scoped>
|
||||
/* 确保Font Awesome图标正确显示 */
|
||||
.fas {
|
||||
font-family: 'Font Awesome 6 Free';
|
||||
font-weight: 900;
|
||||
}
|
||||
</style>
|
||||
@@ -5,9 +5,8 @@
|
||||
<label class="block text-sm font-medium text-gray-700 dark:text-gray-300 mb-2">
|
||||
标题 <span class="text-red-500">*</span>
|
||||
</label>
|
||||
<input
|
||||
v-model="form.title"
|
||||
class="input-field dark:bg-gray-900 dark:text-gray-100 dark:border-gray-700"
|
||||
<n-input
|
||||
v-model:value="form.title"
|
||||
placeholder="输入资源标题(必填)"
|
||||
required
|
||||
/>
|
||||
@@ -18,12 +17,11 @@
|
||||
<label class="block text-sm font-medium text-gray-700 dark:text-gray-300 mb-2">
|
||||
描述 <span class="text-gray-400 text-xs">(可选)</span>
|
||||
</label>
|
||||
<textarea
|
||||
v-model="form.description"
|
||||
rows="3"
|
||||
class="input-field dark:bg-gray-900 dark:text-gray-100 dark:border-gray-700"
|
||||
<n-input
|
||||
v-model:value="form.description"
|
||||
type="textarea"
|
||||
placeholder="输入资源描述,如:剧情简介、文件大小、清晰度等"
|
||||
></textarea>
|
||||
/>
|
||||
</div>
|
||||
|
||||
<!-- URL -->
|
||||
@@ -31,15 +29,14 @@
|
||||
<label class="block text-sm font-medium text-gray-700 dark:text-gray-300 mb-2">
|
||||
URL <span class="text-red-500">*</span>
|
||||
</label>
|
||||
<textarea
|
||||
v-model="form.url"
|
||||
rows="3"
|
||||
class="input-field dark:bg-gray-900 dark:text-gray-100 dark:border-gray-700"
|
||||
<n-input
|
||||
v-model:value="form.url"
|
||||
type="textarea"
|
||||
placeholder="请输入资源链接,支持多行,每行一个链接"
|
||||
required
|
||||
></textarea>
|
||||
/>
|
||||
<p class="text-xs text-gray-500 dark:text-gray-400 mt-1">
|
||||
支持百度网盘、阿里云盘、夸克网盘等链接
|
||||
支持百度网盘、阿里云盘、夸克网盘等链接,每行一个链接
|
||||
</p>
|
||||
</div>
|
||||
|
||||
@@ -48,9 +45,8 @@
|
||||
<label class="block text-sm font-medium text-gray-700 dark:text-gray-300 mb-2">
|
||||
分类 <span class="text-gray-400 text-xs">(可选)</span>
|
||||
</label>
|
||||
<input
|
||||
v-model="form.category"
|
||||
class="input-field dark:bg-gray-900 dark:text-gray-100 dark:border-gray-700"
|
||||
<n-input
|
||||
v-model:value="form.category"
|
||||
placeholder="如:电影、电视剧、动漫、音乐等"
|
||||
/>
|
||||
</div>
|
||||
@@ -76,10 +72,9 @@
|
||||
</button>
|
||||
</span>
|
||||
</div>
|
||||
<input
|
||||
v-model="newTag"
|
||||
<n-input
|
||||
v-model:value="newTag"
|
||||
@keyup.enter.prevent="addTag"
|
||||
class="input-field dark:bg-gray-900 dark:text-gray-100 dark:border-gray-700"
|
||||
placeholder="输入标签后回车添加,多个标签用逗号分隔"
|
||||
/>
|
||||
</div>
|
||||
@@ -89,9 +84,8 @@
|
||||
<label class="block text-sm font-medium text-gray-700 dark:text-gray-300 mb-2">
|
||||
封面图片 <span class="text-gray-400 text-xs">(可选)</span>
|
||||
</label>
|
||||
<input
|
||||
v-model="form.img"
|
||||
class="input-field dark:bg-gray-900 dark:text-gray-100 dark:border-gray-700"
|
||||
<n-input
|
||||
v-model:value="form.img"
|
||||
placeholder="封面图片链接"
|
||||
/>
|
||||
</div>
|
||||
@@ -101,9 +95,8 @@
|
||||
<label class="block text-sm font-medium text-gray-700 dark:text-gray-300 mb-2">
|
||||
数据来源 <span class="text-gray-400 text-xs">(可选)</span>
|
||||
</label>
|
||||
<input
|
||||
v-model="form.source"
|
||||
class="input-field dark:bg-gray-900 dark:text-gray-100 dark:border-gray-700"
|
||||
<n-input
|
||||
v-model:value="form.source"
|
||||
placeholder="如:手动添加、API导入、爬虫等"
|
||||
/>
|
||||
</div>
|
||||
@@ -113,12 +106,11 @@
|
||||
<label class="block text-sm font-medium text-gray-700 dark:text-gray-300 mb-2">
|
||||
额外数据 <span class="text-gray-400 text-xs">(可选)</span>
|
||||
</label>
|
||||
<textarea
|
||||
v-model="form.extra"
|
||||
rows="3"
|
||||
class="input-field dark:bg-gray-900 dark:text-gray-100 dark:border-gray-700"
|
||||
<n-input
|
||||
v-model:value="form.extra"
|
||||
type="textarea"
|
||||
placeholder="JSON格式的额外数据,如:{'size': '2GB', 'quality': '1080p'}"
|
||||
></textarea>
|
||||
/>
|
||||
</div>
|
||||
|
||||
<!-- 按钮区域 -->
|
||||
@@ -205,7 +197,7 @@ const clearForm = () => {
|
||||
newTag.value = ''
|
||||
}
|
||||
|
||||
// 单个添加提交
|
||||
// 单个添加提交 - 更新为使用批量添加方法
|
||||
const handleSubmit = async () => {
|
||||
loading.value = true
|
||||
try {
|
||||
@@ -214,23 +206,23 @@ const handleSubmit = async () => {
|
||||
// 多行链接处理
|
||||
const urls = form.value.url.split(/\r?\n/).map(l => l.trim()).filter(Boolean)
|
||||
|
||||
// 为每个URL创建一个资源
|
||||
for (const url of urls) {
|
||||
const resourceData = {
|
||||
title: form.value.title, // 标题必填
|
||||
description: form.value.description || undefined, // 添加描述
|
||||
url: url,
|
||||
// 使用批量添加方法,将多个URL作为一个资源的多个链接
|
||||
const resourceData = {
|
||||
resources: [{
|
||||
title: form.value.title || undefined, // 后端期望 *string 类型
|
||||
description: form.value.description || '',
|
||||
url: urls, // 现在 url 是一个数组
|
||||
category: form.value.category || '',
|
||||
tags: form.value.tags.join(','), // 转换为逗号分隔的字符串
|
||||
img: form.value.img || '',
|
||||
source: form.value.source || '手动添加',
|
||||
extra: form.value.extra || '',
|
||||
}
|
||||
|
||||
await readyResourceApi.createReadyResource(resourceData)
|
||||
}]
|
||||
}
|
||||
|
||||
emit('success', `成功添加 ${urls.length} 个资源到待处理列表`)
|
||||
const response = await readyResourceApi.batchCreateReadyResources(resourceData)
|
||||
|
||||
emit('success', `成功添加资源,包含 ${urls.length} 个链接`)
|
||||
clearForm()
|
||||
} catch (e: any) {
|
||||
emit('error', e.message || '添加失败')
|
||||
281
web/components/Admin/TransferredList.vue
Normal file
@@ -0,0 +1,281 @@
|
||||
<template>
|
||||
<div class="space-y-4">
|
||||
<!-- 搜索和筛选 -->
|
||||
<div class="grid grid-cols-1 md:grid-cols-4 gap-4">
|
||||
<n-input
|
||||
v-model:value="searchQuery"
|
||||
placeholder="搜索已转存资源..."
|
||||
@keyup.enter="handleSearch"
|
||||
clearable
|
||||
>
|
||||
<template #prefix>
|
||||
<i class="fas fa-search"></i>
|
||||
</template>
|
||||
</n-input>
|
||||
|
||||
<CategorySelector
|
||||
v-model="selectedCategory"
|
||||
placeholder="选择分类"
|
||||
clearable
|
||||
/>
|
||||
|
||||
<TagSelector
|
||||
v-model="selectedTag"
|
||||
placeholder="选择标签"
|
||||
clearable
|
||||
/>
|
||||
|
||||
<n-button type="primary" @click="handleSearch">
|
||||
<template #icon>
|
||||
<i class="fas fa-search"></i>
|
||||
</template>
|
||||
搜索
|
||||
</n-button>
|
||||
</div>
|
||||
|
||||
<!-- 调试信息 -->
|
||||
<div class="text-sm text-gray-500 mb-2">
|
||||
数据数量: {{ resources.length }}, 总数: {{ total }}, 加载状态: {{ loading }}
|
||||
</div>
|
||||
|
||||
<!-- 数据表格 -->
|
||||
<n-data-table
|
||||
:columns="columns"
|
||||
:data="resources"
|
||||
:loading="loading"
|
||||
:pagination="pagination"
|
||||
:remote="true"
|
||||
@update:page="handlePageChange"
|
||||
@update:page-size="handlePageSizeChange"
|
||||
:row-key="(row: any) => row.id"
|
||||
virtual-scroll
|
||||
max-height="500"
|
||||
/>
|
||||
</div>
|
||||
</template>
|
||||
|
||||
<script setup lang="ts">
|
||||
import { ref, reactive, computed, onMounted, h } from 'vue'
|
||||
import { useResourceApi } from '~/composables/useApi'
|
||||
import { useMessage } from 'naive-ui'
|
||||
|
||||
// 消息提示
|
||||
const $message = useMessage()
|
||||
|
||||
// 数据状态
|
||||
const loading = ref(false)
|
||||
const resources = ref<any[]>([])
|
||||
const total = ref(0)
|
||||
const currentPage = ref(1)
|
||||
const pageSize = ref(10000)
|
||||
|
||||
// 搜索条件
|
||||
const searchQuery = ref('')
|
||||
const selectedCategory = ref(null)
|
||||
const selectedTag = ref(null)
|
||||
|
||||
// API实例
|
||||
const resourceApi = useResourceApi()
|
||||
|
||||
// 分页配置
|
||||
const pagination = reactive({
|
||||
page: 1,
|
||||
pageSize: 10000,
|
||||
itemCount: 0,
|
||||
pageSizes: [10000, 20000, 50000, 100000],
|
||||
showSizePicker: true,
|
||||
showQuickJumper: true,
|
||||
prefix: ({ itemCount }: any) => `共 ${itemCount} 条`
|
||||
})
|
||||
|
||||
// 表格列配置
|
||||
const columns: any[] = [
|
||||
{
|
||||
title: 'ID',
|
||||
key: 'id',
|
||||
width: 60,
|
||||
fixed: 'left' as const
|
||||
},
|
||||
{
|
||||
title: '标题',
|
||||
key: 'title',
|
||||
width: 200,
|
||||
ellipsis: {
|
||||
tooltip: true
|
||||
}
|
||||
},
|
||||
{
|
||||
title: '分类',
|
||||
key: 'category_name',
|
||||
width: 80
|
||||
},
|
||||
{
|
||||
title: '平台',
|
||||
key: 'pan_name',
|
||||
width: 80,
|
||||
render: (row: any) => {
|
||||
if (row.pan_id) {
|
||||
const platform = platformOptions.value.find((p: any) => p.value === row.pan_id)
|
||||
return platform?.label || '未知'
|
||||
}
|
||||
return '未知'
|
||||
}
|
||||
},
|
||||
{
|
||||
title: '转存链接',
|
||||
key: 'save_url',
|
||||
width: 200,
|
||||
ellipsis: {
|
||||
tooltip: true
|
||||
},
|
||||
render: (row: any) => {
|
||||
return h('a', {
|
||||
href: row.save_url,
|
||||
target: '_blank',
|
||||
class: 'text-green-500 hover:text-green-700'
|
||||
}, row.save_url.length > 30 ? row.save_url.substring(0, 30) + '...' : row.save_url)
|
||||
}
|
||||
},
|
||||
{
|
||||
title: '转存时间',
|
||||
key: 'updated_at',
|
||||
width: 130,
|
||||
render: (row: any) => {
|
||||
return new Date(row.updated_at).toLocaleDateString()
|
||||
}
|
||||
},
|
||||
{
|
||||
title: '操作',
|
||||
key: 'actions',
|
||||
width: 120,
|
||||
fixed: 'right',
|
||||
render: (row: any) => {
|
||||
return h('div', { class: 'flex space-x-2' }, [
|
||||
h('n-button', {
|
||||
size: 'small',
|
||||
type: 'primary',
|
||||
onClick: () => viewResource(row)
|
||||
}, { default: () => '查看' }),
|
||||
h('n-button', {
|
||||
size: 'small',
|
||||
type: 'info',
|
||||
onClick: () => copyLink(row.save_url)
|
||||
}, { default: () => '复制' })
|
||||
])
|
||||
}
|
||||
}
|
||||
]
|
||||
|
||||
// 平台选项
|
||||
const platformOptions = ref([
|
||||
{ label: '夸克网盘', value: 1 },
|
||||
{ label: '百度网盘', value: 2 },
|
||||
{ label: '阿里云盘', value: 3 },
|
||||
{ label: '天翼云盘', value: 4 },
|
||||
{ label: '迅雷云盘', value: 5 },
|
||||
{ label: '123云盘', value: 6 },
|
||||
{ label: '115网盘', value: 7 },
|
||||
{ label: 'UC网盘', value: 8 }
|
||||
])
|
||||
|
||||
// 获取已转存资源
|
||||
const fetchTransferredResources = async () => {
|
||||
loading.value = true
|
||||
try {
|
||||
const params: any = {
|
||||
page: currentPage.value,
|
||||
page_size: pageSize.value,
|
||||
has_save_url: true // 筛选有转存链接的资源
|
||||
}
|
||||
|
||||
if (searchQuery.value) {
|
||||
params.search = searchQuery.value
|
||||
}
|
||||
if (selectedCategory.value) {
|
||||
params.category_id = selectedCategory.value
|
||||
}
|
||||
|
||||
console.log('请求参数:', params)
|
||||
const result = await resourceApi.getResources(params) as any
|
||||
console.log('已转存资源结果:', result)
|
||||
console.log('结果类型:', typeof result)
|
||||
console.log('结果结构:', Object.keys(result || {}))
|
||||
|
||||
if (result && result.data) {
|
||||
console.log('使用 resources 格式,数量:', result.data.length)
|
||||
resources.value = result.data
|
||||
total.value = result.total || 0
|
||||
pagination.itemCount = result.total || 0
|
||||
} else if (Array.isArray(result)) {
|
||||
console.log('使用数组格式,数量:', result.length)
|
||||
resources.value = result
|
||||
total.value = result.length
|
||||
pagination.itemCount = result.length
|
||||
} else {
|
||||
console.log('未知格式,设置空数组')
|
||||
resources.value = []
|
||||
total.value = 0
|
||||
pagination.itemCount = 0
|
||||
}
|
||||
|
||||
console.log('最终 resources.value:', resources.value)
|
||||
console.log('最终 total.value:', total.value)
|
||||
|
||||
// 检查是否有资源没有 save_url
|
||||
const resourcesWithoutSaveUrl = resources.value.filter((r: any) => !r.save_url || r.save_url.trim() === '')
|
||||
if (resourcesWithoutSaveUrl.length > 0) {
|
||||
console.warn('发现没有 save_url 的资源:', resourcesWithoutSaveUrl.map((r: any) => ({ id: r.id, title: r.title, save_url: r.save_url })))
|
||||
}
|
||||
} catch (error) {
|
||||
console.error('获取已转存资源失败:', error)
|
||||
resources.value = []
|
||||
total.value = 0
|
||||
} finally {
|
||||
loading.value = false
|
||||
}
|
||||
}
|
||||
|
||||
// 搜索处理
|
||||
const handleSearch = () => {
|
||||
currentPage.value = 1
|
||||
pagination.page = 1
|
||||
fetchTransferredResources()
|
||||
}
|
||||
|
||||
// 分页处理
|
||||
const handlePageChange = (page: number) => {
|
||||
currentPage.value = page
|
||||
pagination.page = page
|
||||
fetchTransferredResources()
|
||||
}
|
||||
|
||||
const handlePageSizeChange = (size: number) => {
|
||||
pageSize.value = size
|
||||
pagination.pageSize = size
|
||||
currentPage.value = 1
|
||||
pagination.page = 1
|
||||
fetchTransferredResources()
|
||||
}
|
||||
|
||||
// 查看资源
|
||||
const viewResource = (resource: any) => {
|
||||
// 这里可以打开资源详情模态框
|
||||
console.log('查看资源:', resource)
|
||||
}
|
||||
|
||||
// 复制链接
|
||||
const copyLink = async (url: string) => {
|
||||
try {
|
||||
await navigator.clipboard.writeText(url)
|
||||
$message.success('链接已复制到剪贴板')
|
||||
} catch (error) {
|
||||
console.error('复制失败:', error)
|
||||
$message.error('复制失败')
|
||||
}
|
||||
}
|
||||
|
||||
// 初始化
|
||||
onMounted(() => {
|
||||
fetchTransferredResources()
|
||||
})
|
||||
</script>
|
||||
614
web/components/Admin/UntransferredList.vue
Normal file
@@ -0,0 +1,614 @@
|
||||
<template>
|
||||
<div class="space-y-4">
|
||||
<!-- 搜索和筛选 -->
|
||||
<div class="grid grid-cols-1 md:grid-cols-5 gap-4">
|
||||
<n-input
|
||||
v-model:value="searchQuery"
|
||||
placeholder="搜索未转存资源..."
|
||||
@keyup.enter="handleSearch"
|
||||
clearable
|
||||
>
|
||||
<template #prefix>
|
||||
<i class="fas fa-search"></i>
|
||||
</template>
|
||||
</n-input>
|
||||
|
||||
<CategorySelector
|
||||
v-model="selectedCategory"
|
||||
placeholder="选择分类"
|
||||
clearable
|
||||
/>
|
||||
|
||||
<TagSelector
|
||||
v-model="selectedTag"
|
||||
placeholder="选择标签"
|
||||
clearable
|
||||
/>
|
||||
|
||||
<n-select
|
||||
v-model:value="selectedStatus"
|
||||
placeholder="资源状态"
|
||||
:options="statusOptions"
|
||||
clearable
|
||||
/>
|
||||
|
||||
<n-button type="primary" @click="handleSearch">
|
||||
<template #icon>
|
||||
<i class="fas fa-search"></i>
|
||||
</template>
|
||||
搜索
|
||||
</n-button>
|
||||
</div>
|
||||
|
||||
<!-- 批量操作 -->
|
||||
<n-card>
|
||||
<div class="flex items-center justify-between">
|
||||
<div class="flex items-center space-x-4">
|
||||
<div class="flex items-center space-x-2">
|
||||
<n-checkbox
|
||||
:checked="isAllSelected"
|
||||
@update:checked="toggleSelectAll"
|
||||
:indeterminate="isIndeterminate"
|
||||
/>
|
||||
<span class="text-sm text-gray-600 dark:text-gray-400">全选</span>
|
||||
</div>
|
||||
<span class="text-sm text-gray-500">
|
||||
共 {{ total }} 个资源,已选择 {{ selectedResources.length }} 个
|
||||
</span>
|
||||
</div>
|
||||
|
||||
<div class="flex space-x-2">
|
||||
<n-button
|
||||
type="primary"
|
||||
:disabled="selectedResources.length === 0"
|
||||
:loading="batchTransferring"
|
||||
@click="handleBatchTransfer"
|
||||
>
|
||||
<template #icon>
|
||||
<i class="fas fa-exchange-alt"></i>
|
||||
</template>
|
||||
批量转存 ({{ selectedResources.length }})
|
||||
</n-button>
|
||||
|
||||
<n-button @click="refreshData">
|
||||
<template #icon>
|
||||
<i class="fas fa-refresh"></i>
|
||||
</template>
|
||||
刷新
|
||||
</n-button>
|
||||
</div>
|
||||
</div>
|
||||
</n-card>
|
||||
|
||||
<!-- 资源列表 -->
|
||||
<n-card>
|
||||
<div v-if="loading" class="flex items-center justify-center py-8">
|
||||
<n-spin size="large" />
|
||||
</div>
|
||||
|
||||
<div v-else-if="resources.length === 0" class="text-center py-8">
|
||||
<i class="fas fa-inbox text-4xl text-gray-400 mb-4"></i>
|
||||
<p class="text-gray-500">暂无未转存的夸克资源</p>
|
||||
</div>
|
||||
|
||||
<div v-else>
|
||||
<!-- 虚拟列表 -->
|
||||
<n-virtual-list
|
||||
:items="resources"
|
||||
:item-size="120"
|
||||
style="max-height: 500px"
|
||||
container-style="height: 500px;"
|
||||
>
|
||||
<template #default="{ item }">
|
||||
<div class="p-4 border-b border-gray-200 dark:border-gray-700 hover:bg-gray-50 dark:hover:bg-gray-800">
|
||||
<div class="flex items-start space-x-4">
|
||||
<!-- 选择框 -->
|
||||
<div class="pt-2">
|
||||
<n-checkbox
|
||||
:checked="selectedResources.includes(item.id)"
|
||||
@update:checked="(checked) => toggleResourceSelection(item.id, checked)"
|
||||
/>
|
||||
</div>
|
||||
|
||||
<!-- 资源信息 -->
|
||||
<div class="flex-1 min-w-0">
|
||||
<div class="flex items-start justify-between">
|
||||
<div class="flex-1 min-w-0">
|
||||
<!-- 标题和状态 -->
|
||||
<div class="flex items-center space-x-2 mb-2">
|
||||
<h3 class="text-lg font-medium text-gray-900 dark:text-white line-clamp-1">
|
||||
{{ item.title || '未命名资源' }}
|
||||
</h3>
|
||||
<n-tag :type="getStatusType(item)" size="small">
|
||||
{{ getStatusText(item) }}
|
||||
</n-tag>
|
||||
</div>
|
||||
|
||||
<!-- 描述 -->
|
||||
<p class="text-gray-600 dark:text-gray-400 text-sm line-clamp-2 mb-2">
|
||||
{{ item.description || '暂无描述' }}
|
||||
</p>
|
||||
|
||||
<!-- 元信息 -->
|
||||
<div class="flex items-center space-x-4 text-sm text-gray-500">
|
||||
<span class="flex items-center">
|
||||
<i class="fas fa-folder mr-1"></i>
|
||||
{{ item.category_name || '未分类' }}
|
||||
</span>
|
||||
<span class="flex items-center">
|
||||
<i class="fas fa-cloud mr-1"></i>
|
||||
夸克网盘
|
||||
</span>
|
||||
<span class="flex items-center">
|
||||
<i class="fas fa-eye mr-1"></i>
|
||||
{{ item.view_count || 0 }} 次浏览
|
||||
</span>
|
||||
<span class="flex items-center">
|
||||
<i class="fas fa-calendar mr-1"></i>
|
||||
{{ formatDate(item.created_at) }}
|
||||
</span>
|
||||
</div>
|
||||
|
||||
<!-- 原始链接 -->
|
||||
<div class="mt-2">
|
||||
<div class="flex items-center space-x-2">
|
||||
<span class="text-xs text-gray-400">原始链接:</span>
|
||||
<a
|
||||
:href="item.url"
|
||||
target="_blank"
|
||||
class="text-xs text-blue-500 hover:text-blue-700 truncate max-w-xs"
|
||||
>
|
||||
{{ item.url }}
|
||||
</a>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</template>
|
||||
</n-virtual-list>
|
||||
|
||||
<!-- 分页 -->
|
||||
<div class="mt-4 flex justify-center">
|
||||
<n-pagination
|
||||
v-model:page="currentPage"
|
||||
v-model:page-size="pageSize"
|
||||
:item-count="total"
|
||||
:page-sizes="[10000, 20000, 50000, 100000]"
|
||||
show-size-picker
|
||||
show-quick-jumper
|
||||
@update:page="handlePageChange"
|
||||
@update:page-size="handlePageSizeChange"
|
||||
/>
|
||||
</div>
|
||||
</div>
|
||||
</n-card>
|
||||
|
||||
<!-- 网盘账号选择模态框 -->
|
||||
<n-modal v-model:show="showAccountSelectionModal" preset="card" title="选择网盘账号" style="width: 600px">
|
||||
<div class="space-y-4">
|
||||
<div class="text-sm text-gray-600 dark:text-gray-400">
|
||||
请选择要使用的网盘账号进行批量转存操作
|
||||
</div>
|
||||
|
||||
<div>
|
||||
<label class="block text-sm font-medium text-gray-700 dark:text-gray-300 mb-2">
|
||||
网盘账号 <span class="text-red-500">*</span>
|
||||
</label>
|
||||
<n-select
|
||||
v-model:value="selectedAccounts"
|
||||
:options="accountOptions"
|
||||
placeholder="选择网盘账号"
|
||||
multiple
|
||||
filterable
|
||||
:loading="accountsLoading"
|
||||
@update:value="handleAccountChange"
|
||||
>
|
||||
<template #option="{ option: accountOption }">
|
||||
<div class="flex items-center justify-between w-full">
|
||||
<div class="flex items-center space-x-2">
|
||||
<span class="text-sm">{{ accountOption.label }}</span>
|
||||
<n-tag v-if="accountOption.is_valid" type="success" size="small">有效</n-tag>
|
||||
<n-tag v-else type="error" size="small">无效</n-tag>
|
||||
</div>
|
||||
<div class="text-xs text-gray-500">
|
||||
{{ formatSpace(accountOption.left_space) }}
|
||||
</div>
|
||||
</div>
|
||||
</template>
|
||||
</n-select>
|
||||
<div class="text-xs text-gray-500 mt-1">
|
||||
请选择要使用的网盘账号,系统将使用选中的账号进行转存操作
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div class="bg-yellow-50 dark:bg-yellow-900/20 p-3 rounded border border-yellow-200 dark:border-yellow-800">
|
||||
<div class="flex items-start space-x-2">
|
||||
<i class="fas fa-exclamation-triangle text-yellow-500 mt-0.5"></i>
|
||||
<div class="text-sm text-yellow-800 dark:text-yellow-200">
|
||||
<p>• 转存过程可能需要较长时间</p>
|
||||
<p>• 请确保选中的网盘账号有足够的存储空间</p>
|
||||
<p>• 转存完成后可在"已转存列表"中查看结果</p>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<template #footer>
|
||||
<div class="flex justify-end space-x-3">
|
||||
<n-button @click="showAccountSelectionModal = false">
|
||||
取消
|
||||
</n-button>
|
||||
<n-button
|
||||
type="primary"
|
||||
:disabled="selectedAccounts.length === 0"
|
||||
:loading="batchTransferring"
|
||||
@click="confirmBatchTransfer"
|
||||
>
|
||||
{{ batchTransferring ? '创建任务中...' : '继续' }}
|
||||
</n-button>
|
||||
</div>
|
||||
</template>
|
||||
</n-modal>
|
||||
|
||||
<!-- 转存结果模态框 -->
|
||||
<n-modal v-model:show="showTransferResult" preset="card" title="转存结果" style="width: 600px">
|
||||
<div v-if="transferResults.length > 0" class="space-y-4">
|
||||
<div class="grid grid-cols-3 gap-4">
|
||||
<div class="text-center p-3 bg-green-50 dark:bg-green-900/20 rounded-lg">
|
||||
<div class="text-xl font-bold text-green-600">{{ transferSuccessCount }}</div>
|
||||
<div class="text-sm text-gray-600 dark:text-gray-400">成功</div>
|
||||
</div>
|
||||
<div class="text-center p-3 bg-red-50 dark:bg-red-900/20 rounded-lg">
|
||||
<div class="text-xl font-bold text-red-600">{{ transferFailedCount }}</div>
|
||||
<div class="text-sm text-gray-600 dark:text-gray-400">失败</div>
|
||||
</div>
|
||||
<div class="text-center p-3 bg-blue-50 dark:bg-blue-900/20 rounded-lg">
|
||||
<div class="text-xl font-bold text-blue-600">{{ transferResults.length }}</div>
|
||||
<div class="text-sm text-gray-600 dark:text-gray-400">总计</div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div class="max-h-300 overflow-y-auto">
|
||||
<div v-for="result in transferResults" :key="result.id" class="p-3 border rounded mb-2">
|
||||
<div class="flex items-center justify-between">
|
||||
<div class="flex-1 min-w-0">
|
||||
<div class="text-sm font-medium truncate">{{ result.title }}</div>
|
||||
<div class="text-xs text-gray-500 truncate">{{ result.url }}</div>
|
||||
</div>
|
||||
<n-tag :type="result.success ? 'success' : 'error'" size="small">
|
||||
{{ result.success ? '成功' : '失败' }}
|
||||
</n-tag>
|
||||
</div>
|
||||
<div v-if="result.message" class="text-xs text-gray-600 mt-1">
|
||||
{{ result.message }}
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</n-modal>
|
||||
</div>
|
||||
</template>
|
||||
|
||||
<script setup lang="ts">
|
||||
import { ref, reactive, computed, onMounted } from 'vue'
|
||||
import { useResourceApi, useCategoryApi, useTagApi, useCksApi, useTaskApi } from '~/composables/useApi'
|
||||
import { useMessage } from 'naive-ui'
|
||||
|
||||
// 数据状态
|
||||
const loading = ref(false)
|
||||
const resources = ref([])
|
||||
const total = ref(0)
|
||||
const currentPage = ref(1)
|
||||
const pageSize = ref(2000)
|
||||
|
||||
// 搜索条件
|
||||
const searchQuery = ref('')
|
||||
const selectedCategory = ref(null)
|
||||
const selectedTag = ref(null)
|
||||
const selectedStatus = ref(null)
|
||||
|
||||
// 选择状态
|
||||
const selectedResources = ref([])
|
||||
|
||||
// 批量操作状态
|
||||
const batchTransferring = ref(false)
|
||||
const showTransferResult = ref(false)
|
||||
const transferResults = ref([])
|
||||
const showAccountSelectionModal = ref(false)
|
||||
const selectedAccounts = ref<number[]>([])
|
||||
const accountOptions = ref<any[]>([])
|
||||
const accountsLoading = ref(false)
|
||||
|
||||
// 选项数据
|
||||
const categoryOptions = ref([])
|
||||
const tagOptions = ref([])
|
||||
const statusOptions = [
|
||||
{ label: '有效', value: 'valid' },
|
||||
{ label: '无效', value: 'invalid' },
|
||||
{ label: '待验证', value: 'pending' }
|
||||
]
|
||||
|
||||
// API实例
|
||||
const resourceApi = useResourceApi()
|
||||
const categoryApi = useCategoryApi()
|
||||
const tagApi = useTagApi()
|
||||
const cksApi = useCksApi()
|
||||
const taskApi = useTaskApi()
|
||||
const message = useMessage()
|
||||
|
||||
// 计算属性
|
||||
const isAllSelected = computed(() => {
|
||||
return resources.value.length > 0 && selectedResources.value.length === resources.value.length
|
||||
})
|
||||
|
||||
const isIndeterminate = computed(() => {
|
||||
return selectedResources.value.length > 0 && selectedResources.value.length < resources.value.length
|
||||
})
|
||||
|
||||
const transferSuccessCount = computed(() => {
|
||||
return transferResults.value.filter(r => r.success).length
|
||||
})
|
||||
|
||||
const transferFailedCount = computed(() => {
|
||||
return transferResults.value.filter(r => !r.success).length
|
||||
})
|
||||
|
||||
// 获取未转存资源(夸克网盘且无save_url)
|
||||
const fetchUntransferredResources = async () => {
|
||||
loading.value = true
|
||||
try {
|
||||
const params = {
|
||||
page: currentPage.value,
|
||||
page_size: pageSize.value,
|
||||
no_save_url: true, // 筛选没有转存链接的资源
|
||||
pan_name: 'quark' // 仅夸克网盘资源
|
||||
}
|
||||
|
||||
if (searchQuery.value) {
|
||||
params.search = searchQuery.value
|
||||
}
|
||||
if (selectedCategory.value) {
|
||||
params.category_id = selectedCategory.value
|
||||
}
|
||||
|
||||
const result = await resourceApi.getResources(params) as any
|
||||
console.log('未转存资源结果:', result)
|
||||
|
||||
if (result && result.data) {
|
||||
resources.value = result.data
|
||||
total.value = result.total || 0
|
||||
} else if (Array.isArray(result)) {
|
||||
resources.value = result
|
||||
total.value = result.length
|
||||
}
|
||||
|
||||
// 清空选择
|
||||
selectedResources.value = []
|
||||
} catch (error) {
|
||||
console.error('获取未转存资源失败:', error)
|
||||
resources.value = []
|
||||
total.value = 0
|
||||
} finally {
|
||||
loading.value = false
|
||||
}
|
||||
}
|
||||
|
||||
// 获取分类选项
|
||||
const fetchCategories = async () => {
|
||||
try {
|
||||
const result = await categoryApi.getCategories() as any
|
||||
if (result && result.items) {
|
||||
categoryOptions.value = result.items.map((item: any) => ({
|
||||
label: item.name,
|
||||
value: item.id
|
||||
}))
|
||||
}
|
||||
} catch (error) {
|
||||
console.error('获取分类失败:', error)
|
||||
}
|
||||
}
|
||||
|
||||
// 获取标签选项
|
||||
const fetchTags = async () => {
|
||||
try {
|
||||
const result = await tagApi.getTags() as any
|
||||
if (result && result.items) {
|
||||
tagOptions.value = result.items.map((item: any) => ({
|
||||
label: item.name,
|
||||
value: item.id
|
||||
}))
|
||||
}
|
||||
} catch (error) {
|
||||
console.error('获取标签失败:', error)
|
||||
}
|
||||
}
|
||||
|
||||
// 获取网盘账号选项
|
||||
const getAccountOptions = async () => {
|
||||
accountsLoading.value = true
|
||||
try {
|
||||
const response = await cksApi.getCks() as any
|
||||
const accounts = Array.isArray(response) ? response : []
|
||||
|
||||
accountOptions.value = accounts.map((account: any) => ({
|
||||
label: `${account.username || '未知用户'} (${account.pan?.name || '未知平台'})`,
|
||||
value: account.id,
|
||||
is_valid: account.is_valid,
|
||||
left_space: account.left_space,
|
||||
username: account.username,
|
||||
pan_name: account.pan?.name || '未知平台'
|
||||
}))
|
||||
} catch (error) {
|
||||
console.error('获取网盘账号选项失败:', error)
|
||||
message.error('获取网盘账号失败')
|
||||
} finally {
|
||||
accountsLoading.value = false
|
||||
}
|
||||
}
|
||||
|
||||
// 处理账号选择变化
|
||||
const handleAccountChange = (value: number[]) => {
|
||||
selectedAccounts.value = value
|
||||
console.log('选择的账号:', value)
|
||||
}
|
||||
|
||||
// 格式化空间大小
|
||||
const formatSpace = (bytes: number) => {
|
||||
if (bytes === 0) return '0 B'
|
||||
const k = 1024
|
||||
const sizes = ['B', 'KB', 'MB', 'GB', 'TB']
|
||||
const i = Math.floor(Math.log(bytes) / Math.log(k))
|
||||
return parseFloat((bytes / Math.pow(k, i)).toFixed(2)) + ' ' + sizes[i]
|
||||
}
|
||||
|
||||
// 搜索处理
|
||||
const handleSearch = () => {
|
||||
currentPage.value = 1
|
||||
fetchUntransferredResources()
|
||||
}
|
||||
|
||||
// 刷新数据
|
||||
const refreshData = () => {
|
||||
fetchUntransferredResources()
|
||||
}
|
||||
|
||||
// 分页处理
|
||||
const handlePageChange = (page: number) => {
|
||||
currentPage.value = page
|
||||
fetchUntransferredResources()
|
||||
}
|
||||
|
||||
const handlePageSizeChange = (size: number) => {
|
||||
pageSize.value = size
|
||||
currentPage.value = 1
|
||||
fetchUntransferredResources()
|
||||
}
|
||||
|
||||
// 选择处理
|
||||
const toggleSelectAll = (checked: boolean) => {
|
||||
if (checked) {
|
||||
selectedResources.value = resources.value.map(r => r.id)
|
||||
} else {
|
||||
selectedResources.value = []
|
||||
}
|
||||
}
|
||||
|
||||
const toggleResourceSelection = (id: number, checked: boolean) => {
|
||||
if (checked) {
|
||||
if (!selectedResources.value.includes(id)) {
|
||||
selectedResources.value.push(id)
|
||||
}
|
||||
} else {
|
||||
const index = selectedResources.value.indexOf(id)
|
||||
if (index > -1) {
|
||||
selectedResources.value.splice(index, 1)
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
|
||||
|
||||
// 批量转存
|
||||
const handleBatchTransfer = async () => {
|
||||
if (selectedResources.value.length === 0) {
|
||||
message.warning('请选择要转存的资源')
|
||||
return
|
||||
}
|
||||
|
||||
// 先获取网盘账号列表
|
||||
await getAccountOptions()
|
||||
|
||||
// 显示账号选择模态框
|
||||
showAccountSelectionModal.value = true
|
||||
}
|
||||
|
||||
|
||||
|
||||
// 获取状态类型
|
||||
const getStatusType = (resource: any) => {
|
||||
if (resource.is_valid === false) return 'error'
|
||||
if (resource.is_valid === true) return 'success'
|
||||
return 'warning'
|
||||
}
|
||||
|
||||
// 获取状态文本
|
||||
const getStatusText = (resource: any) => {
|
||||
if (resource.is_valid === false) return '无效'
|
||||
if (resource.is_valid === true) return '有效'
|
||||
return '待验证'
|
||||
}
|
||||
|
||||
// 格式化日期
|
||||
const formatDate = (dateString: string) => {
|
||||
return new Date(dateString).toLocaleDateString()
|
||||
}
|
||||
|
||||
// 确认批量转存
|
||||
const confirmBatchTransfer = async () => {
|
||||
if (selectedAccounts.value.length === 0) {
|
||||
message.warning('请选择至少一个网盘账号')
|
||||
return
|
||||
}
|
||||
|
||||
batchTransferring.value = true
|
||||
try {
|
||||
const selectedItems = resources.value.filter(r => selectedResources.value.includes(r.id))
|
||||
|
||||
const taskData = {
|
||||
title: `批量转存 ${selectedItems.length} 个资源`,
|
||||
description: `批量转存 ${selectedItems.length} 个资源,使用 ${selectedAccounts.value.length} 个账号`,
|
||||
resources: selectedItems.map(r => ({
|
||||
title: r.title,
|
||||
url: r.url,
|
||||
category_id: r.category_id || 0,
|
||||
pan_id: r.pan_id || 0
|
||||
})),
|
||||
selected_accounts: selectedAccounts.value
|
||||
}
|
||||
|
||||
const response = await taskApi.createBatchTransferTask(taskData) as any
|
||||
message.success(`批量转存任务已创建,共 ${selectedItems.length} 个资源`)
|
||||
|
||||
// 关闭模态框
|
||||
showAccountSelectionModal.value = false
|
||||
selectedAccounts.value = []
|
||||
|
||||
// 刷新列表
|
||||
refreshData()
|
||||
|
||||
} catch (error) {
|
||||
console.error('创建批量转存任务失败:', error)
|
||||
message.error('创建批量转存任务失败')
|
||||
} finally {
|
||||
batchTransferring.value = false
|
||||
}
|
||||
}
|
||||
|
||||
// 初始化
|
||||
onMounted(() => {
|
||||
fetchCategories()
|
||||
fetchTags()
|
||||
fetchUntransferredResources()
|
||||
})
|
||||
</script>
|
||||
|
||||
<style scoped>
|
||||
.line-clamp-1 {
|
||||
display: -webkit-box;
|
||||
-webkit-line-clamp: 1;
|
||||
-webkit-box-orient: vertical;
|
||||
overflow: hidden;
|
||||
}
|
||||
|
||||
.line-clamp-2 {
|
||||
display: -webkit-box;
|
||||
-webkit-line-clamp: 2;
|
||||
-webkit-box-orient: vertical;
|
||||
overflow: hidden;
|
||||
}
|
||||
</style>
|
||||
@@ -1,6 +1,6 @@
|
||||
<template>
|
||||
<footer class="mt-auto py-6 border-t border-gray-200 dark:border-gray-700 bg-white dark:bg-gray-800">
|
||||
<div class="max-w-7xl mx-auto text-center text-gray-600 dark:text-gray-400 text-sm px-3 sm:px-5">
|
||||
<footer class="footer-container mt-auto py-6 border-t border-gray-700 bg-white dark:bg-gray-800">
|
||||
<div class="max-w-7xl mx-auto text-center text-gray-400 text-sm px-3 sm:px-5">
|
||||
<p class="mb-2">本站内容由网络爬虫自动抓取。本站不储存、复制、传播任何文件,仅作个人公益学习,请在获取后24小内删除!!!</p>
|
||||
<p class="flex items-center justify-center gap-2">
|
||||
<span>{{ systemConfig?.copyright || '© 2025 老九网盘资源数据库 By 老九' }}</span>
|
||||
@@ -35,4 +35,15 @@ const systemConfig = computed(() => (systemConfigData.value as any) || { copyrig
|
||||
onMounted(() => {
|
||||
fetchVersionInfo()
|
||||
})
|
||||
</script>
|
||||
</script>
|
||||
|
||||
<style scoped>
|
||||
.footer-container{
|
||||
background: url(/assets/images/footer-banner.webp) center top/cover no-repeat,
|
||||
linear-gradient(
|
||||
to bottom,
|
||||
rgba(0,0,0,0.1) 0%,
|
||||
rgba(0,0,0,0.25) 100%
|
||||
);
|
||||
}
|
||||
</style>
|
||||
105
web/components/CategorySelector.vue
Normal file
@@ -0,0 +1,105 @@
|
||||
<template>
|
||||
<n-select
|
||||
v-model:value="selectedValue"
|
||||
:placeholder="placeholder"
|
||||
:options="categoryOptions"
|
||||
:loading="loading"
|
||||
:clearable="clearable"
|
||||
:filterable="true"
|
||||
:disabled="disabled"
|
||||
@update:value="handleUpdate"
|
||||
/>
|
||||
</template>
|
||||
|
||||
<script setup lang="ts">
|
||||
import { ref, watch, onMounted } from 'vue'
|
||||
import { useCategoryApi } from '~/composables/useApi'
|
||||
|
||||
// Props定义
|
||||
interface Props {
|
||||
modelValue?: number | null
|
||||
placeholder?: string
|
||||
clearable?: boolean
|
||||
disabled?: boolean
|
||||
}
|
||||
|
||||
const props = withDefaults(defineProps<Props>(), {
|
||||
placeholder: '选择分类',
|
||||
clearable: true,
|
||||
disabled: false
|
||||
})
|
||||
|
||||
// Emits定义
|
||||
const emit = defineEmits<{
|
||||
'update:modelValue': [value: number | null]
|
||||
}>()
|
||||
|
||||
// 定义选项类型
|
||||
interface CategoryOption {
|
||||
label: string
|
||||
value: number
|
||||
disabled: boolean
|
||||
}
|
||||
|
||||
// 内部状态
|
||||
const selectedValue = ref(props.modelValue)
|
||||
const categoryOptions = ref<CategoryOption[]>([])
|
||||
const loading = ref(false)
|
||||
|
||||
// API实例
|
||||
const categoryApi = useCategoryApi()
|
||||
|
||||
// 监听外部值变化
|
||||
watch(
|
||||
() => props.modelValue,
|
||||
(newValue) => {
|
||||
selectedValue.value = newValue
|
||||
}
|
||||
)
|
||||
|
||||
// 监听内部值变化并向外发射
|
||||
const handleUpdate = (value: number | null) => {
|
||||
selectedValue.value = value
|
||||
emit('update:modelValue', value)
|
||||
}
|
||||
|
||||
// 加载分类数据
|
||||
const loadCategories = async () => {
|
||||
// 如果已经加载过,直接返回
|
||||
if (categoryOptions.value.length > 0) {
|
||||
return
|
||||
}
|
||||
|
||||
loading.value = true
|
||||
try {
|
||||
const result = await categoryApi.getCategories() as any
|
||||
|
||||
const options: CategoryOption[] = []
|
||||
if (result && result.items) {
|
||||
options.push(...result.items.map((item: any) => ({
|
||||
label: item.name,
|
||||
value: item.id,
|
||||
disabled: false
|
||||
})))
|
||||
} else if (Array.isArray(result)) {
|
||||
options.push(...result.map((item: any) => ({
|
||||
label: item.name,
|
||||
value: item.id,
|
||||
disabled: false
|
||||
})))
|
||||
}
|
||||
|
||||
categoryOptions.value = options
|
||||
} catch (error) {
|
||||
console.error('获取分类失败:', error)
|
||||
categoryOptions.value = []
|
||||
} finally {
|
||||
loading.value = false
|
||||
}
|
||||
}
|
||||
|
||||
// 组件挂载时立即加载分类
|
||||
onMounted(() => {
|
||||
loadCategories()
|
||||
})
|
||||
</script>
|
||||
@@ -1,58 +0,0 @@
|
||||
<template>
|
||||
<div v-if="show" class="fixed top-4 right-4 z-50">
|
||||
<div class="bg-red-50 border border-red-200 rounded-lg p-4 shadow-lg max-w-sm">
|
||||
<div class="flex items-start">
|
||||
<div class="flex-shrink-0">
|
||||
<i class="fas fa-exclamation-circle text-red-400"></i>
|
||||
</div>
|
||||
<div class="ml-3 flex-1">
|
||||
<h3 class="text-sm font-medium text-red-800">错误</h3>
|
||||
<div class="mt-1 text-sm text-red-700">
|
||||
{{ message }}
|
||||
</div>
|
||||
</div>
|
||||
<div class="ml-4 flex-shrink-0">
|
||||
<button
|
||||
@click="close"
|
||||
class="inline-flex text-red-400 hover:text-red-600 focus:outline-none"
|
||||
>
|
||||
<i class="fas fa-times"></i>
|
||||
</button>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</template>
|
||||
|
||||
<script setup lang="ts">
|
||||
import { ref, onMounted } from 'vue'
|
||||
|
||||
interface Props {
|
||||
message: string
|
||||
duration?: number
|
||||
}
|
||||
|
||||
const props = withDefaults(defineProps<Props>(), {
|
||||
duration: 5000
|
||||
})
|
||||
|
||||
const emit = defineEmits<{
|
||||
close: []
|
||||
}>()
|
||||
|
||||
const show = ref(false)
|
||||
|
||||
const close = () => {
|
||||
show.value = false
|
||||
emit('close')
|
||||
}
|
||||
|
||||
onMounted(() => {
|
||||
show.value = true
|
||||
if (props.duration > 0) {
|
||||
setTimeout(() => {
|
||||
close()
|
||||
}, props.duration)
|
||||
}
|
||||
})
|
||||
</script>
|
||||
121
web/components/ForbiddenPage.vue
Normal file
@@ -0,0 +1,121 @@
|
||||
<template>
|
||||
<div class="forbidden-page">
|
||||
<div class="top-bar-guidance">
|
||||
<p class="top-bar-guidance-text">请按提示在手机 浏览器 打开<img src="/assets/images/3dian.png" class="icon-safari"></p>
|
||||
<p class="top-bar-guidance-text">苹果设备<img src="/assets/images/iphone.png" class="icon-safari">↗↗↗</p>
|
||||
<p class="top-bar-guidance-text">安卓设备<img src="/assets/images/android.png" class="icon-safari">↗↗↗</p>
|
||||
</div>
|
||||
|
||||
<div id="contens">
|
||||
<p><br/><br/></p>
|
||||
<p>1.本站不支持 微信,QQ等APP 内访问</p>
|
||||
<p><br/></p>
|
||||
<p>2.请按提示在手机 浏览器 打开</p>
|
||||
<p id="device-tip"><br/>3.请在浏览器中打开</p>
|
||||
</div>
|
||||
|
||||
<p><br/><br/></p>
|
||||
<div class="app-download-tip">
|
||||
<span class="guidance-desc" id="current-url"></span>
|
||||
</div>
|
||||
<p><br/></p>
|
||||
<div class="app-download-tip">
|
||||
<span class="guidance-desc">点击右上角···图标 or 复制网址自行打开</span>
|
||||
</div>
|
||||
</div>
|
||||
</template>
|
||||
|
||||
<script setup lang="ts">
|
||||
import { onMounted } from 'vue'
|
||||
|
||||
// 组件属性
|
||||
interface Props {
|
||||
currentUrl?: string
|
||||
isIOS?: boolean
|
||||
}
|
||||
|
||||
const props = withDefaults(defineProps<Props>(), {
|
||||
currentUrl: '',
|
||||
isIOS: false
|
||||
})
|
||||
|
||||
// 在组件挂载时设置内容
|
||||
onMounted(() => {
|
||||
const currentUrlElement = document.getElementById('current-url')
|
||||
const deviceTipElement = document.getElementById('device-tip')
|
||||
|
||||
if (currentUrlElement) {
|
||||
currentUrlElement.textContent = props.currentUrl || window.location.href
|
||||
}
|
||||
|
||||
if (deviceTipElement) {
|
||||
const deviceText = props.isIOS ? '苹果设备请在Safari浏览器中打开' : '安卓设备请在Chrome或其他浏览器中打开'
|
||||
deviceTipElement.innerHTML = `<br/>3.${deviceText}`
|
||||
}
|
||||
})
|
||||
</script>
|
||||
|
||||
<style scoped>
|
||||
.forbidden-page {
|
||||
min-height: 100vh;
|
||||
}
|
||||
|
||||
.top-bar-guidance {
|
||||
font-size: 15px;
|
||||
color: #fff;
|
||||
height: 70%;
|
||||
line-height: 1.2;
|
||||
padding-left: 20px;
|
||||
padding-top: 20px;
|
||||
background: url('/assets/images/banner.png') center top/cover no-repeat;
|
||||
}
|
||||
|
||||
.top-bar-guidance p {
|
||||
white-space: nowrap;
|
||||
overflow: hidden;
|
||||
text-overflow: ellipsis;
|
||||
}
|
||||
|
||||
.top-bar-guidance .icon-safari {
|
||||
width: 25px;
|
||||
height: 25px;
|
||||
vertical-align: middle;
|
||||
margin: 0 .2em;
|
||||
}
|
||||
|
||||
.top-bar-guidance-text {
|
||||
display: flex;
|
||||
justify-items: center;
|
||||
word-wrap: nowrap;
|
||||
}
|
||||
|
||||
.top-bar-guidance-text img {
|
||||
display: inline-block;
|
||||
width: 25px;
|
||||
height: 25px;
|
||||
vertical-align: middle;
|
||||
margin: 0 .2em;
|
||||
}
|
||||
|
||||
#contens {
|
||||
font-weight: bold;
|
||||
color: #2466f4;
|
||||
text-align: center;
|
||||
font-size: 20px;
|
||||
margin-bottom: 125px;
|
||||
}
|
||||
|
||||
.app-download-tip {
|
||||
margin: 0 auto;
|
||||
width: 290px;
|
||||
text-align: center;
|
||||
font-size: 15px;
|
||||
color: #2466f4;
|
||||
background: url(data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAAcAQMAAACak0ePAAAABlBMVEUAAAAdYfh+GakkAAAAAXRSTlMAQObYZgAAAA5JREFUCNdjwA8acEkAAAy4AIE4hQq/AAAAAElFTkSuQmCC) left center/auto 15px repeat-x;
|
||||
}
|
||||
|
||||
.app-download-tip .guidance-desc {
|
||||
background-color: #fff;
|
||||
padding: 0 5px;
|
||||
}
|
||||
</style>
|
||||
51
web/components/LoadingState.vue
Normal file
@@ -0,0 +1,51 @@
|
||||
<template>
|
||||
<div class="loading-container">
|
||||
<div class="loading-spinner"></div>
|
||||
<p class="loading-text">{{ message }}</p>
|
||||
</div>
|
||||
</template>
|
||||
|
||||
<script setup lang="ts">
|
||||
// 组件属性
|
||||
interface Props {
|
||||
message?: string
|
||||
}
|
||||
|
||||
const props = withDefaults(defineProps<Props>(), {
|
||||
message: '正在检测访问环境...'
|
||||
})
|
||||
</script>
|
||||
|
||||
<style scoped>
|
||||
.loading-container {
|
||||
display: flex;
|
||||
flex-direction: column;
|
||||
align-items: center;
|
||||
justify-content: center;
|
||||
height: 100vh;
|
||||
background: url('/assets/images/banner.webp') center / cover no-repeat;
|
||||
}
|
||||
|
||||
.loading-spinner {
|
||||
width: 50px;
|
||||
height: 50px;
|
||||
border: 4px solid rgba(255, 255, 255, 0.3);
|
||||
border-top: 4px solid #ffffff;
|
||||
border-radius: 50%;
|
||||
animation: spin 1s linear infinite;
|
||||
margin-bottom: 20px;
|
||||
}
|
||||
|
||||
.loading-text {
|
||||
color: #ffffff;
|
||||
font-size: 16px;
|
||||
font-weight: 500;
|
||||
text-align: center;
|
||||
margin: 0;
|
||||
}
|
||||
|
||||
@keyframes spin {
|
||||
0% { transform: rotate(0deg); }
|
||||
100% { transform: rotate(360deg); }
|
||||
}
|
||||
</style>
|
||||
@@ -14,8 +14,22 @@
|
||||
</div>
|
||||
|
||||
<div class="text-center">
|
||||
<!-- 移动端:所有链接都显示链接文本和操作按钮 -->
|
||||
<div v-if="isMobile" class="space-y-4">
|
||||
<!-- 加载状态 -->
|
||||
<div v-if="loading" class="space-y-4">
|
||||
<div class="flex flex-col items-center justify-center py-8">
|
||||
<div class="animate-spin rounded-full h-12 w-12 border-b-2 border-blue-600 mb-4"></div>
|
||||
<p class="text-sm text-gray-600 dark:text-gray-400">正在获取链接...</p>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- 错误状态 -->
|
||||
<div v-else-if="error" class="space-y-4">
|
||||
<div class="bg-red-50 dark:bg-red-900/20 p-4 rounded-lg">
|
||||
<div class="flex items-center">
|
||||
<i class="fas fa-exclamation-triangle text-red-500 mr-2"></i>
|
||||
<p class="text-sm text-red-700 dark:text-red-300">{{ error }}</p>
|
||||
</div>
|
||||
</div>
|
||||
<div class="bg-gray-50 dark:bg-gray-700 p-4 rounded-lg">
|
||||
<p class="text-sm text-gray-700 dark:text-gray-300 break-all">{{ url }}</p>
|
||||
</div>
|
||||
@@ -35,8 +49,47 @@
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- 正常显示 -->
|
||||
<div v-else>
|
||||
<!-- 移动端:所有链接都显示链接文本和操作按钮 -->
|
||||
<div v-if="isMobile" class="space-y-4">
|
||||
<!-- 显示链接状态信息 -->
|
||||
<div v-if="message" class="bg-blue-50 dark:bg-blue-900/20 p-3 rounded-lg">
|
||||
<div class="flex items-center">
|
||||
<i class="fas fa-info-circle text-blue-500 mr-2"></i>
|
||||
<p class="text-sm text-blue-700 dark:text-blue-300">{{ message }}</p>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div class="bg-gray-50 dark:bg-gray-700 p-4 rounded-lg">
|
||||
<p class="text-sm text-gray-700 dark:text-gray-300 break-all">{{ url }}</p>
|
||||
</div>
|
||||
<div class="flex gap-2">
|
||||
<button
|
||||
@click="openLink"
|
||||
class="flex-1 px-4 py-2 bg-blue-600 text-white rounded hover:bg-blue-700 transition-colors text-sm flex items-center justify-center gap-2"
|
||||
>
|
||||
<i class="fas fa-external-link-alt"></i> 跳转
|
||||
</button>
|
||||
<button
|
||||
@click="copyUrl"
|
||||
class="flex-1 px-4 py-2 bg-green-600 text-white rounded hover:bg-green-700 transition-colors text-sm flex items-center justify-center gap-2"
|
||||
>
|
||||
<i class="fas fa-copy"></i> 复制
|
||||
</button>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- PC端:根据链接类型显示不同内容 -->
|
||||
<div v-else class="space-y-4">
|
||||
<!-- 显示链接状态信息 -->
|
||||
<div v-if="message" class="bg-blue-50 dark:bg-blue-900/20 p-3 rounded-lg">
|
||||
<div class="flex items-center">
|
||||
<i class="fas fa-info-circle text-blue-500 mr-2"></i>
|
||||
<p class="text-sm text-blue-700 dark:text-blue-300">{{ message }}</p>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- 夸克链接:只显示二维码 -->
|
||||
<div v-if="isQuarkLink" class="space-y-4">
|
||||
<div class="bg-gray-100 dark:bg-gray-700 p-4 rounded-lg">
|
||||
@@ -86,6 +139,7 @@
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
@@ -96,14 +150,22 @@ import QRCode from 'qrcode'
|
||||
|
||||
interface Props {
|
||||
visible: boolean
|
||||
url: string
|
||||
save_url?: string
|
||||
url?: string
|
||||
loading?: boolean
|
||||
linkType?: string
|
||||
platform?: string
|
||||
message?: string
|
||||
error?: string
|
||||
}
|
||||
|
||||
interface Emits {
|
||||
(e: 'close'): void
|
||||
}
|
||||
|
||||
const props = defineProps<Props>()
|
||||
const props = withDefaults(defineProps<Props>(), {
|
||||
url: ''
|
||||
})
|
||||
const emit = defineEmits<Emits>()
|
||||
|
||||
const qrCanvas = ref<HTMLCanvasElement>()
|
||||
@@ -120,7 +182,7 @@ const detectDevice = () => {
|
||||
|
||||
// 判断是否为夸克链接
|
||||
const isQuarkLink = computed(() => {
|
||||
return props.url.includes('pan.quark.cn') || props.url.includes('quark.cn')
|
||||
return (props.url.includes('pan.quark.cn') || props.url.includes('quark.cn')) && !!props.save_url
|
||||
})
|
||||
|
||||
// 生成二维码
|
||||
@@ -128,7 +190,7 @@ const generateQrCode = async () => {
|
||||
if (!qrCanvas.value || !props.url) return
|
||||
|
||||
try {
|
||||
await QRCode.toCanvas(qrCanvas.value, props.url, {
|
||||
await QRCode.toCanvas(qrCanvas.value, props.save_url || props.url, {
|
||||
width: 200,
|
||||
margin: 2,
|
||||
color: {
|
||||
@@ -168,7 +230,9 @@ const copyUrl = async () => {
|
||||
|
||||
// 跳转到链接
|
||||
const openLink = () => {
|
||||
window.open(props.url, '_blank')
|
||||
if (process.client) {
|
||||
window.open(props.url, '_blank')
|
||||
}
|
||||
}
|
||||
|
||||
// 下载二维码
|
||||
|
||||