78 Commits

Author	SHA1	Message	Date
程序员阿江(Relakkes)	ff8c92daad	chore: add copyright to every file	2025-11-18 12:24:02 +08:00
程序员阿江(Relakkes)	b6caa7a85e	refactor: add xhs creator params	2025-11-10 21:10:03 +08:00
程序员阿江(Relakkes)	1e3637f238	refactor: update xhs note detail	2025-11-10 18:13:51 +08:00
程序员阿江(Relakkes)	3f5925e326	feat: update xhs sign	2025-10-27 19:06:07 +08:00
程序员阿江(Relakkes)	03e384bbe2	refactor: cdp模式下移除stealth注入	2025-10-19 15:32:03 +08:00
程序员阿江(Relakkes)	a9dd08680f	feat: xhs support creator url link	2025-10-18 07:20:09 +08:00
程序员阿江(Relakkes)	2bce3593f7	feat: support time deplay for all platform	2025-09-02 16:43:09 +08:00
未来可欺	81f2dbe4ab	添加了对媒体资源服务器的异常处理，参见 issue #691	2025-08-05 13:11:00 +08:00
程序员阿江(Relakkes)	b9d30bbabb	fix: #693	2025-08-01 15:55:21 +08:00
未来可欺	0b81240aed	升级 httpx 版本至 0.28.1，并修改关键字参数 proxies 至 proxy	2025-07-31 22:48:02 +08:00
未来可欺	173bc08a9d	添加了抖音存储视频以及图片的逻辑，并将config.py中ENABLE_GET_IMAGES参数更名为ENABLE_GET_MEIDAS，在此基础上略微修改存储逻辑	2025-07-30 18:24:08 +08:00
korruz	07a6e387ea	refactor: move format_proxy_info to utils and update crawler classes to use it	2025-07-29 14:16:24 +08:00
程序员阿江(Relakkes)	fc06c783f5	fix: fixed xhs req headers	2025-07-23 13:28:58 +08:00
程序员阿江(Relakkes)	a4d9aaa34a	refactor: xhs update	2025-07-21 21:26:16 +08:00
程序员阿江(Relakkes)	13b00f7a36	refactor: config update	2025-07-18 23:26:52 +08:00
gaoxiaobei	b913db64bb	refactor(config): move platform-specific configs to separate files ... - Remove platform-specific configurations from base_config.py - Create separate config files for each platform in their respective directories - Update import statements in core files to use new platform-specific config modules - Clean up unused and deprecated configuration options	2025-07-18 17:27:37 +08:00
程序员阿江(Relakkes)	e83b2422d9	feat: 支持playwright通过cdp协议连接本地chrome浏览器 ... docs: 增加uv来管理python依赖的文档	2025-06-25 23:22:39 +08:00
liudongkai	33e7ef016d	feat: xhs 非代理模式下增加随机等待间隔, db存储模式下增加存储xsec_token字段	2024-12-05 21:10:31 +08:00
leantli	e830ada574	feat: xhs comments add xsec_token	2024-12-03 18:25:21 +08:00
Relakkes	ca9b47ef63	fix: xhs 帖子详情优化	2024-11-27 09:41:24 +08:00
Relakkes	43dffeb2d1	feat: xhs帖子详情获取优化	2024-11-26 13:37:53 +08:00
liugangdao	78c09c4ae1	fix:翻页时search id不变	2024-10-24 13:57:27 +08:00
unknown	19269c66fd	xiaohongshu_comment_number_restrict	2024-10-22 20:33:10 +08:00
Relakkes	03e393949a	fix: xhs帖子详情问题更新	2024-10-20 00:59:08 +08:00
Relakkes	9fe3e47b0f	chore: 增加代码学习声明，严格禁止非法、禁止商业、不当用途	2024-10-20 00:43:25 +08:00
Relakkes	6dd3420743	fix: #423	2024-09-02 22:57:28 +08:00
Relakkes	d6fb255bdf	fix: xhs note detail error	2024-09-02 21:45:12 +08:00
Relakkes	65699aa1cb	feat: xhs支持获取评论的点赞数量	2024-08-24 06:07:33 +08:00
Relakkes	ab7d8142af	feat: weibo支持指定创作者主页	2024-08-24 05:52:11 +08:00
Relakkes	c70bd9e071	feat: 增加搜索词来源渠道	2024-08-23 08:29:24 +08:00
Relakkes	f371675d47	fix: xhs指定笔记ID获取方式增加解析html方式，原来的由于xsec_token导致失效	2024-08-11 22:37:10 +08:00
Relakkes	7229d29123	feat: xhs update	2024-08-04 14:54:03 +08:00
Wenbo Lu	9fb8f42f69	fetch_creator_notes_detail, id ->note_id	2024-07-26 21:55:31 +08:00
Relakkes	573ca9a659	feat: xhs笔记详情更新	2024-07-25 00:44:46 +08:00
AuYeung	1fd7827e36	When the query has no content, terminate the loop early	2024-07-18 20:44:40 +08:00
helloteemo	6545a15ff3	feature: 支持小红书图片、视频下载	2024-07-11 22:56:30 +08:00
Relakkes	d3eeccbaac	feat: logger record current search page	2024-06-24 22:24:51 +08:00
nelzomal	eace7d1750	improve base config reading command line arg logic	2024-06-09 18:51:36 +08:00
程序员阿江-Relakkes	a341dc2aff	Merge pull request #229 from Tianci-King/main ... feat(core): 新增控制爬虫参数起始页面的页数start_page;perf(argparse): 向命令行解析器添加程序参数…	2024-04-13 13:37:35 +08:00
leantli	ad01dfba95	feat: 轻量化支持爬取小红书二级评论	2024-04-12 17:32:20 +08:00
Tianci-King	1115b0d90c	feat(core): 新增控制爬虫 参数起始页面的页数start_page;perf(argparse): 向命令行解析器添加程序参数起始页面页数和关键字	2024-04-12 00:52:47 +08:00
leantli	81a9946afd	feat: 支持爬取小红书二级评论	2024-04-11 17:16:13 +08:00
leantli	68a60faa7f	chore: 简化判断方式	2024-04-04 00:11:22 +08:00
leantli	133f978477	fix: 修复爬取视频/帖子最大数设置值较低导致不爬取的问题	2024-04-03 12:18:23 +08:00
Relakkes	67ec49498a	refactor: rename xhs to xiaohongshu	2024-03-30 21:17:33 +08:00
Relakkes	96309dcfee	fix: 小红书创作者功能数据获取优化	2024-03-17 14:50:10 +08:00
Relakkes	59cd9f67a0	feat: 支持评论模式是否开启爬取选项	2024-03-16 11:52:42 +08:00
jayeeliu@gmail.com	61ba8c5cc7	feat: 小红书支持通过博主ID采集笔记和评论，小红书type=search时支持配置按哪种排序方式获取笔记数据，小红书笔记增加视频地址和标签字段	2024-03-02 01:49:42 +08:00
Relakkes	e0f9a487e4	refactor: 代码优化	2024-01-16 00:40:07 +08:00
Relakkes	894dabcf63	refactor: 数据存储重构，分离不同类型的存储实现	2024-01-14 22:06:31 +08:00