- 模拟登录
- 根据自增UID，爬取全站用户信息
- 根据用户信息，爬取全站发帖基本信息（标题，查看数，回复数）
经测试，清水河畔并没有做反爬虫处理，为了不影响他人使用，请在爬虫的时候降低速度（任务管理器查看，网速小于1Mbps较为合适）
可直接与代码结合分析的数据下载链接
Download from OneDrive
This repository has been archived by the owner on Apr 5, 2023. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 3
sczhengyabin/QingShuiHePan_Spider
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
电子科技大学论坛 清水河畔 爬虫
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published