Skip to content

/ webmagic

New pull request New
22 Open 125 Closed
22 Open 125 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels.
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀
更新内容
#944 opened Aug 23, 2020 by apaqi
6
分布式redis爬虫缓存清理支持
#893 opened Sep 25, 2019 by qingmo
分布式redis爬虫缓存清理支持
#892 opened Sep 25, 2019 by qingmo
增加支持批量保存为JSON文件的Pipeline。
#890 opened Sep 11, 2019 by colin-plus
Update Page.java
#888 opened Aug 21, 2019 by weilunhui
Update Spider.java
#887 opened Aug 19, 2019 by weilunhui
Fix Spider main thread any problem with redis connection (when working with redis-based schedulers) leads to unhandled exception and release the main (control) thread
#846 opened Nov 7, 2018 by Interfer0n
修改Json#node方法，改为返回List<Json>，方便链式调用
#835 opened Sep 30, 2018 by xukeek
Bug and Vulnerability fixes
#834 opened Sep 29, 2018 by Xenios91
1
修正Cookie在子域名无效的问题
#828 opened Aug 25, 2018 by suym845
支持直接用编译后的RegexSelector进行选择
#827 opened Aug 25, 2018 by suym845
add a new proxy provider named effectiveProxyProvider
#819 opened Aug 7, 2018 by evancyz
1
#816 Fix dependency conflict issue for us.codecraft:webmagic-selenium:jar
#817 opened Aug 2, 2018 by LeoAugust19
extend the four-component to every request
#808 opened Jul 9, 2018 by Henior
修复部分网站重定向出现异常。新增基于反射的解析方法调用
#774 opened Apr 18, 2018 by 406965097
: 是非法字符，无法作为文件名
#762 opened Mar 28, 2018 by jialigit
1
Html新增text()方法，便于获取全部文本
#717 opened Dec 20, 2017 by VATALU
混合Downloader扩展、提供headless实现
#707 opened Dec 5, 2017 by wanglong9
新增ChromeDriverDownloader
#705 opened Dec 3, 2017 by Windsmild
#fixbug shutdown executorService incorrect
#670 opened Sep 19, 2017 by l1fan
删除构造函数防止误用
#666 opened Sep 12, 2017 by PatrickNicholas
简化了一下SeleniumDownloader的结构
#624 opened Jun 30, 2017 by darknt
1
ProTip! Exclude everything labeled bug with -label:bug.
You can’t perform that action at this time.