Here are
4,504 public repositories
matching this topic...
Create agents that monitor and act on your behalf. Your agents are standing by!
Updated
Mar 21, 2021
Ruby
Fast, flexible, and lean implementation of core jQuery designed specifically for the server.
Updated
Mar 28, 2021
JavaScript
👾 Fast, simple and clean video downloader
Elegant Scraper and Crawler Framework for Golang
News, full-text, and article metadata extraction in Python 3. Advanced docs:
Updated
Mar 6, 2021
Python
📙 中华新华字典数据库。包括歇后语,成语,词语,汉字。
Updated
Nov 9, 2020
Python
AV 电影管理系统, avmoo , javbus , javlibrary 爬虫,线上 AV 影片图书馆,AV 磁力链接数据库,Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database
Distributed crawler powered by Headless Chrome
Updated
Oct 26, 2020
JavaScript
Scrapes an instagram user's photos and videos
Updated
Mar 24, 2021
Python
A collection of awesome web crawler,spider in different languages
🔮 A Node.js scraper for humans.
Updated
Jan 30, 2021
JavaScript
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
Updated
Feb 3, 2021
Python
Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator
Updated
Oct 25, 2019
Python
🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
YouTube video downloader in javascript.
Updated
Mar 25, 2021
JavaScript
scrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot
Updated
Mar 24, 2021
Python
Scrape job websites into a single spreadsheet with no duplicates.
Updated
Mar 25, 2021
Python
A Devtools driver for web automation and scraping
Scrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!
Updated
Dec 18, 2020
JavaScript
Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
Updated
Aug 19, 2019
Python
Creating Scrapy scrapers via the Django admin interface
Updated
Oct 13, 2020
Python
Download website to local directory (including all css, images, js, etc.)
Updated
Mar 25, 2021
JavaScript
Emby/Jellyfin 的一个日本电影刮削器插件,可以从某些网站抓取影片信息。
Updated
Dec 9, 2020
Python
[Unmaintained] A simple and clean video/music/image downloader 👾
Updated
Oct 27, 2020
Python
Improve this page
Add a description, image, and links to the
scraper
topic page so that developers can more easily learn about it.
Curate this topic
Add this topic to your repo
To associate your repository with the
scraper
topic, visit your repo's landing page and select "manage topics."
Learn more
You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session.
You signed out in another tab or window. Reload to refresh your session.
Right now, pages created by in-memory
httpdriver does not support navigation between pages due to their static nature.It makes it problematic to "move" from one static page to another within a same domain simply because we cannot reuse current page. In order to do so, we have to create a new page every time we need to move from A to B.
Let's add a possibility to reuse existing page by imp