#

scraper

Here are 1,079 public repositories matching this topic...

yujiosaka / headless-chrome-crawler

Distributed crawler powered by Headless Chrome

jquery crawler chrome scraper promise scraping crawling chromium headless-chrome puppeteer

Updated Nov 11, 2021
JavaScript

IonicaBizau / scrape-it

Sponsor

🔮 A Node.js scraper for humans.

scraper node-scraper hacktoberfest

Updated May 14, 2022
JavaScript

fent / node-ytdl-core

YouTube video downloader in javascript.

scraper youtube node video-downloader youtube-downloader

Updated Nov 7, 2022
JavaScript

niespodd / browser-fingerprinting

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?

bot crawler scraper automation recaptcha web spider detection chromium chromedriver fingerprinting browser-fingerprinting stealth webscraping bot-detection chromium-browser puppeteer

Updated Oct 31, 2022
JavaScript

facundoolano / google-play-scraper

Node.js scraper to get data from Google Play

nodejs api crawler scraper google-play

Updated Oct 16, 2022
JavaScript

fabienvauchelles / scrapoxy

Scrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!

nodejs angularjs crawler scraper cloud proxy scrapy blacklisting

Updated Dec 18, 2020
JavaScript

meetDeveloper / freeDictionaryAPI

There was no free Dictionary API on the web when I wanted one for my friend, so I created one.

api scraper google google-dictionary free-api dictonary dictionary-api

Updated Aug 18, 2022
JavaScript

website-scraper / node-website-scraper

Download website to local directory (including all css, images, js, etc.)

nodejs javascript scraper hacktoberfest website-scraper

Updated Nov 7, 2022
JavaScript

gajus / surgeon

Sponsor

Declarative DOM extraction expression evaluator. 👨‍⚕️

parser scraper css-selector subroutines

Updated Jun 5, 2020
JavaScript

linkedtales / scrapedin

LinkedIn Scraper (currently working 2020)

crawler scraper linkedin linkedin-scraper

Updated Apr 26, 2022
JavaScript

withspectrum / micro-open-graph

A tiny Node.js microservice to scrape open graph data with joy.

nodejs scraper microservices micro opengraph

Updated Jan 1, 2021
JavaScript

zerodytrash / TikTok-Live-Connector

Node.js library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.

Updated Oct 22, 2022
JavaScript

whizzzkid / instagram-proxy-api

CORS compliant API to access Instagram's public data

nodejs javascript fetch heroku pagination cors instagram data scraper public proxy jsonp instagram-scraper instagram-api workaround instagram-data instagram-downloader data-instagram

Updated Apr 24, 2018
JavaScript

goose-parser

redco / goose-parser

Universal scraping tool, which allows you to extract data using multiple environments

nodejs docker parser crawler scraper browser parsing phantomjs scraping jsdom goose

Updated Apr 17, 2019
JavaScript

website-scraper / website-scraper-puppeteer

Plugin for website-scraper which returns html for dynamic websites using puppeteer

nodejs javascript chrome scraper chromium hacktoberfest website-scraper puppeteer

Updated Nov 7, 2022
JavaScript

gogoanime-api

riimuru / gogoanime-api

Sponsor

Anime Streaming, Discovery API made with Cheerio and Express. Uses data from Gogoanime

nodejs api scraper streaming anime rest-api scraping expressjs web-scraping streaming-api anime-search anime-scraper anime-list gogoanime anime-api anime-streaming gogoanime-api

Updated Oct 26, 2022
JavaScript

pevers / images-scraper

Simple and fast scraper for Google

nodejs scraper google images puppeteer

Updated Jul 31, 2022
JavaScript

gahabeen / jsonframe-cheerio

simple multi-level scraper json input/output for Cheerio

json scraper scraping selector parsed-data frame

Updated Apr 2, 2020
JavaScript

copyrenzhe / novel

基于 Laravel 5.2 的小说网站

scraper laravel book novel

Updated Sep 10, 2018
JavaScript

sunny9577 / proxy-scraper

⭐️ A proxy scraper made using Protractor | Proxy list Updates every three hour 🔥

angularjs scraper proxy protractor selenium proxy-list proxylist getproxy freeproxy proxy-scraper

Updated Nov 8, 2022
JavaScript

Improve this page

Add a description, image, and links to the scraper topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the scraper topic, visit your repo's landing page and select "manage topics."