cheerio

web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb），提供数据可视化和用户交互的实现方案

nodejs crawler angular node typescript spider mongodb cheerio proxy headless nedb task-queue node-spider puppeteer nodejs-spider task-scheduling

Updated Dec 25, 2020
TypeScript

KieSun / Vue-StudyMaps

Star

使用 Vue.js 开发的聚合应用。通过爬虫抓取平时浏览的网站，省去逐个点开网页的时间。

express vue cheerio vuex vue-router superagent

Updated Aug 6, 2017
JavaScript

yodhcn / kikoeru-express

Star

kikoeru 后端

nodejs scraper jwt express cheerio socket-io axios sqlite3 pkg knexjs

Updated Dec 22, 2020
JavaScript

lensh / koa2-cet

Star

English-querying system for Grade 4 and Grade 6 with free api interface,based on angular and koa2

cors angular es6 cheerio pm2 jsonp superagent koa2 es7 es8

Updated Aug 22, 2017
HTML

dolyw / VueStudy

Star

Vue.js学习系列示例代码及教程

jwt router vue study cheerio vuex

Updated Dec 21, 2020
Vue

HuangXiZhou / dytt-reptitle

Star

🐜 Dytt crawler

nodejs npm mongodb cheerio node-reptitle

Updated Jun 19, 2019
JavaScript

LuckyHH / WebSpider

Star

基于Nodejs,superagent,cheerio的在线web爬虫项目，支持生成API

nodejs crawler spider cheerio superagent

Updated Nov 25, 2019
JavaScript

itemsapi / website-to-json

Star

Converts website to json using jQuery selectors

nodejs jquery data-mining scraper cheerio nightmare jquery-recipes extract-website

Updated Jan 13, 2018
JavaScript

Tazeg / sample-web-scraping-with-electron

Sponsor Star

Sample project for web scraping with Electron

electron javascript cheerio scraping scraping-websites

Updated May 13, 2020
JavaScript

Fee-ing / Fee-movie2.0

Star

整合了几个常用的电影网站，获取资源更方便，更新中

nodejs cheerio pug superagent koa2

Updated Dec 3, 2018
JavaScript

asimpson / nodejs-web-scraper-cookbook

Star

📝 Resources for web scraping with node.js

nodejs cheerio scrapers web-scrapers

Updated Nov 10, 2019

BUPT-HJM / buptclass

Star

A nodejs-spider that gets the infomation of empty classrooms in BUPT

cheerio superagent tesseract-ocr node-tesseract

Updated Jun 1, 2016
JavaScript

transitive-bullshit / scrape-github-trending

Star

Tutorial for web scraping / crawling with Node.js.

tutorial cheerio scraping crawling

Updated Jul 17, 2020
JavaScript

slopeninja / slopeninja-backend

Star

Slope Ninja Backend ⛷

❄️

⛄️

nodejs redis postgres babel koa cron jest sentry cheerio dynamodb joi knexjs

Updated Dec 27, 2020
JavaScript

sid24rane / Personal-Chef

Star

An Self learning AI Chatbot who doesnt let you waste food by recommending awesome Recipies

nodejs android api app material-design cheerio chatbot recipe glide api-ai recipe-details

Updated Sep 19, 2018
Java

kayslay / web-crawljs

Star

web crawler for Nodejs

nodejs javascript crawler node web cheerio scrap web-crawljs

Updated Dec 11, 2020
JavaScript

amazingshellyyy / covid19-api

Star

Covid19 Data API (JSON) - LIVE

json data cheerio openapi open-data webscraping datavisualization datacrawler githubactions coronavirus coronavirus-globaloutbreak coronavirus-tracking coronavirus-real-time coronavirus-info coronavirus-tracker covid-19 covid covid-data covid19-data county-level

Updated Sep 16, 2020
JavaScript

elnaz / scraper

Star

A web scraper starter project

scraper node cheerio

Updated Nov 29, 2015
JavaScript

wahengchang / node-dcard-scraper

Star

it is an example of implementing cheerio scraper of extracting images in dcard

nodejs javascript npm crawler scraper tutorial cheerio example dcard

Updated Feb 23, 2017
JavaScript

LuXDAmore / nuxt-prune-html

Star

Nuxt module to prune html before sending it to the browser (it removes elements matching CSS selector(s)), useful for boosting performance showing a different HTML for bots by removing all the scripts with dynamic rendering