-
Updated
Apr 23, 2022 - Python
#
scrapping
Here are 355 public repositories matching this topic...
Comic-dl is a command line tool to download manga and comics from various comic and manga sites. Supported sites : readcomiconline.to, mangafox.me, comic naver and many more.
automation
web
debian
phantomjs
scraping
manga
python-script
youtube-dl
comics
scrapping
scrapper
python-support
-
Updated
Apr 15, 2021 - TypeScript
help wanted
Extra attention is needed
good first issue
Good for newcomers
New functionality
New functionality
2
Download all video lectures from a MIT-OCW course with a single command.
-
Updated
Jan 21, 2019 - Python
A Scrapy middleware to bypass the CloudFlare's anti-bot protection
-
Updated
Jun 20, 2021 - Python
Library and cli for extracting data from HTML via CSS selectors
-
Updated
Apr 17, 2022 - Go
Chrome Extension starter Kit with es6 standards
-
Updated
Dec 10, 2019 - JavaScript
Evaluate JavaScript on a URL through headless Chrome browser.
command-line
scrapping
cli-utilities
evaluator
scrapers
web-browser
scrapper
eval
web-crawling
commandline-interface
browser-automation
cmdline
headless-browsers
data-scraping
website-scraper
datascraping
webscrapping
web-scrapping
pupeteer
headless-browser
-
Updated
Jun 18, 2021 - JavaScript
Websites scanner for X-Recruiting header
-
Updated
Mar 1, 2018 - Go
A browsable REST API for recognizing book spines in an image.
api
book
rest-api
scrapping
bookshelf
restful-api
book-information
data-scraping
book-spider
rest-apis
scrappers
spines
book-spines
spine-recognition
book-spine
spine-detection
book-spine-detection
recognizing-book-spines
bookshelf-reader-api
book-scrapper
-
Updated
Jan 16, 2021 - Python
Gere e valide dados randômicos com fordev 🎲
python
api
data-validation
scrapping
data-generator
data-manipulation
fake-data
random-data
fake-data-generator
4devs
4devs-api
4devs-module
fordev
fourthdev
-
Updated
Oct 21, 2021 - Python
python
data-science
data
machine-learning
scraper
mongodb
nosql
web-crawler
pymongo
web-scraper
python3
artificial-intelligence
web-scraping
scrapping
scrapy
scraping-websites
web-crawling
olx
web-crawler-python
nosql-mongodb
-
Updated
Apr 3, 2021 - Python
A simple tool made with server-side and client-side for Scraping Websites and downloading them.
-
Updated
Mar 29, 2022 - TypeScript
Script que monitora novos anúncios feitos no OLX, alteração de preços em anúncios existentes e envia notificações pelo Telegram.
-
Updated
Jul 23, 2021 - JavaScript
2
xBioDreadx
commented
Oct 31, 2019
Hi, im currently parse website that require authentication for access to some content.
So I log in with browser, copy all created cookies and add them with each parse request.
void editRequest(BoundRequestBuilder req, * *, * *) {
cookieService.cookies.each { req.addCookie(it) }
}
That works like a charm until website change cookies in response - short after this my c
good first issue
Good for newcomers
joelibaceta
commented
Nov 3, 2019
- png
- jpg
- gif
a simple script that downloads all comics from commitstrip.com
-
Updated
Jan 1, 2017 - PHP
-
Updated
Dec 20, 2019 - Python
LinkedIn Scraper
python
scraper
linkedin
scraping
selenium
python3
scrapping
scrapy
linkedin-profile
beautifulsoup
python-3
selenium-webdriver
bs4
scrapper
scraping-websites
scrapy-crawler
linkedin-scraper
selenium-python
beautifulsoup4
bs4-requests
-
Updated
Feb 23, 2020 - Python
Improve this page
Add a description, image, and links to the scrapping topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the scrapping topic, visit your repo's landing page and select "manage topics."
The idea is to have an option like 3 (Do a Google search, save the Urls found and search the emails), but search a list of phrases.
This list can be in a .txt
The option can ask for number of search results in Google