#

scrapper

Here are 562 public repositories matching this topic...

Xonshiz / comic-dl

Comic-dl is a command line tool to download manga and comics from various comic and manga sites. Supported sites : readcomiconline.to, mangafox.me, comic naver and many more.

automation web debian phantomjs scraping manga python-script youtube-dl comics scrapping scrapper python-support

Updated Oct 17, 2021
Python

tinking

baptisteArno / tinking

🧶 Extract data from any website without code, just clicks.

scraping scrapping scrapper scraping-websites harvesting puppeteer

Updated Apr 15, 2021
TypeScript

web-scraping

je-suis-tm / web-scraping

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

web-scraper web-scraping newsletter reuters bloomberg futures web-scrapers scrapper financial-data news-websites data-scraping news-scraper futures-historical-data data-scraper sraping python-web-scraper financial-times options-data wall-street-journal wallstreetbets

Updated Feb 1, 2022
Python

keethesh / UdemyCourseGrabber

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

scraper scraping selenium lxml scrapper udemy selenium-python scrapper-script

Updated Apr 29, 2021
Python

iw4p / proxy-scraper

scrape proxies from more than 5 different sources and check which ones are still alive

http scraper checker proxy grabber https-proxy socks socks5 proxies socks-proxy proxy-list scrapper socks5-proxy socks4 proxy-checker proxychecker proxy-scraper

Updated Aug 31, 2021
Python

rodrigogs / xvideos

xvideos API library

nodejs api npm crawler library scrapper porn xvideos

Updated Feb 13, 2022
JavaScript

rocktimsaikia / meta-fetcher

simple metadata scrapper for node.js

scrapper metadata-extractor meta-data url-metadata metadata-scrapper meta-data-fetcher meta-fetcher

Updated Jun 12, 2021
TypeScript

CuriousLearner / GeeksForGeeksScrapper

Scrapes g4g and creates PDF

pdf webscraper geeksforgeeks scrapper webscraping hacktoberfest

Updated May 15, 2020
Python

voliveirajr / seleniumcrawler

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

python scraper scraping selenium scrapy selenium-webdriver asp-net webcrawler scrapper scraping-websites webcrawling

Updated Feb 28, 2019
Python

fernandod1 / Instagram-to-discord

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

Updated Apr 7, 2021
Python

DiegoCaraballo / Email-extractor

Open

Add a list of phrases to search

DiegoCaraballo commented Sep 28, 2019

The idea is to have an option like 3 (Do a Google search, save the Urls found and search the emails), but search a list of phrases.

This list can be in a .txt
The option can ask for number of search results in Google

Read more

help wanted good first issue New functionality

Open

Choose diferent countries

2

ph09nix / APSoft-Web-Scanner-v2

Powerful dork searcher and vulnerability scanner for windows platform

crawler automation sql csharp exploit hacking xss smartthings vulnerability crawlers scrapper xss-detection scanners dork lfi lfi-detection

Updated Mar 5, 2021
C#

markowanga / stweet

Advanced python library to scrap Twitter (tweets, users) from unofficial API, fully covered by integration tests

python search api scraper twitter tweets twitter-api users unofficial crawl scrape scrap user tweet scrapper twint scrap-tweet searchrunner

Updated Oct 26, 2021
Python

SpEcHiDe / MyTelegramOrgRoBot

Open

feature request: add Delete Telegram Account option

SpEcHiDe commented Apr 30, 2020

it would be nice to have this, since my.telegram.org allows it

Read more

documentation enhancement help wanted good first issue

badoux / goscraper

Golang pkg to quickly return a preview of a webpage (title/description/images)

url go golang website crawler scraper image webpage engine icon preview scrape description page title scrapper

Updated Jan 18, 2021
Go

lscofield / node-urlresolver-api

A complete nodejs API to extract streaming sites video direct URLs

Updated Dec 20, 2021
JavaScript

5hirish / tweet_scrapper

Scrape the Twitter frontend API without any authentication and restriction.

twitter python3 lxml scrapper

Updated Jul 29, 2019
Python

Proxy-List-Scrapper

narkhedesam / Proxy-List-Scrapper

Proxy List Scrapper

Updated Apr 3, 2021
Python

champmq / TheScrapper

Scrape emails, phone numbers and social media accounts from a website.

python osint tool scraping python3 contact scrapper socialmedia osint-tool contact-finder

Updated Feb 14, 2022
Python

Bishalsarang / Leetcode-Questions-Scraper

Scrape Algorithm Questions from leetcode and generate html and epub file

scraper leetcode scraping scrapper scraping-websites leetcode-questions leetcode-downloader leetcode-problems-solutions leetcode-scrapper download-leetcode leetcode-offline leetcode-pdf leetcode-epub leetcode-download leetcode-save

Updated Sep 1, 2021
Python

filipemeneses / fatec-api

API for SIGA from Centro Paula Souza made for students to create things based in their profile data

api fatec scrapper profile-data siga fatec-api

Updated Feb 11, 2022
TypeScript

kant2002 / ncrawler

Web Crawler written in C#

crawler scrapper

Updated Oct 13, 2019
C#

clouedoc / goquotes

A Go scraper aimed at scrapping quotes.

go quotes golang scrapping scrapper h4ck3rz colly

Updated Dec 4, 2020
Go

SigTools

msramalho / SigTools

Open

Auto infinite scrolling

fabiodrg commented Nov 7, 2021

Current infinite scrolling implements a lazy loading approach where new data is only fetched when the user scrolls to the table/page bottom.

Suggestion:

Add a button near the table to fetch all data at once

Read more

enhancement good first issue extractor

Open

Using JavaScript Modules

Open

Standard WebExtensions API on the way?

Find more good first issues

CodHeK / pysoc.js

😎 Simple gsoc data scraper, search for any keyword and instantly get data about the orgs that match your search criteria, use filters to sort and analyse the data, uses fuzzy-searching to improve user-search experience

firebase analytics reactjs fuzzy-search thread-pool bs4 scrapper fusejs gsoc-data-scraper

Updated Dec 17, 2018
JavaScript

raphaklaus / chupa-cabra

NodeJS tool to get data from site or API and concatenate to a file.

nodejs scrapper

Updated Oct 6, 2017
JavaScript

anshulrgoyal / imdb-scrapper

This is small project it provide many good api for search ,scrapping ,trending

javascript node imdb scrapper

Updated Jul 4, 2020
JavaScript

o2sh / 4chanMarkovText

Text Generation using Markov Chains fed by 4chan APIs

data-mining markov-chain scrapper

Updated Aug 25, 2018
Go

tharyckgusmao / integrada.minhabiblioteca.com.br

Download de livros para PDF/EPUB - Integrada.minhabiblioteca / vitalsource

electron nodejs javascript pdf promises crawler university download convert scrapper vitarsource minhabiblioteca

Updated Feb 21, 2018
JavaScript

Potelo / laravel-block-bots

Block crawlers and high traffic users on your site by IP using Redis

laravel bots crawlers scrapper

Updated Jan 27, 2021
PHP

Improve this page

Add a description, image, and links to the scrapper topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the scrapper topic, visit your repo's landing page and select "manage topics."