scrape

An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

A Python module to bypass Cloudflare's anti-bot page.

Get unified metadata from websites using Open Graph, Microdata, RDFa, Twitter Cards, JSON-LD, HTML, and more.

A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers, user info, images...

Complete implementation of the undocumented Twitter API

Scrape domain names from SSL certificates of arbitrary hosts

Advanced python library to scrap Twitter (tweets, users) from unofficial API

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

Scrape Instagram's API with Puppeteer

Scrape any website, article or RSS/Atom Feed with ease!

Google/Bing Images Web Downloader

A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library

Python library for retrieving free proxies (HTTP, HTTPS, SOCKS4, SOCKS5).

A webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)

Crawl telegra.ph searching for nudes!

Node.js package to bypass CloudFlare's anti-bot JavaScript challenges

A simple (and unofficial) GitHub Trending client that lives in your menubar.

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

A instagram scraper wrote in python. Similar to instagram-php-scraper.Usages are in example.py. Enjoy it!