apify

Crawlee—A web scraping and browser automation library for Node.js that helps you build reliable crawlers. Fast.

House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.

Apify actor that crawls Google Search result pages (SERPs) and extracts a list of organic results, ads, related queries and more. It supports selection of custom country, language and location.

This repo is a part of blog series on several web scraping projects where we will explore scraping techniques to crawl data from simple websites to websites using advanced protection.

Apify SDK monorepo

Amazon crawler - this configuration will extract items for a keywords that you will specify in the input, and it will automatically extract all pages for the given keyword. You can specify more keywords on the input for one run.

基于Apify+node+react搭建的有点意思的爬虫平台

Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.

Scrape Tripadvisor restaurant, hotels, and places.

Apify actor to scrape Youtube search results. You can set the maximum videos to scrape per page as well as the date from which to start scraping.

You can use this act to monitor any page's content and get a notification when content changes.

No more dealing with Google API. Simple Node.js program to automate access to Google Sheets.

Experimental scraper in Rust suited for running locally or on the Apify platform. Inspired by Apify SDK.

Scrape any Twitter user profile. Extract tweets, retweets, replies, favorites, and conversation threads with no Twitter API limits

CurlX a basic Curl syntax

An easy-to-use tool for making web service with API from your own Python functions.

The actor implements the legacy Apify Crawler product. It uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of JavaScript code.

Apify act for solving google recaptcha using the anti-captcha.com service.

Grab a session for any website for usage on your own actor

Apify actor to run web spiders written in Python in the Scrapy library