Serritor is an open source web crawler framework built upon Selenium and written in Java. It can be used to crawl dynamic web pages that require JavaScript to render data.

Updated Jun 11, 2020
Java

PreferredAI / venom-tutorial

Star

A tutorial based on your preferred open source focused crawler for the deep web.

java html crawler scraper tutorial framework web scraping

Updated Oct 10, 2019
Java

riteshakya037 / Android-Scrapper

Star

This project is uploaded as a demo to showcase various components and patterns

android scraper android-architecture mvp-architecture demo-app

Updated Oct 23, 2017
Java

maithilish / gotz

Star

Gotz - Heavy duty ETL to automate data extraction from tons of HTML pages

java scraper etl jsoup htmlunit unstructured-data

Updated Oct 15, 2018
Java

boratanrikulu / imdb_scraper

Star

Scrapes the "In Theaters Now" list from IMDb.

java scraper imdb theater

Updated Jun 26, 2018
Java

stendarr / infk-uebungsscraper-java

Star

get all your exercises with one click

java computer-science scraper scraping exercise eth webscraping informatik zurich ethz

Updated Feb 28, 2020
Java

SkyTreasure / Bing-Flight-Status-Android-Scraper

Star

An Android app to scrap flight status from bing search engine. Serverless app.

android scraper bing serverless flights bing-api flights-api flightstatus flighttracker androidserverless

Updated Jan 4, 2018
Java

sharmatanesh / VehicleInfoOCR

Star

Vehicle-info-app

scraper ocr ocr-android ocr-recognition ocr-text-reader vehicleinfo

Updated Jun 9, 2019
Java

jmesserli / svmeal-api

Star

Api which scrapes menu plans from SV-Group websites

api scraper spring spring-boot meal-planner restaurant-menu sv-group

Updated Aug 9, 2018
Java

bmhm / ffb.depot.client

Star

Ein Java-Client für FFB-Depots. Features: Stammdaten und Depotbestände abholen, Depotperformance ermitteln.

tls scraper library user-agent gzip german protocol scraping banking lastname charset funds fidelity hibiscus-ffb-depot ffb-scraping-library depot

Updated Mar 16, 2020
Java

bluurr / quora-loader

Star

A realtime read-only locator and extraction library for Quora questions and answers.

java api client answers crawler scraper scraping crawling selenium questions quora bluurr

Updated Mar 22, 2020
Java

hugoltsp / chanchan

Star

4chan web scraper

search crawler scraper scraping 4chan

Updated Jun 22, 2019
Java

StevenKin / beetle

Star

🐞 a lightweight, simple web spider framework

scraper framework spider beetle java-8

Updated Jul 1, 2020
Java

KBNLresearch / oai-pmh-bulk-downloader

Star

Bulk downloader of web resources via OAI/PMH

scraper rest-api dropwizard archives java-8 digital-humanities restful-api oai-pmh digital-library webscraping cultural-heritage oai-pmh-client

Updated Oct 6, 2017
Java

fennifith / Blackboard

Star

(unstable) An HTML scraping, JavaScript injecting, spaghettificating, massive heap of Blackboard parsing mobile client.

android scraper android-app

Updated Sep 9, 2017
Java

Whamo12 / image-hunter-cli

Star

Find where your images are being used with this free Google Image web scraper.

java scraper photography imagescraper

Updated Mar 31, 2017
Java

silvanheller / mensa-bot

Star

Telegram Bot which tells you the meal of the current day in the mensa of the university of Basel

java bot scraper telegram gradle telegram-bot jsoup mensa-bot

Updated Jun 7, 2019
Java

NandanSatheesh / Web-Scraper-Bot

Star

A web scraper bot developed using Java (Result Scraper Application)

crawler scraper automation web-scraping data-extraction java-8 jaunt

Updated Oct 1, 2019
Java

Conquest-Reforged / BlockScraper

Star

dynmap blockscraper

minecraft scraper dynmap mod-block block-model

Updated Jun 11, 2018
Java

polypus-firehose / twitter-firehose

Star

A Java Twitter Crawler with Dictionary-Based Search

twitter-bot scraper twitter-api twitter-client twitter-scraper twitter-crawler twitter-scraping twitter-crawling twitter-scrape

Updated Jun 10, 2020
Java

Kennuel / dgapScraper

Star

Scraping information dependent on ad-hoc news and stockprices

java docker data-science scraper docker-compose postgresql stock-market ad-hoc mircoservices

Updated Jul 17, 2020
Java

Improve this page

Add a description, image, and links to the scraper topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the scraper topic, visit your repo's landing page and select "manage topics."

Learn more