Here are 31 public repositories matching this topic...

psf / requests-html

Star 11.1k

Pythonic HTML Parsing for Humans™

python html http scraping requests kennethreitz beautifulsoup lxml css-selectors pyquery

• Updated Jul 29, 2020
• Python

shengqiangzhang / examples-of-web-crawlers

Star 8.9k

一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

python crawler spider example selenium multithreading stock wechat taobao pyquery tmall fund agent-pool wechat-report

• Updated May 15, 2020
• Python

qiaofei32 / yunCrawler

Star 31

智能云爬虫Demo

web-app css-selector pyquery

• Updated Aug 16, 2017
• HTML

shivammathur / TwitterScraper

Star 11

Twitter Scraper - Scrape tweets for a user or a #hashtag.

python scraper twitter tweets pyquery

• Updated May 22, 2017
• Python

RodrigoRosmaninho / TimeTableParser-ua

Star 10

Python tool for scraping any timetable page on the University of Aveiro's academic portal (PACO) and exporting it to different formats

python timetable universidade webscraping ua pyquery paco aveiro horario universidade-de-aveiro sttx smarttimetable

• Updated Jan 30, 2020
• Python

christabor / job_scraper

Star 8

[NOT MAINTAINED] Job/Occupation data scraping tool that uses scrapy and pyquery

scraper jobs scrapy pyquery careerbuilder onetonline

• Updated May 13, 2017
• Python

luanxiangming / spider

Star 7

Selenium with ChromeDrive/PhantomJS; Crawler with BeautifulSoup4, Scrapy, PyQuery

python chrome-extension phantomjs selenium pymysql pyquery

• Updated May 3, 2018
• Python

myounus96 / stock-market-prediction-using-sentiment-analysis

Star 7

stock market predictions using sentiment analysis, a deep learning project(data and news based on pakistani stock exchange and news(Dawn news))

python machine-learning sentiment-analysis neural-network numpy keras pandas web-scraping artificial-neural-networks matplotlib evolutionary-algorithm vader-sentiment-analysis pyquery stock-exchange

• Updated Jun 14, 2020
• Jupyter Notebook

flyyang / medical-news

Star 7

spider for chinese medical websites with wechat notification enabled

spider requests wechat pyquery

• Updated May 24, 2017
• Python

gyje / tieba_qiandao

Star 4

百度贴吧极速签到,200个吧用时1.6秒,简单直接

python threading tieba gevent pyquery qiandao tieba-qiandao py-ba

• Updated Nov 18, 2017
• Python

zhangshyue / scrapy-webscrapper-for-bbcnews

Star 3

A webscrapper that can scrape bbcnews using Scrapy and mongoDB

mongodb pymongo python3 xpath scrapy webscraping pyquery crawlspider bbc-news

• Updated Dec 22, 2018
• Python

koty / hokuto_program_scraper

Star 2

ホクト文化ホールのプログラムをスクレイピングします。

aws-lambda python3 serverless-framework pyquery

• Updated Oct 13, 2017
• Python

peacexie / python

Star 1

生活是艰难的：甚至需要爬…… 但是，微爬(Wepy)，却尽量让您轻松愉快的爬知识，爬价值，爬乐趣！

python flask iis sqlite3 pyquery

• Updated Nov 13, 2019
• Python

jsxz / crawl-tutorial

Star 1

python 3 crawl tutorial

pymongo selenium requests crawl jupyter-notebooks pymysql pyquery urllib beautifulsoup4 tuorial

• Updated Dec 23, 2018
• Jupyter Notebook

miozune / AtCoderUsersAPI_DB

Star 1

AtCoderUsersAPIのスクレイピング部分

python heroku firebase firebase-realtime-database pyquery

• Updated Apr 28, 2019
• Python

Live-Lyrics / amalgama-pq

Star 1

Amalgama lyrics scraping

lyrics scraping pyquery lyrics-fetcher

• Updated Aug 20, 2019
• HTML

hgz6536 / spiderman

Star 1

🐞🌸小蜘蛛

spider requests pyquery

• Updated May 15, 2017
• Python

ckcks12 / debian-package-manager

Star 1

fucking army shit the fucking army twice

python parser package debian dpkg pyquery

• Updated Dec 27, 2017
• Python

samuraitruong / py-scrapper

Star 0

A python application to scrap & clone static website

python multithreading pyquery

• Updated May 3, 2020
• Python

ShahzaibWaseem / FreeSpringerBooks

Star 0

Downloader for Free Books from Springer COVID-19 Package

pdf downloader books wget pyquery springer-free

• Updated May 16, 2020
• Python

mujahid14916 / Page-Monitor

Star 0

Monitor web page for change at regular interval.

python3 pyquery tkinter-python

• Updated Jul 28, 2018
• Python

zxzxzxygithub / pythonscarch

Star 0

base on python 2.7

pyquery

• Updated May 9, 2018
• HTML

enincc / infoq_crawler

Star 0

InfoQ 文章区爬虫

crawler requests pyquery infoq

• Updated Jan 10, 2018
• Python

wallacesilva / webscraper-alternativa-empregos

Star 0

Pega vagas de trabalho do site Alternativa Empregos (http://empregos.alternativa.co.jp/)

webscraper jobs python3 webscraping pyquery

• Updated Jun 9, 2019
• Python

xkdcc / Robots

Star 0

My spiderbot

selenium scrapy lxml spiders scrapy-crawler pyquery scrapy-demo selenium-python requests-html

• Updated Dec 2, 2018
• Python

foggyspace / MSpider

Star 0

自用爬虫模板

python3 aiohttp requests asyncio lxml bs4 pyquery spider-template

• Updated Apr 19, 2019
• Python

samuraitruong / fifa-ranking-data

Star 0

simple python script to collect fifa ranking data and create publish json + csv

python json csv request pyquery

• Updated Dec 13, 2019
• Python

lishulongVI / whisky

Star 0

About Cloud Baidu Resource cloud_group

rabbitmq python3 rpc pyquery

• Updated May 7, 2018
• Python

seaung / NySpiders

Star 0

the Spiders set

python spider requests xpath lxml pyquery beautifulsoup4

• Updated Feb 6, 2019
• Python

ArkaitzUlibarri / bizkaiabasket

Star 0

Scraping of bizkaiabasket

python scraping-websites pyquery

• Updated May 17, 2019
• Python

Load more…