Skip to content
#

lxml

Star

Here are 269 public repositories matching this topic...

Language: All
Filter by language
All 269 Python 214 Jupyter Notebook 26 HTML 8 JavaScript 5 CSS 2 XSLT 2 Go 1 Vim Script 1 TSQL 1
Sort: Best match
Sort options
Best match Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

psf / requests-html

Star 12.6k
Open

Make pyppeteer use proxies

11
oldani
oldani commented Feb 18, 2019

If you're using proxies with requests-html and rendering JS sites is all good. Once you render a website pyppeteer don't know about this proxies and will expose your IP. This is an undesired behavior when scraping with proxies.

The idea is that whenever someone passes in proxies to the session object or any method call, make pyppeteer also use these proxies. #265

Read more
enhancement good first issue

roniemartinez / dude

Sponsor
Star 305
Find more good first issues

keethesh / UdemyCourseGrabber

Star 164

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

scraper scraping selenium lxml scrapper udemy selenium-python scrapper-script
  • Updated Apr 29, 2021
  • Python

Improve this page

Add a description, image, and links to the lxml topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the lxml topic, visit your repo's landing page and select "manage topics."

Learn more