Skip to content
#

beautifulsoup

Star

Here are 1,742 public repositories matching this topic...

Language: All
Filter by language
All 1,742 Python 1,267 Jupyter Notebook 322 HTML 78 JavaScript 25 CSS 4 Go 4 PHP 4 TeX 3 Java 2 Dart 1
Sort: Best match
Sort options
Best match Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

psf / requests-html

Star
Open

Make pyppeteer use proxies

8
oldani
oldani commented Feb 18, 2019

If you're using proxies with requests-html and rendering JS sites is all good. Once you render a website pyppeteer don't know about this proxies and will expose your IP. This is an undesired behavior when scraping with proxies.

The idea is that whenever someone passes in proxies to the session object or any method call, make pyppeteer also use these proxies. #265

Read more
enhancement good first issue

nedlir / languagepod101-scraper

Star

Python scraper for Language Pods such as Japanesepod101.com 👹 🗾 🍣 Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨

python language course podcast download japanese scraping language-learning requests learn beautifulsoup japanese-language learn-japanese spanish-language chinese-language learn-chinese learn-spanish jpod101 japanesepod japanesepod101
  • Updated Dec 3, 2020
  • Python

Improve this page

Add a description, image, and links to the beautifulsoup topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the beautifulsoup topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.