Getting the HTML code of a particular div using selenium in python

Question

Using Selenium in Python, I'd like to download a page, and save the HTML code of a particular div, identified by its id. I've got the following:

from selenium.webdriver import Firefox 
from selenium.webdriver.support.ui import WebDriverWait

...

with closing(Firefox()) as browser:
   browser.get(current_url)

WebDriverWait(browser, timeout=3).until(lambda x: x.find_element_by_id('element_id'))

element = browser.find_element_by_id('element_id')

element is of type selenium.webdriver.remote.webelement.WebElement. Is there a way to get the HTML code (not processed in any way) from element? Is there some better way, using Selenium, of accomplishing this task?

I'm looking for a solution specifically using selenium. Thanks. — Lamps1829
– Lamps1829, Commented Dec 14, 2013 at 12:57

Community · Accepted Answer · 2017-05-23 12:33:15Z

3

Right from pydoc selenium.webdriver.remote.webelement.WebElement:

 |  text
 |      Gets the text of the element.

Use the .text attribute.

If you really are after the HTML source of the element then please see: Get HTML Source of WebElement in Selenium WebDriver using Python

As stated above, it's not as straight forward as you'd like.

edited May 23, 2017 at 12:33

CommunityBot

11 silver badge

answered Dec 14, 2013 at 13:01

James Mills

19.1k4 gold badges53 silver badges63 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Lamps1829 Over a year ago

The text attribute produces the visible text (i.e. what one sees when viewing a page) rather than the HTML code.

Lamps1829 Over a year ago

A variant of this reply from the thread you linked above took care of it: elem = driver.find_element_by_xpath("//*"); source_code = elem.get_attribute("innerHTML"). Thanks!

Collectives™ on Stack Overflow

Getting the HTML code of a particular div using selenium in python

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related