Python Selenium: get values from dropdown list

I'm using Selenium in Python to open a web page and I'm trying to get the list of values from a specific dropdown list. Let's say the HTML code for the dropdown list looks like this:

<select name="nouveau-num"> <option value="" selected="selected"></option> <option value="351 8320175">351 8320175</option>
<option value="351 8652736">351 8652736</option>
<option value="351 8783295">351 8783295</option>
<option value="351 8094085">351 8094085</option>
<option value="351 8861691">351 8861691</option>
<option value="351 8271705">351 8271705</option>
<option value="351 8970191">351 8970191</option>
<option value="351 8965848">351 8965848</option>
<option value="351 8353924">351 8353924</option>
<option value="351 8988158">351 8988158</option>
</select>

And I want to retrieve all the values between <option> tags. I tried to do a browser.page_source which returns the HTML source of the web page and then do a regular expression (something like <option value="[0-9 ]*">) but the result is empty. For some reason however, the HTML code above is not in the HTML page source code retrieved by Selenium. Any ideas how I can approach this differently/what is wrong with the current approach?

2 Answers

You can create a Select object and iterate over the amount of options with a loop.

For example:

from selenium.webdriver.support.ui import Select
selector = Select(driver.find_element_by_name("nouveau-num"))
options = selector.options
for index in range(0, len(options)-1): print(options[index])

Edit:

I tried the code on the link you provided and there seems to be a delay until the dropdown's values are loaded. In addition I forgot that options has a list of elements so you need to specify .text. On top of all that By.NAME seems to work better than find_element_by_name

Here is the corrected code:

from selenium.webdriver.support.ui import Select
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.by import By
dropdown = driver.find_element(By.NAME, "nouveau-num")
selector = Select(dropdown)
# Waiting for the values to load
element = WebDriverWait(driver,
10).until(EC.element_to_be_selected(selector.options[0]))
options = selector.options
for index in range(1, len(options)-1): print(options[index].text)

Using this code I receive the following results:

351 8631174
351 8586821
351 8014561
351 8831839
351 8957001
351 8673968
351 8612034
351 8585995
351 8438130

According to this brilliant answer parsing HTML with Regex is never a good idea.

You better use find_elements_by_css_selector or find_elements_by_xpath.

Example with css selectors:

for tag in browser.find_elements_by_css_selector('select[name=nouveau-num] option'): value = tag.get_attribute('value') text = tag.text