How to read html using selenium in python

http://www.amazon.co.jp/gp/bestsellers/gift-cards/ref=zg_bs_nav_0
I am thinking of obtaining the ranking of the products from the above sites.

 from selenium import webdriver
from bs4 import BeautifulSoup

driver=webdriver.PhantomJS(executable_path=path)
start_url='http://www.amazon.co.jp/gp/bestsellers/gift-cards/ref=zg_bs_nav_0'
driver.get('start_url')
page_source=driver.page_source
html = BeautifulSoup(page_source, 'html.parser')
print html

As a result of executing this code, I am at a loss because I only get <html>>head>/head>body>>>/html>.I don't understand the timing of Javascript rendering well, so I would appreciate it if you could explain it to me.

python

2022-09-30 21:16

1 Answers

Can't I set driver.get('start_url') to driver.get(start_url)?

Also, the HTML tag in the body of the question will not be displayed as it is, so please enclose it with a back quote (`).
(I tried to edit it, but I got an error when the number of characters in the edit was too small...)

2022-09-30 21:16

If you have any answers or tips

Popular Tags

python x 4647

android x 1593

java x 1494

javascript x 1427

c x 927

c++ x 878

ruby-on-rails x 696

php x 692

python3 x 685

html x 656