I use Python selenium to crawl and get it in HTML, but I don't scratch the whole thing, I scratch the half.

Asked 2 years ago, Updated 2 years ago, 49 views

from selenium import webdriver
from bs4 import BeautifulSoup

driver = webdriver.Chrome('./chromedriver')
driver.get('http://see.knu.ac.kr/content/board/notice.html')

html = driver.page_source
soup = BeautifulSoup(html, "html.parser")

print(soup)

driver.quit()

If you do this, you will only scratch the top 4 notices from the top of the notice website. What's the problem?

There were times when I scratched everything, did I do anything wrong?

For your information, print(soup.text) will scratch everything, but I can't find the information I need.

python selenium html crawling

2022-09-20 19:14

1 Answers

Find a way and answer yourself. It's just that there's no sign If I put in a different code, I can find everything even if it doesn't pop up


2022-09-20 19:14

If you have any answers or tips


© 2024 OneMinuteCode. All rights reserved.