Fixed url I got a question while crawling several pages.

Asked 2 years ago, Updated 2 years ago, 80 views

We are crawling the notice of certain public institutions with Python.

But when I turned the page, there was no change in url, and only the page was grouped separately in div class with javascript.

<a href="javascript:listShow('1')">

I wonder if there is a way to crawl multiple pages in this case.

python crawling beautifulsoup

2022-09-21 11:57

1 Answers

You can use Selenium when scraping sites configured using JavaScript with Python.
See here.


2022-09-21 11:57

If you have any answers or tips


© 2024 OneMinuteCode. All rights reserved.