How do you crawl on a site like this?

Asked 2 years ago, Updated 2 years ago, 48 views

https://www.weather.go.kr/weather/observation/aws_table_popup.jsp

It's this site, but even if I click the button with selenium and try to crawl to bs4, it doesn't ring up when I call up HTML. Is there any other way to crawl?

python selenium crawling

2022-09-20 20:54

1 Answers

The frame is inside, so you can't load it as it is.

If you right-click on the table and go into the frame source view, The tickets are being dynamically loaded in the following way.

https://www.weather.go.kr/cgi-bin/aws/nph-aws_txt_min_guide_test?0&0&MINDB_01M&4108&a&K

Above is the address (0&0) when the current time is specified, and if you set a specific time zone and check the frame source view again, it is shown below.

https://www.weather.go.kr/cgi-bin/aws/nph-aws_txt_min_guide_test?202007272014&-60&MINDB_01M&0&m&K

202007272014&-60&MINDB_01M&0&m&K shows the following format:

"Date" (20200727)"Time" (2014)&"After a few minutes" (-60)&MINDB_01M&0&m&K

Please specify the desired date, time, and minutes and call them to the address.

Thank you.


2022-09-20 20:54

If you have any answers or tips


© 2024 OneMinuteCode. All rights reserved.