I'd like to crawl on Python, but I'm not sure about the browser type.

Asked 2 years ago, Updated 2 years ago, 117 views

I'm going to make a crawler that collects and stores pictures of Cyworld.

However, Psy asked for IE 9.0 or higher or a browser such as Chrome

Crawler can only see that browser's upload recommendation.

Is there a way to trick the crawler into having more than the recommended browser?

python beautifulsoup

2022-09-22 20:57

1 Answers

You can change the user-agent value of the header.

If you look at the help of your http module, you will be able to set the header value.

You can change the User-Agent value among them.


2022-09-22 20:57

If you have any answers or tips


© 2024 OneMinuteCode. All rights reserved.