To write code to parse/crawl purchase reviews from open markets such as Python or R

Asked 2 years ago, Updated 2 years ago, 110 views

I would like to know how to write a code that parses/crawls the purchase reviews of open markets such as Python or R.

I did it like this when I picked Coupang's product list from R, but what can I do with Gmarket? If possible, I would like to collect the horoscope for each product.

library(rvest)
library(httr)
url=''
response=GET(url)
htxt=read_html(response)

comments=html_nodes(htxt,'div.name')
html_text(comments)

comments=repair_encoding(html_text(comments))
comments <-gsub("\n","",comments)
comments
writeLines(comments,"comments.txt")


python r parsing crawling

2022-09-22 08:47

1 Answers

Skill sets for implementing questions are as follows.

HTTP(S)
HTML
JAVASCRIPT
R or PYTHON

Be familiar with HTTP(S), a communication protocol.

HTML, which is a language of expression, of course.

These days, AJAX uses a lot of dynamic functions, so it's almost impossible without knowing JAVASCRIPT.

Then you can cook R, or PYTHON.

You may need SpiderMonkey here or selenium.


2022-09-22 08:47

If you have any answers or tips


© 2024 OneMinuteCode. All rights reserved.