crawling tag

126 questions

1 answers
357 views
0

Crawling processing for missing material

HelloI'm a novice office worker who starts Python.Web crawling on the journal of the paper.I think the package I'm using will be selenium and beautiful soup 4.About the paper page in the journalThe ti...

python crawling beautifulsoup selenium-webdrive

1 years ago

1 answers
442 views
0

Python Suddenly Web Scraping Site Rejects

Hello.I'm inquiring because there was a sudden denial of access during scraping of the stock site.The error code is as follows.requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https...

python beautifulsoup scraping crawling

2 years ago

1 answers
384 views
0

Data crawling question!

I'm practicing crawling the store information (store name, address, number) of Goobne Chicken and saving it as a csv fileGoobne Chicken's web structure (tags) is getting stuck because I don't understa...

python crawling webdriver selenium-webdrive selenium

2 years ago

1 answers
343 views
0

Clear with Python special character replace

Hello, I have a question.If there is a special character when saving to Excel after crawling, there is an error when encoding euc-kr, so it cannot be saved to Excel.The problem with the current code ...

python crawling

2 years ago

1 answers
101 views
0

Difference between selenium and chrome driver, relationship

I am a high school student studying crawl.I use selenium and chrome driver when I crawl, but I don't know the difference between the two. Both are described as devices for automating web browsers, and...

selenium crawling

2 years ago

1 answers
183 views
0

Append to a new list in the existing list

Web-crawling shopping mall, in the purchase item partThere is a button called Purchase Quantity, If sold out, there is no button, If you have multiple options (color or size), you will get different v...

selenium crawling

2 years ago

1 answers
119 views
0

This is a question about web crawling in Ruby.

I'm a student who studies the web.I'm making a code that extracts only the contents of Internet newspaper articles with rubies.Code execution allows you to extract text from a newspaper article. The c...

ruby ruby-on-rails-4 web crawling nokogiri

2 years ago

1 answers
241 views
0

Python urlib.request.urlopen Timeout Error Why?

I tried to crawl the next news, but I got a timeout errorSo I typed the code one by one and looked for the error, and I got a timeout error in urlib.request.urlopen, but I don't know why it's showing ...

python crawling scraping urllib timeout

2 years ago

1 answers
182 views
0

What should I do if I can't get data due to JavaScript when crawling on Ruby?

I'm practicing web crawling using nokogiri.http://media.daum.net/digital/mobile/#page=1&type=tit_contIn this url, I made a code that outputs url of the article in the red type as shown below.Howev...

nokogiri ruby crawling javascript

2 years ago

1 answers
96 views
0

A function that functions as ready() or $(window).load() of js in ruby grammar

To get information that Naver API doesn't provide,I'm crawling directly on the Naver map site.But after doing it,NAVER map is loaded in double?This I think it's working. After loading the basic frame,...

ruby crawling

2 years ago

- 1 -

Popular Tags

python x 4647

android x 1593

java x 1494

javascript x 1427

c x 927

c++ x 878

ruby-on-rails x 696

php x 692

python3 x 685

html x 656