crawling tag

126 questions


1 answers
103 views
0
I'm asking you to print it out as a Python txt file (sys.stdout function)

import urllib.requestfrom urllib.parse import quote_plusfrom bs4 import BeautifulSoupfrom urllib import parsefrom selenium import webdriverfrom collections import OrderedDictfrom datetime import datet...

2 years ago

1 answers
88 views
0
Python Beautiful Soup select result is strange.

I'm practicing Python crawling, and I'm collecting sections from Naver's integrated search as follows.If you search with the following code, there should be 9 words for section, but there are only 2 w...


1 answers
65 views
0
For statement in Python graph utilization

It is a code that tries to graph the current death rate by Corona country. In this code, the for statement shows all the names of the countries on the page, the r_rate, and the country-specific mortal...


1 answers
54 views
0
I use Python selenium to crawl and get it in HTML, but I don't scratch the whole thing, I scratch the half.

from selenium import webdriverfrom bs4 import BeautifulSoupdriver = webdriver.Chrome('./chromedriver')driver.get('http://see.knu.ac.kr/content/board/notice.html')html = driver.page_sourcesoup = Beauti...


1 answers
88 views
0
You need to log in when crawling with Java programs

Because it is a program, basic information is different when accessing it, and various information is needed for connection.Can I know the specific way to log in with the Java program?I'm trying to lo...

2 years ago

1 answers
61 views
0
Problem with selenium installation. 'TypeError: 'module' object is not callable' in webdriver.chrome()

Hello, I'm a beginner who wants to study code.There is an error trying to install and practice selenium in the visual code.from selenium import webdriverbrowser = webdriver.chrome() # <- I also add...

2 years ago

1 answers
57 views
0
Crawling Python comments

'https://news.v.daum.net/v/20190728165812603' I'd like to crawl the number of comments in this article.url ='https://comment.daum.net/apis/v1/ui/single/main/@20190728165812603'headers = { 'Authorizati...

2 years ago

1 answers
53 views
0
I have a question regarding the data type.

Hello, everyone I'm a beginner at coding.I'm getting data from the website Part of the data is contained in non-numeric characters.For example, all other data are float types, such as 2.4 and 12.7, bu...

2 years ago

1 answers
81 views
0
There is data missing when crawling by combining multiprocessing and multi-threading. How can we solve this?

Crawling using multiprocessing, treading, beautiful soup, and requests results in a list index out of range error or none type has not attribute text error.import requestsfrom bs4 import BeautifulSoup...


1 answers
144 views
0
Naver Securities Web Crawling

Hello! I'm a beginner at coding. I've been trying to scribble stock data on the Nav Securities site for the past few days, but I've had a hard time because of the continuous errors. I'd appreciate it ...

« - 11 - »

© 2024 OneMinuteCode. All rights reserved.