crawling tag

126 questions


1 answers
144 views
0
Python Web Crawling Login Question!

import requestsfrom bs4 import BeautifulSoups = requests.Session()req = s.get('http://www.filesun.com/')LOGIN_INFO = { 'user_id': ' ', 'password': ' '}with requests.Session() as s:login_req = s.post('...

2 years ago

1 answers
116 views
0
c# I have a question for your web browser!

Hi, everyone. Assuming you create a web browser using c#Using the webbrowser class provided in c#,It's just that you add an already installed Internet Explorer to your Windows form Isn't it hard to sa...


1 answers
67 views
0
Python selenium crawling question! (Modify URL)

I'm trying to crawl a product that meets the conditions on a siteI wrote the code using selenium because it seemed to dynamically load the product list.The structure of this site shows the url and the...

2 years ago

1 answers
110 views
0
Chrome dirver crawling_1_modified (add url)

url ='https://play.google.com/store/apps/details?id=tools.photo.hd.camera&hl=en'title = driver.find_element_by_xpath('//title')print(title.get_attribute('content'))None is the result of this code....


1 answers
111 views
0
To write code to parse/crawl purchase reviews from open markets such as Python or R

I would like to know how to write a code that parses/crawls the purchase reviews of open markets such as Python or R.I did it like this when I picked Coupang's product list from R, but what can I do w...

2 years ago

1 answers
75 views
0
Encoding problem after crawling Naver blog?

I crawled through the Naver blog, but the results came out only in unknown texts. What should I do to make it look like Korean? The command is as follows from gn_libs3.naver_api_caller2 import get1000...

2 years ago

1 answers
184 views
0
I'm curious about Python curling using selenium.

I'd like to use Selenium to read comments from Naver News.Currently using Python 3.4 and Windows 8.1 64bit.Currently, Naver News' comments can only be viewed by clicking on the More window, and before...


1 answers
71 views
0
I'm creating a harmful site blocking page that blocks certain words with php

Hi, everyone. I'm going to make a page to block harmful sites on the website I make.Currently, parsing is trying to utilize Snoopy class. /Start Snoopy /$snoopy = new snoopy;/Parsing /$url = http://ww...

2 years ago

2 answers
111 views
0
Python Web Crawling Error Problem

import requestsfrom bs4 import BeautifulSoupimport operatordef start(url): word_list=[] source_code=requests.get(url).text soup=BeautifulSoup(source_code,'lxml') p_tag=soup.findAll('p',{'class':'tt-p...


1 answers
111 views
0
I have a question about Python crawling. (Second...)

Following yesterday's question, I ask you a question.import urllib.requestimport bs4x=informationurls[4] #informationurls is a list of more than 1000 urls in str formi=[]html = urllib.request.urlopen(...

2 years ago
« - 6 - »

© 2024 OneMinuteCode. All rights reserved.