crawling tag

126 questions

1 answers
89 views
0

I want to bring it to soup and run it only if there is a specific class

When Africa BJ starts broadcasting, I'm going to make a program that executes a specific code.If you look at the BJ station website, there is a live class only when broadcasting. So I crawl the BJ bro...

python beautifulsoup crawling

2 years ago

1 answers
93 views
0

Please help me to click on Google's favorite site with Python selenium

url = 'site url'driver.get(url)# I'll connect it like thispage = driver.page_sourcehtml = BeautifulSoup(page, 'html.parser')find_tag = html.findAll('h3')# h3 tag is the name of the sites that are expo...

python selenium selenium-webdrive beautifulsoup crawling

2 years ago

1 answers
158 views
0

How do I read dynamic data from crawling using python 2.7 requests?

url=https://www.whoscored.com/Players/11119/Show/Lionel-Messires = requests.get(url, headers=headers, proxies=proxies)page_parser = bs4(res.content, html.parser)So we're going to practice bringing Mes...

python-2.7 python requests crawling

2 years ago

1 answers
69 views
0

(Full beginner) I can't read data when I'm crawling Python web.

import urllib.requestimport bs4url = https://sports.media.daum.net/sports/record/epl?tab=playerRankhtml = urllib.request.urlopen(url)bs_obj = bs4.BeautifulSoup(html, html.parser)div = bs_obj.find(div,...

python crawling

2 years ago

1 answers
93 views
0

Unable to retrieve data while crawling python beautiful soup. Please tell me how to crawl a web page with JavaScript using selenium!

https://mensaar.de/#/menu/sbI want to get the menu data from the web page above and print it out, but it's not working well.The code I wrote is as follows.//#encoding = utf-8import urllib.requestfrom ...

python crawling beautifulsoup

2 years ago

1 answers
93 views
0

What error is no ciphers available? (Qpython)

I am using the QPython3 Android app and I installed the requests module with pip.import requestsreq = requests.get(http://google.com)print(req.text)If you enter the code as shown above, it will run no...

crawling python android

2 years ago

1 answers
175 views
0

Web-crawling Korean broken question.

class Home Controller < Application Controller def index require 'open-uri' require 'nokogiri' @url =http://news.naver.com/main/read.nhn?mode=LSD&mid=shm&sid1=105&oid=030&aid=000248...

ruby-on-rails-4 crawling scraping utf-8

2 years ago

2 answers
61 views
0

Crawling to Beautiful soup displays urllib.error.HTTPError: HTTP Error 302.

urllib.error.HTTPError: HTTP Error 302: The HTTP server returned a redirect error that would lead to an infinite loop.The last 30x error message was:Moved TemporarilyThere's an error.Looking at the st...

python crawling

2 years ago

1 answers
74 views
0

Access desired posts through Python string search.

This is the code I wrote so far. The purpose is to enter the article with the title of the bulletin board with the desired wordFirst of all, I even wrote the title and link of the post to include it i...

python string crawling

2 years ago

1 answers
128 views
0

This is a web crawling question using Ruby-on-Rails.

I'm studying Ruby on Rails. I'm trying to scratch four titles of Naver news articles, but it didn't work out as I thought, so I'm posting a question.In the code I made, if you turn 0002713773, 0002713...

ruby ruby-on-rails crawling html nokogiri

2 years ago

- 5 -

Popular Tags

python x 4647

android x 1593

java x 1494

javascript x 1427

c x 927

c++ x 878

ruby-on-rails x 696

php x 692

python3 x 685

html x 656