How to Use Scrapy Threads

Hi, how are you?

I do web-crawling with Scrappy Since there's a lot of data, it takes more than 10 hours to get it...

I looked up how to solve this, and they said we could use a thread I've never used a thread before, so I don't know how to use it when I search for it and I don't know what to do.

Does anyone know how to import scrapy using multiple threads??

scrapy python thread threading

2022-09-22 21:30

1 Answers

Scrapy is a library that scraps web pages and you need to use a library called threading to use thread.

It's true that you can't make threads with just scrapy.

If you want to develop something with python, you can search on Google like python **** and get good search results.

The case is python thread Roman Python to search using a description of ways to manage the thread is good. =)

2022-09-22 21:30

If you have any answers or tips

Popular Tags

python x 4647

android x 1593

java x 1494

javascript x 1427

c x 927

c++ x 878

ruby-on-rails x 696

php x 692

python3 x 685

html x 656