Is my interpretation of Python's data collection environment correct?

Asked 1 years ago, Updated 1 years ago, 113 views

I wanted to do web scraping on Python, so I was doing a lot of research.
As for me, I'm in a state where I've finished studying Python.

AnAnaconda is designed to enhance Python's capabilities and provides pre-compiled code for collecting data from the web by installing it.

An After installing Anaconda, you can call from Python IDE by import if necessary.
(I plan to use PyCharm for IDE, but do I need to set it up separately?)to the effect)

(iii) There was a description that a virtual environment would be used when scraping, but is it not necessary to use it personally?

These are the three questions.
Thank you for your cooperation.

python anaconda web-scraping

2022-09-30 17:25

1 Answers

An As Anaconda calls itself Python Data Science Distribution, it is a good option to use Python mainly in data science.Conversely, when creating web applications, pip is often installed and difficult to manage because there are not enough related packages.I think Anaconda is a better choice if you don't even create applications just by web scraping.As you can see in the question, it's pre-compiled, so it's easy to install.

PIn the case of PyCharm, since it supports Anaconda, it is often automatically recognized.If you do not recognize it automatically, you can configure Python to use in File->Settings->Project Interpreter from the menu.

データIf you are focusing on data science, there are few cases where you will need a virtual environment immediately.If the amount of code becomes so large that you can't follow all the code to Python or package updates, or if Anaconda's package is insufficient to install a package with pip, you should consider using a virtual environment.

Also, if you are using Mac or Linux, Python is already installed, so it is safer to start Anaconda before using the Anaconda environment as follows without going through the path when installing Anaconda.

source~/anaconda3/bin/activate

If it is troublesome to enter this every time, you should register with an alias.You can start your environment with myconda by doing the following:

 alias myconda="source$HOME/anaconda3/bin/activate"


2022-09-30 17:25

If you have any answers or tips


© 2024 OneMinuteCode. All rights reserved.