A Simple Guide to Install Scrapy with Conda for Beginners on Windows – Python Web Crawler Tutorial

By | July 11, 2019

In this tutorial, we will introduce how to install scrapy library with conda command on windows, there are some notices we should concern, otherwise, you may fail to install it.

Backgroud

Scrapy can run on python 2.7 and python 3.4 above, you can both install python 2.7 and python 3.x on your windows.

Install and Use Both Python 2 and Python 3 in Windows with Anaconda – Python Tutorial

If you only install anaconda with python 2.x or 3.x, you can use conda command to install directly.

Install scrapy using conda command

conda install -c conda-forge scrapy

However, you may get this  CondaError: Cannot link a source that does not exist. ***\Scripts\conda.exe when you are installing and fail to install.

To fix this error, you can view:

Fix CondaError: Cannot link a source that does not exist. ***Scriptsconda.exe – Python Tutorial

After fixing this error, you can install again.

anaconda python 2.7 install scrapy

However, you will find scrapy only be installed based on anaconda python, we can not use it on anaconda environment python 2.7 or 3.5.

In anaconda python 2.7 environment.

anaconda python 2.7 no module named scrapy

In anaconda python 3.5 enviroment.

anaconda python 3.5 no module named scrapy

How to use scrapy in anaconda python environment? For example python 3.5.

Install scrapy in anaconda environment python 3.5

activate py3

Then

pip install Scrapy

You can get:

anaconda python 3.5 install scrapy

As to anaconda enviroment python 2.7, you can do as above.

Leave a Reply