Home  >  Article  >  Backend Development  >  Ubuntu scrapy development environment setup

Ubuntu scrapy development environment setup

巴扎黑
巴扎黑Original
2017-06-23 15:32:571232browse

My version is 14.04

1. Update the system

##If the system does not change the domestic download path, you need to change the system update download path

Sudo apt-get update Update system

sudo apt-get upgrade

2. Install pip Some packages of scrapy need to be installed using the pip command

  1. <span class="pln">sudo apt<span class="pun">-<span class="kwd">get<span class="pln"> install python<span class="pun">-<span class="pln">pip Installation command</span></span></span></span></span></span>

  2. ##pip <span class="pln">-<span class="pun">V This is the command to view pip version information<span class="pln"></span></span></span>

3. Install srapy related dependencies

 1.sudo apt-get install python-dev python-pip libxml2-dev libxslt1-dev zlib1g-dev libffi-dev libssl-dev

 2. If you also want to install scrapy in the python3 environment, you need to execute the following command

  sudo apt-get install python3 python3-dev

#4. Install scrapy# sudo pip

install scrapy

scrapy environment installation completed

Check whether scrapy is installed successfully Enter in the console :scrapy

If there is a prompt for the corresponding version information, it will be successful. No need to look at the following

## During the installation of scrapy, OP_NO_TLSv1_1 may appear, usually the twisted version is higher than,

1 .The easiest way is to uninstall twisted and then reinstall a lower version,

sudo pip install twisted==16.04 (here 16.04 is what we are using now) 2/There is another method, but there is no experiment, which is to delete pyopenssl and run sudo pip install scrapy again

##

<br>
<br>

The above is the detailed content of Ubuntu scrapy development environment setup. For more information, please follow other related articles on the PHP Chinese website!

Statement:
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn