scrapy 安装
原文链接: scrapy 安装
原文地址:http://doc.scrapy.org/en/latest/intro/install.html
##准备工作
python 2.7
python --version
lxml 安装指南:http://lxml.de/installation.html
pip install lxml
如果报错:
make sure the development packages of libxml2 and libxslt are installed
则先执行:
apt-get install libxml2-dev libxslt1-dev python-dev
再重新安装OpenSSL(除了windows,其他系统均已安装)
pip或者easy_install
apt-get install python-pip
##安装Scrapy
NOTE : Don’t use the python-scrapy package provided by Ubuntu, they are typically too old and slow to catch up with latest Scrapy.
安装方法:http://doc.scrapy.org/en/latest/intro/install.html#intro-install-platform-notes
Import the GPG key used to sign Scrapy packages into APT keyring:
sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv 627220E7
Create /etc/apt/sources.list.d/scrapy.list file using the following command:
echo 'deb http://archive.scrapy.org/ubuntu scrapy main' | sudo tee /etc/apt/sources.list.d/scrapy.list
Update package lists and install scrapy-VERSION, replace VERSION by a known Scrapy version (i.e.: scrapy-0.22:
sudo apt-get update && sudo apt-get install scrapy-VERSION