(一) 安装Python3.5
(1)在安装python之前,因为linux系统下默认没有安装wget,gcc,首先安装wget,gcc:
[root@node6 python_scripts]# yum install wget
[root@node6 python_scripts]# yum install gcc
(2)安装依赖:
!!!在编译之前需要安装一些必须的依赖,否则当报错的时候还得重新编译
yum install openssl-devel -y
yum install zlib-devel -y
(3)利用wget下载python3.5.0的安装文件并解压缩:
[root@node6 python_scripts]#wget https://www.python.org/ftp/python/3.5.0/Python-3.5.0.tgz
[root@node6 python_scripts]# ls
Python-3.5..tgz
[root@node6 python_scripts]# tar xvf Python-3.5..tgz
[root@node6 python_scripts]# ls
Python-3.5. Python-3.5..tgz
[root@node6 Python-3.5.]# cd Python-3.5.
(4)编译:
[root@node6 Python-3.5.]# ./configure --prefix=/usr/local/python3.
[root@node6 Python-3.5.]# make
[root@node6 Python-3.5.]# make install
[root@node6 Python-3.5.]mv /usr/bin/python /usr/bin/python_bak
[root@node6 Python-3.5.]ln -s /usr/local/python3./bin/python3. /usr/bin/python
(5)此时执行phthon可以看到3.5已经运行:
[root@node6 python_scripts]# python
Python 3.5. (default, Jul , ::)
[GCC 4.8. (Red Hat 4.8.-)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>>
(6) 此时yum的运行会报错,如下操作可以恢复yum:
修改yum文件
、cd /usr/bin
、ls -l yum*
会显示出“yum、yum-builddep、yum-config-manager、yum-debug-dump、yum-debug-restore、yumdownloader、yum-groups-manager”这7个yum开头的文件,这7个文件都是脚本文件,其第一行为:
#!/usr/bin/python
或
#!/usr/bin/python -tt
将“python”改为“python2.7”。
我们试着安装一个文件:
[root@vnode33 bin]# yum install tcpreplay
发现系统仍然报错:
Is this ok [y/d/N]: y
Downloading packages:
File "/usr/libexec/urlgrabber-ext-down", line
except OSError, e:
^
SyntaxError: invalid syntax
找到该文件[root@vnode33 libexec]# vi /usr/libexec/urlgrabber-ext-down
修改/usr/bin/python为/usr/bin/python2.7
可以安装成功了:
Is this ok [y/d/N]: y
Downloading packages:
tcpreplay-4.1.-.el7.x86_64.rpm | kB ::
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Installing : tcpreplay-4.1.-.el7.x86_64 /
Verifying : tcpreplay-4.1.-.el7.x86_64 / Installed:
tcpreplay.x86_64 :4.1.-.el7 Complete!
或者也可以用以下的方法:
./configure --prefix=/opt/python #因为centos自带python,为了不影响原有系统,我这里是另外安装到新目录 make install 进行安装 ln -s /opt/python/bin/python3. /usr/bin/python3 #软连接到系统path所指向的一个目录中,使之成为系统命令 ln -s /opt/python/bin/pip3. /usr/bin/pip3 ln -s /opt/python/bin/easy_install-3.4 /usr/bin/easy_install3
(二)安装pip3:
(1)首先下载,安装依赖setuptools
wget --no-check-certificate https://pypi.python.org/packages/source/s/setuptools/setuptools-19.6.tar.gz#md5=c607dd118eae682c44ed146367a17e26
tar -zxvf setuptools-19.6.tar.gz
cd setuptools-19.6.tar.gz
python3 setup.py build
python3 setup.py install
(2)安装pip3
wget --no-check-certificate https://pypi.python.org/packages/source/p/pip/pip-8.0.2.tar.gz#md5=3a73c4188f8dbad6a1e6f6d44d117eeb
tar -zxvf pip-8.0..tar.gz
cd pip-8.0.
python3 setup.py build
python3 setup.py install
安装完成之后我们再来查看python3.5的bin目录下都有什么东西:
[root@vnode33 usr]# cd /usr/local/python3./bin/
[root@vnode33 bin]# ls
2to3 easy_install idle3 pip pip3. pydoc3. python3. python3.5m python3-config pyvenv-3.5
2to3-3.5 easy_install-3.5 idle3. pip3 pydoc3 python3 python3.-config python3.5m-config pyvenv
为pip3创建链接:
[root@vnode33 bin]# ln -s /usr/local/python3./bin/pip3 /usr/bin/pip
现在可以用了:
[root@vnode33 bin]# pip Usage:
pip <command> [options] Commands:
install Install packages.
download Download packages.
uninstall Uninstall packages.
freeze Output installed packages in requirements format.
list List installed packages.
show Show information about installed packages.
search Search PyPI for packages.
wheel Build wheels from your requirements.
hash Compute hashes of package archives.
help Show help for commands. ...
(3)安装Twisted
Linux上设置https proxy并安装:
本机因从网络下载包时需要代理,故需要如下命令:
export https_proxy=135.251.33.31:
export http_proxy=135.251.33.31:
export ftp_proxy=135.251.33.31:
然后下载安装:
wget https://pypi.python.org/packages/source/T/Twisted/Twisted-15.2.1.tar.bz2
tar -xjvf Twisted-15.2..tar.bz2
cd Twisted-15.2./
python setup.py install
检查是否安装成功:
[root@vnode33 ~]# python
Python 3.5. (default, Feb , ::)
[GCC 4.8. (Red Hat 4.8.-)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import twisted
>>>
(4)安装Scrapy
pip install Scrapy
这个时候安装成功了,但是运行scrapy时报错
再重新安装下Twisted最新的版本:
wget https://twistedmatrix.com/Releases/Twisted/17.1/Twisted-17.1.0.tar.bz2
tar -xjvf Twisted-17.1..tar.bz2
cd Twisted-17.1./
python setup.py install
再运行scrapy发现已经好了:
[root@vnode33 bin]# ./scrapy
Scrapy 1.3. - no active project Usage:
scrapy <command> [options] [args] Available commands:
bench Run quick benchmark test
commands
fetch Fetch a URL using the Scrapy downloader
genspider Generate new spider using pre-defined templates
runspider Run a self-contained spider (without creating a project)
settings Get settings values
shell Interactive scraping console
startproject Create new project
version Print Scrapy version
view Open URL in browser, as seen by Scrapy [ more ] More commands available when run from project directory Use "scrapy <command> -h" to see more info about a command
还需要做一个软链接让scrapy命令全局可用:
ln -s /usr/local/python3./bin/scrapy /usr/bin/scrapy
试试在Python中导入scrapy:
Python 3.5. (default, Feb , ::)
[GCC 4.8. (Red Hat 4.8.-)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from scrapy.spider import BaseSpider
__main__:: ScrapyDeprecationWarning: Module `scrapy.spider` is deprecated, use `scrapy.spiders` instead
>>> from scrapy.spiders import BaseSpider
安装scrapy过程中有三步不确定是否需要,附录如下:
1,libxml2
wget ftp://xmlsoft.org/libxml2/libxml2-git-snapshot.tar.gz
tar -zxvf libxml2-git-snapshot.tar.gz
cd libxml2-2.9./
./configure
make
make install
2,libxlst
wget http://xmlsoft.org/sources/libxslt-1.1.28.tar.gz
tar -zxvf libxslt-1.1..tar.gz
cd libxslt-1.1./
./configure
make
make install
3,cryptography
wget ftp://sourceware.org/pub/libffi/libffi-3.2.1.tar.gz
tar -zxvf libffi-3.2..tar.gz
cd libffi-3.2.
./configure
make
make install
export PKG_CONFIG_PATH=/usr/local/lib/pkgconfig:$PKG_CONFIG_PATH
wget ftp://sourceware.org/pub/libffi/libffi-3.2.1.tar.gz
tar -zxvf libffi-3.2..tar.gz
cd libffi-3.2.
./configure
make
make install
Windows7下安装scrapy:
先下载python-3.5.2.exe 双击文件安装成功:
然后直接安装scrapy,找到pip文件的目录:
cd C:\Users\xxx\AppData\Local\Programs\Python\Python35-\Scripts
pip install scrapy
安装成功后测试下:
C:\Users\xxx>python
Python 3.5. (v3.5.2:4def2a2901a5, Jun , ::) [MSC v. bit (In
tel)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> from scrapy.spiders import BaseSpider
>>> exit()
(三)IDLE支持方向键:
(1)安装readline
pip install readline
但是有如下报错:
gcc: error: readline/libreadline.a: No such file or directory
解决方法:
yum install readline-devel
yum install patch
再重新configure、make、make install python3.