scrapy

wget https://www.python.org/ftp/python/3.6.9/Python-3.6.9.tgz
./configure --prefix=/usr/local/python3
make && make install
ln -s /usr/local/python3/bin/python3 /usr/bin/python3
ln -s /usr/local/python3/bin/pip3 /usr/bin/pip3

pip3 install --upgrade pip
pip3 install scrapy
ln -s /usr/local/python3/bin/scrapy /usr/bin/scrapy

linux下sqlite3, python3.6.6及pip3的安装

scrapy startproject artSpider
scrapy genspider tencentPosition 'tencent.com'
scrapy genspider -t crawl tencent 'tencent.com'
scrapy crawl tencentPosition

清博舆情

清博大数据

python3下使用requests模拟用户登录 —— 中级篇

python爬虫从入门到放弃（六）之 BeautifulSoup库的使用]]

Python爬虫框架Scrapy实例

python爬虫框架Scrapy实战之定向批量获取职位招聘信息

利用scrapy模拟登录知乎

Python抓取股票数据

Python爬虫(七)--Scrapy模拟登录

Python3+Scrapy实现网页爬虫

Python3爬虫小程序——爬取各类天气信息

Python 简单的天气预报

一个51job职位爬虫

python3下使用requests模拟用户登录