文件名称:Google-Web-Search-Crawler:抓取Google网络搜索结果并从Google给我们的网址中获取文本
文件大小:9KB
文件格式:ZIP
更新时间:2024-05-28 18:48:44
Python
#Usage Inspired by and This is a google web search crawler with random useragent and automatic result save based at python2 + selenium + firefox profile(firefox is mainly for debug, you can use phantomjs instead for headless crawl ) For more info please refer to the Chinese Version below Sorry for my poor english 用途 由 和 启发 使用python2 + selenium + firefox profile 实现的随机user agent 模拟抓取Google搜索结果和关
【文件预览】:
Google-Web-Search-Crawler-master
----core.py(6KB)
----result-crawler.py(4KB)
----google-web-search-state-crawler.py(556B)
----core.pyc(5KB)
----README.md(2KB)
----google-web-search.py(559B)
----google-add.txt(24B)
----useragent.txt(3KB)