爬虫模拟有道字典进行翻译,还发现了一条好玩的js

时间：2023-06-01 13:22:20

08.14自我总结

爬虫模拟有道字典进行翻译

一.代码

import requests

from lxml.html import etree

# headers= {

# 'User-Agent':' Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.90 Safari/537.36',

# 'Cookie':' DICT_UGC=be3af0da19b5c5e6aa4e17bd8d90b28a|; webDict_HdAD=%7B%22req%22%3A%22http%3A//dict.youdao.com%22%2C%22width%22%3A960%2C%22height%22%3A240%2C%22showtime%22%3A5000%2C%22fadetime%22%3A500%2C%22notShowInterval%22%3A3%2C%22notShowInDays%22%3Afalse%2C%22lastShowDate%22%3A%22Mon%20Nov%2008%202010%22%7D; ___rl__test__cookies=1565782601235; OUTFOX_SEARCH_USER_ID=131296774@139.226.172.110; OUTFOX_SEARCH_USER_ID_NCOO=1369535179.7407944; _ntes_nnid=b3ad33663a64ae962e76c71b2df46330,1565057224869; JSESSIONID=abcfltcZlc31Td7QD1pYw; search-popup-show=8-14; DICT_UGC=be3af0da19b5c5e6aa4e17bd8d90b28a|; ___rl__test__cookies=1565782014056'

# }

# 本来以为有道可能会有点反爬措施,结果发现并没有...

a = input('请输入你翻译的内容')

rp = requests.get(f'https://dict.youdao.com/w/{a}/')  # 这个url是Fiddler获得的

# 他翻译的内容可能会出现在两个xpath中

data_xpath_1 = '//*[@id="phrsListTab"]/div/ul/li/text()'

html = etree.HTML(rp.text)

data = html.xpath(data_xpath_1)

if not data:

    data_xpath_2 = '//*[@id="phrsListTab"]/div/ul/p/span[2]/a/text()'

    data = html.xpath(data_xpath_2)

#一长串东西翻译

if not data:

    data_xpath_3 = '//*[@id="fanyiToggle"]/div/p[2]/text()'

    data = html.xpath(data_xpath_3)

#单纯的为了打印好看

count = 1

for english in data:

    print(f'翻译{count}:{english}')

    count += 1

我还发现了一条好玩的js

https://dict.youdao.com/word/wordarticle?query=这里是我们查询的翻译输入的内容&jsonp=jQuery191018231021198201125_1565783847667&_=1565783847668 HTTP/1.1

很多内容会匹配不到,你输入天才可以试试

是匹配相关文章的

相关文章