qqxx6661 / price-monitor Goto Github PK

View Code? Open in Web Editor NEW

116.0 4.0 50.0 3.52 MB

某东商品价格监控：自定义商品价格，降价邮件/微信提醒。技术：Python爬虫/IP代理池/JS接口爬取/Selenium页面爬取

Home Page: http://price.monitor4all.cn/

License: GNU General Public License v3.0

Python 100.00%

python crawler requests selenium mysql jingdong

price-monitor's Introduction

Price-Monitor

JD商品价格监控

简介

用户自行设定指定商品的监控价格，运行脚本获取价格数据。

申明：本脚本没有涉及JD账号登录，没有抓取任何JD敏感信息，仅在手动执行一次脚本时会读取JD公开商品页面的商品名称和价格，如有任何敏感侵权问题，请联系我删除。

核心代码

请先使用pip install -r requirements.txt安装依赖库

你需要的仅仅只是这两个Crawler类：

crawler_selenium: (推荐) 使用selenium+chrome访问某东商品单页进行爬取
crawler_js.py: 使用requests访问某东商品数据接口进行爬取

两个类下方都有测试代码，可以调试，并且都可以接入http/https代理。

代码里面包括了商品名称，副标题，PLUS价格，历史最高最低价等。

由于电商经常会更新接口，所以Crawler代码往往具有时效性，若发现代码报错不要慌，自行尝试修改。

使用selenium+chrome注意事项

需要安装chrome和chromedriver

若您使用默认的Selenium+Chrome，您还需要安装好Chrome，以及Selenium用来操控Chrome的ChromeDriver。

http://npm.taobao.org/mirrors/chromedriver/

若您在Windows下调试本项目，可以将ChromeDriver放置在任何配置了环境变量的目录下，我放在了C:/Windows/chromedriver.exe

若您使用Js爬取，不需要任何额外的库

price-monitor's People

Contributors

Stargazers

Watchers

Forkers

yaogdu northsnow2018 isaiahwang aetatisnovae laohu123 pyer-at-gh ztohacker linxuefei dst1213 allen-shixu pythonwmw junshine yuyaokeng woshishui83 kuustudio lattefang yangjietadie notrace carmelomeng logicjwell linny006 hzylyh marktang small-darkhorse omgen loncheng ljl1126 huaprobe zhb980213 gongyongtao lethe-ideal tl566 nirvana6 kekewind yu-rp banduoba zcjyt dory1005 crazycodelab wangyajiei hehtao pscmar jerrytci feng1213 jbyan supersongssr gavin30 dreamonthego yougwypf1991 xinpengdr

price-monitor's Issues

价格元素未出现提示："The AudioContext was not allowed to start. It must be resumed (or created) after a user gesture on the page.

问题与问题6大体一致
1、尝试一，chrome降版本，降到66版本，问题依旧
2、尝试二，crawler_selenium.py
去掉头请求：将# self.chrome = webdriver.Chrome(chrome_options=chrome_options, desired_capabilities=caps)
调整为，self.chrome = webdriver.Chrome()，可抓取到数据，但每次请求，chrmoe都要被唤起。

请教下，是京东更新了反爬策略吗？如何根据反爬策略更新下爬取机制？
盼回复！

web网页代码

大佬有前端的网页代码吗，我感觉你的前端代码很适合我目前的项目，希望借用一下，拜托了

如何添加监控产品

数据库没怎么看懂参数意义。
想要添加一个产品是往哪个表添加，哪些字段是必须的。

代理池问题

看到代码里用到的代理池, 自用的话, 还需要买代理ip吗? 我看芝麻, 代理云什么的还挺贵的.

网站注册错误

您好，这个网站是暂时还未开放注册么？

监控方面的建议

作者这个产品的不知道是否有商业化的打算，如果目标客户是专业撸货群体的话，建议监控苏宁，京东，唯品会等几个平台，就目前网页规则，感觉京东的页面是最简单的。本人平时就是搞撸货，相对需求比较清楚，也在自学并参考作者的代码做爬虫。价格方面，京东的PLUS价没有参考意义，而商品监控的话，主要是数码，黄金，奶粉这几类产品，需要自动计算券后价格，黄金的话，还要自动计算出每g成本，因为京东黄金的话，有时候会有送1g活动，这种时候可能需要爬取副标题，算入成本价。所以副标题只要作为一个字段，后台爬取计算成本使用，前台界面越简洁越好。主标题的话目前参考作者完整爬取，没想好优化方式，如何做简化规则，毕竟要考虑爬取代码在不同产品判断时的通用性。

几点小建议

1、建议不单纯以价格作为监控依据，因为京东的价格体系五花八门，优惠券，满减，赠品，多买打折之类，能否允许用户多种条件监控。
2、能否增加server酱推送。
3、能否增加地区检测，比如自选地区是否有货等。
4、能否开源自行搭建。
谢谢！

期待你这个什么时候开源，自己搭建，就可以减轻楼主服务器压力了！哈哈！

加上惠惠的历史价格数据作参考

接口

URI : https://zhushou.huihui.cn/productSense?phu=https://item.jd.com/3182191.html

参数phu 就是商品的连接，支持淘宝跟京东，下面是示例报文

{
    "img": "iVBORw0KGgoAAAANSUhEUgAAAPAAAACCCAYAAAB4v0VYAAAPIUlEQVR42u2djW8UxxnG80dFTRpViFhGEJSUNk5bg9RaDXUbNXIki7hJUSoZGzs1IRDZEEDExgYbFYuERlXaIFdAgiE2mO/EB/gDGxswAezG2Gff3d693XfudrO7t7u3e3u+u719Hml09szuzO3s/O6dnZ155xmCIMi3esYqYWFhAbUDQQAYgiAADEEQAIYgAAxBEACGIAgAQxAABsAQBIAhCALAhS0f145rB8C4kbh2XDsARiPGtQNgAIxGjGvPquyrV6/S5s2bqby8nKqrq2lsbExNW716dVpQNDc3R1u2bBHn1dbW0vz8vKM0AIxGjGvPYdnvvvsuTU9PUyKRoC+++ELArAXYSs3NzdTe3i7Oa2tro7179zpKA8BoxFlJGt9F0tgOWrrZJD6zCvd65HCUKB4xLSN+v1c+7gPd8cZji+2+S5Kk+5+tphOA16xZo567uLhIGzdudJQGgAGwe3jvtFLk62dzFgTERngffOro2GK+75OTk2kWmIFet24dtbS06LrCWkjZ0mrBt0sDwADYteL/G0rCNFznyQLHxlpEPvG5C9ZlhP6SPDb0tumxxXzf6+rqqK+vT/2f4WPNzs5SY2Mj1dfX647t7OwUf3d3dwtonaQBYACcNcD86aVsbT6Z0qyOLdb7/vHHH1NDQ4NleiQS0YE4MzMjrDXHdXR0UGVlpaO0nAKMEIywONMvYOLPlcrHmJarMlciGMXWkkeLGVKtFAusPMtyV9pMoVCImpqaXKfBAsMCO7OcT74WMCWeDsMCG9Tb20tvvvkmhcPhtDTuNjO4/OzL1rm1tVVN4241a2JiIu31k10aAAbA7sGb+VcS4KX7ANggZaCKu7tKUMSvldavX09r164V8C4vL6tpFRUVVFZWRlVVVTQwMKDL0y4NAANgAOzT+w6AATAABsAAGAADYAAMgAEwAAbAABgAA2AADIABMAC2vHHaSer3eihuM6E9V5UpysxBOQCYSLp7SMDEdZkLgJXpkrpploapkxkBTkipdmW9cCLX9z6QADudpJ7LytSW6bUcACwDPHEgCbDHsq3aglm7yASwJMObzaIJAOwWYM2vrvIru+IAp8q0mjgPgAsDcFpvzMZqZgJYmR0m3dqa0ZoD4BwAzJ9asPIGsMnzFgAuHMBen5dVgDXP5W6etQFwrgCWu1N5AVj+pQbApQew9rkcABcC4O9P5gdg+ZcaAJcgwOMfUeTcKlfnAmAADICLBODYrXqKXngFAANgAJwZ4H0UOftccQF8o4aiV34PgAEwAM4krbUrFoCjl39LsW9rATAABsC+BFj+Pvy9Cg2wnV/ooaEh4VGS03jR/8jIiJrmG7/QlgA/PpUfgO8fB8AlCHCk/wWS7uwpOMB2fqHZCwfDqKRp3cP6xi+0FcBeK9cpwDwAA4BLDGBpMXlvp44UHGA7v9DaNIZR663DN36heTZMclbMAAAGwK4BNs6bZre2/H1EG3pwwtW52hBnJ/PqjLAW4fKWYk+TDuxHW0xniS3Mz9p+Z6NfaLX+YjHh+G737t2mkBbML7STEL5zWFRm+E6n6mlwpb0NastZGtkDz5Iew9J371Fk8OX8ljl5NONc56VQQ9bnmoXlS5W26dyG7X7AjH6hWcqeSK+//rrqrE451hd+odXujGyJYYFhgV1ZYZN500nH8j9aTDfnaudJ6yz0za3J/ycPqA7s3VpgO7/QigWuqalR44rCL7Sjm/Dov8k5qwujANivAH/3NkUvbSqJa2fXuMY2yPOpRVsZbVHbqpuynfiFNj4fa1XUfqG1k87zDvC5VfKv54cA2CvA1/4kQkkAnILVFODb2y0XSFiVnckvtDIK3dXVRW+99Zaa5hu/0IUEODqw1vJdIQAGwGobjEfE/7Hhd1wDbOcX+tSpU7RhwwYRx91r7TOwb/xC81C/mEcrLQJgAFycAMsS7eXaG8m2mpCK8r4XBmDNRHgADIALDvDyQ3OAzz4nX2O12lYBMAAGwEV67WZtkEfZo/waqf8FAKwDeHQHRb4pB8AAuOgBjlx8laKD6wGw7uZr3iHmHeALL1MstBUAA+DMAA+9RpELP7dcYwyACwHwpU1qwwPA2St68ZcUu/m3kgaY20lU7ikq77sBsFIx39aKtZsA2McAa5bulQTA35SZA3zuRdv2EkyANd0vAAyAiwLggbXpAPNss/5VABgAA2BfAswrnPqfF5M5ALD25l/6jVopABgAFzXA/C7Y5q1FMAHW3Py8A3ylytLxGQAOMMAXf5HWBtm7R+TsswC4qABmz4U2rwUAcDABjl7elA5wasIRe+AEwNpfO14RNP4RAPYzwDwhZuT90gZ48pMUwPsBsA5gzZpcAOzP8rX3sFQBZvc8YkXSeCsABsAA2HcWeLoneZ13OwHwjzU1l9qJ8BgABsDFA/D1N9IBlttoEuBDwQE4Y3gymnQGNnk8zdlcPpzaLV2rocjAS3BM5zGUmnPApWt/TmuD4ckkwOHRfRnPD4wFVhZPK7sj5NsCK+5HYYFhgXUW+NuadAt8/x8Z960OXBdacSAWf3wGAAPgogaY3eoIeG08XQYOYHbtqf1VA8AAuBiuPRZ6J6s2GDyAlV0ZZgcAsF/LNwxElgTAys4OADgDwIY9agCw/8o3jmMAYACcP4BTjropNg+AATAA9gqwlNqlIV8AS3fabP38AuCAApxy4M4b7gFgNwB/fxIAA+CCX7vSLtxuMg+AATAABsAAGAADYAAMgAEwAAbArgCe+Wd+Ab77SWq7yFsAOFuAf7iSGvAZLB2ApzqS7ePBpwDYFcD3juYX4FR5XssKMsDGe1gSAKfahd2858AAbLUTunY3dJ6RZQRY3R3dsAs6HxOXgz7P5I7scU5PxSd3at9hW6403Z3auPnvyfNGW/THTh9JHj/aLP8qd8nhsDgnvXzN95Pjw+Pt5vm5DZrrMQ3ju8Qc3UI2JGlsp+6VCwAuMYAVIO2COhc6NTc6X0G68UZey1uJEBtpLlhDistdTPV7yD+gpQKwcY4+LLCdFZGtjNaK8PFWFo4biZmFVmbOaOPtLLC2XGXiujj35tY0K20Jv0UPIRaqM80v5xZ4pNHSQ0TeAFYeReS6IClcUo8P3A7Nejd4Bs5Bg0l7bpUW0+Kdlq/NUzsarY03C1bPzVb5rYR4V0eeNVRogLV1EbSVWAA4FwBzY+5/3jPAup6AFuBU3m4BdvsL7lbRq39Q95UCwADY3wAbvOm7Brj/Z5bxSt6uADbktyIDSLy38vkXiRISAAbAPgM4NXKtAnyxwhPA7NvYKl7J2w3AxvxWBGDF0drtbbrnY8vn/0yj2i6DMiahvRcAGABbw6YZ9TSOEPI2KZ4AHvq1ZbyStyuADfmtCMDjHxXFSLj2XgDgEgM45x4DJ7opfKeTFuZnM3oSdOOhcvlSlWW8krc2WJVjld+KeVC89YGwuE5CeLxDPr7Z8fFO8jO7F0EPsMBZKBb6qzcLfKPGMl7J25UFNuQHK4RrB8B2ABsWYbsFOHbzPct4JW8dwBaLva3yQyMO5rVPTU1RV1cXbd68OS1tbm6OtmzZQuXl5VRbW0vz8/Oe03wLsHEFiWOAZ/tTM5ret4xX8tY991msVLHKDwAH89qrqqrowIEDtHr16rS05uZmam9vp0QiQW1tbbR3717Paf4F2LCCxGn5yhJGhtQqXslbB7DFShWr/ABwsK/dDOA1a9aQJCVfAS4uLtLGjRs9p/kXYIPnfMcWOLWEkRcrWMUreVuNvDrJD40YANsBzNaUu8Re03wLME9mYNBcz8k1nGcaz3/z/GyxIqlLrFJKO15zXnjisHU6AAbAKdXV1VFnZ3Iue3d3twDTa5p/AUYjxrX7DOCZmRkxuMUAdnR0UGVlpee0YAEcmxcLDnIdeNfFlcjXqf9qAOwPgLUKhULU1NSU07SSB5j38/HT2l9l/yEAXBoAz87Ois+JiQmqrq6msbExz2kAGAAD4ByWzeAag6KKigoqKysTr5oGBvTzCrJNA8AAGAD79NoBcBYhOvgKAAbAALigAPe/QInwhPDsER146Uc4B9aJuMTimDhGBWnqMMWffK2+KtKBdvanJN1LvX6SgzTV6T0NAANgAGxvgaNXfkeUiAsw1fnOD/8jvGpEL76qA4kBS/xwTc1HB9l0T3o5Yx96SgPAABgAO+hCS5MHRXzsu7cpeu2Pyb9H3rfs0poBTLGnIi469CuKXtok/k4s3PaUBoABMAB29Az8EwFNYvmB+Iw/6rN9JjUFOBFLgfgaRS9sSB4gx3lJA8AAGABnADj+4ITlcW4AVrYYSRYQToKZAjHbNAAMgAGwIwtsDabT49h6svWm+LLwV83P1YnI957SADAABsCZAD63KicWWNsdl6aOiPT4w3/nJA0A49oBcA4scCbQjWLfzV7TADAABsB5Alh0heXn18TSNMWG63TnZpsGgAEwAHYIMKZSBqsRA2CLiyn2sDSyx1cA8/eF21a4p80LwH5Q/PFpMeLrl8DfF4IAMARBABiCADAEQQAYgiAADEEAGIIgACxUX19vG8x07Ngx4TtX0dOnT+nIkSO4W6hnKBuAHz9+TF999RXt27cvLY1dY3J8Q0MD7d+/X9cglIalbCNh1ujMNDw8LDzWK/r8889FCLrOnz9P27dvp507d5rWJeoZAJtqz5491NfXZ9oQenp66MmTJ2KPl8uXL6dB7rRhZbIgTixKKYt/KHmby0gkQktLS1kDjHoOcBfa7IbG43Hd/2yJvXbtoHT19vbSw4cPc9qFhgCwTo8ePcraAls1QuOxQW2Mu3fvpsHBQWpsbBQ9Iq5r1DOUU4B5AOT69evq/9yt5nP402nDsuv6BblhMbg8DsHq7+9Xd7dDPQPgnAB88uRJOn78uC6ONy9207WDZbAWP5oogPInA416hnIC8JkzZ8QASywW08XzKOfBgwcd5wfLYK3W1lZaXl5Wxx14NBr1DHkGmF9ttLe3i9FRo3iEmrt7bhoWLIN1D+fLL78Uf58+fZo+++wz1DPkDOBMN5y7d9ylUwLr9u3btGvXLlOwWbzForYb6MRScF7btm0L5I3ia2dQua65t8PdZtQztGIzsU6cOEF3795Ni+fGxg2Ku4BGq6E0NB5x5b8PHTqkpu3YsUPEHT16FHcN9QytNMAQBAFgCIIAMAQBYAiCikz/BwN6WsI4im0zAAAAAElFTkSuQmCC",
    "max": 2599,
    "min": 1999,
    "today": 2399,
    "priceunit": "元",
    "priceunitSymbol": "￥",
    "lowestPrice": "2499",
    "clusterUrl": "http://www.huihui.cn/detail?id=a818cb73fc0e303e&keyfrom=zhushou-hover",
    "hasLower": false,
    "lowestSite": "天猫",
    "priceTrendShare": {
        "anchor": "坑爹哇，说好的促销呢？",
        "shareDoc": "#惠惠购物助手比价2.0#618来袭，惠惠购物助手帮你计算活动到手价。在比价基础上，价格历史中增加了促销活动标记，买不买一目了然。快来下载体验吧！>>http://zhushou.huihui.cn/",
        "type": "RISE",
        "img": "http://img11.360buyimg.com/n1/jfs/t3106/2/1439459481/185815/dc74aa8f/57cd426cN4194de3b.jpg"
    }
}

分页排序的问题咋解决

演示站上直接点最后一页然后凉了的感觉 2333

请问大神这个程序能改成淘宝/天猫的价格监控吗？

找了挺久，好像现在还没有淘宝、天猫的价格监控。

BUG价格自动下单

我最开始接触py就是因为秒杀。后来也断断续续的关注撸货。现在的水平也就是你的第一版的水平。
个人认为监控的目的是
1、形成价格曲线，包含标价、到手价，供购物时提供参考；
2、秒杀指定产品（大促时，与网络、性能、帐号情况都会影响成功率），这个一般有针对性，适合临时启用；
3、bug自动下单。当出现bug时，时间是很短的。即使邮件提醒，等查看到，可能也错过了。所以，对高净值产品（电子产品、酒、黄金等），设置阀值（1折或低于某价格），认为是bug，就下单锁住；

关于京东价格监控的建议

看了下代码，比如像iPhone8那样实际价格是改在副标题的，应该是无法监控到的。。
建议再加个满减这种的提醒。。
（不过其实我觉得是可以做成信息有改动就发个提醒的，而不是提醒价格，因为你也不知道狗东什么时候又用什么方式让价格发生变化了。。

网站出现错误了 redis是不是挂了啊？

价格元素尚未出现

我这边看了一下，好像每次请求的京东网站都会重定向到登录页面，不知道你们有没有这个问题，我是直接运行的crawler_selenium.py ，自己也测试了几个其他的商品，都是这样。
另外我用其他几个无头浏览器测试都是在开启无头模式的时候就会跳转到登录页。
DevTools listening on ws://127.0.0.1:1846/devtools/browser/97cd85d8-2f68-4b74-be31-e2304fbfc7a4 2020-08-03 16:40:19 | INFO | crawler_selenium.py 46 | Crawl: https://item.jd.com/6287165.html 2020-08-03 16:40:19 | INFO | crawler_selenium.py 61 | 价格元素未出现 [0803/164020.312:INFO:CONSOLE(1)] "Synchronous XMLHttpRequest on the main thread is deprecated because of its detrimental effects to the end user's experience. For more help, check https://xhr.spec.whatwg.org/.", source: https://passport.jd.com/new/misc/js/common_login_v20180829.js (1) [0803/164020.314:INFO:CONSOLE(1)] "Access to XMLHttpRequest at 'chrome-extension://gfgkebiommjpiaomalcbfefimhhanlfd/static/priceChart.js' from origin 'https://passport.jd.com' has been blocked by CORS policy: Cross origin requests are only supported for protocol schemes: http, data, chrome, https.", source: https://passport.jd.com/new/misc/js/common_login_v20180829.js (1) [0803/164020.327:ERROR:web_contents_delegate.cc(279)] WebContentsDelegate::CheckMediaAccessPermission: Not supported. [0803/164020.328:ERROR:web_contents_delegate.cc(279)] WebContentsDelegate::CheckMediaAccessPermission: Not supported. [0803/164020.590:INFO:CONSOLE(1)] "The AudioContext was not allowed to start. It must be resumed (or created) after a user gesture on the page. https://goo.gl/7K7WLu", source: (1) [0803/164020.976:INFO:CONSOLE(1)] "Uncaught TypeError: Cannot read property '1' of null", source: https://passport.jd.com/new/misc/js/common_login_v20180829.js (1) 2020-08-03 16:40:21 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:23 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:25 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:27 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:29 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:31 | INFO | crawler_selenium.py 61 | 价格元素未出现 [0803/164033.306:ERROR:socket_udp.cc(219)] Received unexpected data packet from [::ffff:5f1c:ac57]:49849 before STUN binding is finished. 2020-08-03 16:40:33 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:35 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:37 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:39 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:41 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:43 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:45 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:47 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:49 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:51 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:53 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:55 | INFO | crawler_selenium.py 61 | 价格元素未出现 [0803/164057.306:ERROR:socket_udp.cc(219)] Received unexpected data packet from [::ffff:5f1c:ac57]:49849 before STUN binding is finished. 2020-08-03 16:40:57 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:40:59 | INFO | crawler_selenium.py 61 | 价格元素未出现 [0803/164100.788:ERROR:stun_port.cc(96)] Binding request timed out from 0.0.0.x:62983 (any) 2020-08-03 16:41:01 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:41:03 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:41:05 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:41:07 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:41:09 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:41:12 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:41:14 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:41:16 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:41:18 | INFO | crawler_selenium.py 61 | 价格元素未出现 2020-08-03 16:41:20 | WARNING | crawler_selenium.py 80 | Crawl name failure: no such element: Unable to locate element: {"method":"xpath","selector":"//*[@class='name']"} (Session info: headless chrome=80.0.3987.163) 2020-08-03 16:41:20 | WARNING | crawler_selenium.py 91 | Crawl plus_price failure: no such element: Unable to locate element: {"method":"xpath","selector":"//*[@class='p-price-plus']"} (Session info: headless chrome=80.0.3987.163) 2020-08-03 16:41:20 | WARNING | crawler_selenium.py 105 | Crawl subtitle failure: no such element: Unable to locate element: {"method":"xpath","selector":"//*[@class='name-s']"} (Session info: headless chrome=80.0.3987.163) 2020-08-03 16:41:20 | WARNING | crawler_selenium.py 117 | Crawl price failure: no such element: Unable to locate element: {"method":"xpath","selector":"//*[@class='p-price']"} (Session info: headless chrome=80.0.3987.163) 2020-08-03 16:41:22 | INFO | crawler_selenium.py 134 | Found body element: 404 Not Found /productSense was not found on this server. Resin-3.0.21 (built Thu, 10 Aug 2006 12:03:19 PDT) 2020-08-03 16:41:22 | WARNING | crawler_selenium.py 151 | Crawl failure: Extra data 执行时间: 78.0674524307251