Code Monkey home page Code Monkey logo

gui-amazon-review's Introduction

下载亚马逊评论工具

一个小改改时不时找我做一个Google扩展来下载Amazon的评论以提高工作效率,奈何时间一直不在这一块,刚好同学也接到了这个需求,就打算一起做一个。

最后商量还是做一个Gui,Google扩展有时候感觉有些不方便,顺带了解一下Python中的标准库tkinter。

最后分工我来做界面,同学来写下载解析那一块,说说一下思路,其实还是很简单的,就跟普通的爬虫差不多。

  • Gui提供2个参数,一个是站点,一个是产品Asin,Gui的具体界面就不仔细说了
  • 通过2个参数,可以构建一个种子Url,先会检测产品是否存在(404)
  • 检测通过后,然后开始开启线程递归下载
  • 下载完成后,解析数据保存到本地
  • 判断是否存在下一页,存在则修改header继续下载解析,直到最后一页

没有使用代理,因为数据量小,防止被ban,加了一些延时请求,如果有需要的朋友可以自行添加。

最后建议一下,简单的页面可以是用tkinter,复杂可以使用其他Gui库,比如pyqt,tkinter实现复杂的页面有点费劲。

下载地址https://github.com/DisasterMeng/Gui-Amazon-Review/releases/download/1.0/Amazon-Review_1.0.exe

源码地址https://github.com/DisasterMeng/Gui-Amazon-Review,求星星😊

结果

gui-amazon-review's People

Contributors

linghanchujian avatar sujianqingfeng avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.