Code Monkey home page Code Monkey logo

weixin_article_spiders's Introduction

weixin

A spiders' program for weixin which made by Express & cheerio

  1. 这个爬虫小软件,通过调用 “搜狗” 微信搜索的接口,捕获到相应的资源。
  2. 通过cheerio对文章进行筛选。
  3. 通过 fs 模块 在 res 文件夹下生成对应的 JSON 和 img 资源。

注意这个小软件分为

  • 通过关键词查询列表
  • 通过指定的 url 查单个文章,须是单个文章的网址,文章列表的网址不行

捕获的资源

  • 通过关键词搜索出来的微信文章列表会保存在 /res/list 下面
    • 在文章列表中选择 “抓取此条” 之后,会将此条文章保存在 /res/oneArticle 下面
  • 通过 指定 url 抓取出来的 图片和文章会保存到 /res/img-txt 下面

如何运行

npm install

然后运行 node app.js

登录 http://localhost:3000

weixin_article_spiders's People

Contributors

zgj233 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.