Code Monkey home page Code Monkey logo

sina_reptile's Introduction

这是一个关于sina微博的爬虫，采用python开发，并修改了其sdk中的bug，采用mongodb存储，实现了多进程爬取任务。

功能是:获取新浪微博1000w用户的基本信息和每个爬取用户最近发表的50条微博,使用python编写，多进程爬取，将数据存储在了
mongodb中

sina_reptile's People

Contributors

gnemoug avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Forkers

gregorianzhang chenhbzl chermong daqing15 ongbe streambo myjack chu888chu888 chriszhou1986 mcpoet yyqvod zhangtianyi1234 publicbull huangciyin shou1989 mafing mwzkqmuuzkflbxm iamxiatian lemosa wisherg andy071001 jessicap stamhe lyhiving hacder williamtangzugang ericxsun ormuzd sunbin1021 superyxo zuckonit kunkun-tang caoleintu hong1830 zfu savanti yupengyan wfcadd swinghu xsongx dybwall1234 mmxpeng iiapache jwchennlp kathyuanxing zz198808 feitianxiaodai snaillin wangqiangit namezsw potatozhao qcdcool qq40660 nashxk suzhaolong zhengyouxiang biznixcn mutefrank meloyou zjulib maxliaops wtaps zhanghoucheng zmoon111 beiyexertz liandesinian gladiator179 prostones wx2000 wanshimozun lucifer8900 badlarry happyboy2014 zhaoxinben ttluujn queserasit 4zc cnhacks wanghaisheng heber cnbird1999 hubeizk waytai juli-so jizhonglee ppisunshine sdutheone jaykizhou tucano2000 joeyxy hejunbok gitbyte wswenyue jimmycode2009 lokij1414 bbllxue unix8net godlzr nobsu xctsao

sina_reptile's Issues

Proposing a PR to fix a few small typos

Issue Type

[x] Bug (Typo)

Steps to Replicate and Expected Behaviour

  • Examine SDK1/weibopy/api.py and observe mulitpart, however expect to see multipart.
  • Examine SDK1/weibopy/streaming.py and observe arrvies, however expect to see arrives.

Notes

Semi-automated issue generated by
https://github.com/timgates42/meticulous/blob/master/docs/NOTE.md

To avoid wasting CI processing resources a branch with the fix has been
prepared but a pull request has not yet been created. A pull request fixing
the issue can be prepared from the link below, feel free to create it or
request @timgates42 create the PR. Alternatively if the fix is undesired please
close the issue with a small comment about the reasoning.

https://github.com/timgates42/sina_reptile/pull/new/bugfix_typos

Thanks.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.