Code Monkey home page Code Monkey logo

web-scraping's Introduction

web-scraping

Web-scraping practice:

Reference:
Online course https://www.inflearn.com/course/crawling-scrapy-selenium/dashboard
https://www.storybench.org/how-to-scrape-reddit-with-python/

  • 200811_Webcrawling_Basicpractice.ipynb
    : practicing with solving course assignments
  • 200827_Loneliness_Web-scraping_Practice.ipynb
    : practicing web-scraping of my own interest based on codes learned from the course

Web-scraping for research:

Reference:
https://praw.readthedocs.io/en/latest/
https://www.storybench.org/how-to-scrape-reddit-with-python/
https://github.com/pushshift/api
https://rareloot.medium.com/using-pushshifts-api-to-extract-reddit-submissions-fb517b286563
https://colab.research.google.com/drive/1biLcXeHs8yZD1x9f3gv-cNJXEq7tpyoO?usp=sharing
https://www.osrsbox.com/blog/2019/03/18/watercooler-scraping-an-entire-subreddit-2007scape/

  • 210106_Loneliness_Web_scraping_for_research.ipynb
    : web-scraping loneliness-related data from Reddit using PRAW and Pushshift API
    : Jung, Y., Lee, YK., Hahn, S. (2021). Web-scraping the Expression of Loneliness during COVID-19. In Press.

web-scraping's People

Contributors

yoonwonj avatar

Watchers

James Cloos avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.