Code Monkey home page Code Monkey logo

newsscraper's Introduction

MongoDB-NYT-Scraper || All the News That's Fit to Scrape

Overview

Create a web app that lets users view and leave comments on the latest news. But you're not going to actually write any articles; instead, you'll flex your Mongoose and Cheerio muscles to scrape news from another site.

This GitHub repo requires you to run npm init. When that's finished, install and save these npm packages:

  • express
  • express-handlebars
  • mongoose
  • body-parser
  • cheerio
  • request

To run this app, do the following:

  1. Clone this repo to your computer and open the folder in Visual Studio Code.
  2. Open your terminal and type npm install and press enter.
  3. Open another terminal/GitBashcd into the NewsScraper folder.
  4. Run mongoDB and listen to the PORT by typing mongod and press enter.
  5. In the terminal, type node server.js.
  6. Open your browser and type localhost:3000 into the URL.

Create an app that accomplishes the following:

  • Whenever a user visits this site, the app should scrape stories from a news outlet of your choice and display them for the user.
  • Each scraped article should be saved to your application database.
  • At a minimum, the app should scrape and display the following information for each article:
  • Headline - the title of the article
  • Summary - a short summary of the article
  • URL - the url to the original article
  • Users should also be able to leave comments on the articles displayed and revisit them later.
  • The comments should be saved to the database as well and associated with their articles.
  • Users should also be able to delete comments left on articles.
  • All stored comments should be visible to every user.

Happy Scraping!

newsscraper's People

Contributors

kyoukel avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.