bigveezus / nodecrawler Goto Github PK

An application that crawls and scraps all internal links of a website/url.

Install the project with npm install

  npm install 

To begin, in your command line in the project enter

node main.js <url>

Make sure you replace the "url" in the field with the url you want to scrape.

After the url has been scraped, a Report.txt file will be generated at the bottom of your directory.

Open and view your internal links, Thank you for using this project.

• Sincerely @bigVeezus