Description This is a web scraping tool that allows you to extract links and data from a website. The tool provides four scraping methods:

1. Scrape subdomain & related links
2. Scrape pages links
3. Scrape robots.txt
4. Scrape embedded links

To use the ScrapEZ web scraping tool, follow these steps:

1. Clone the repository: Run git clone https://github.com/jakk-er/ScrapEZ.git to clone the repository to your local machine.

git clone https://github.com/jakk-er/ScrapEZ.git

2. Install dependencies: Run pip install -r requirements.txt to install the required dependencies, including requests, beautifulsoup4 and urllib.parse.

pip install -r requirements.txt

3. Run the script: Run python scrapez.py.

python scrapez.py

Note: Make sure you have Python installed on your system, along with the required dependencies. If you're using a virtual environment, activate it before running the script.

Run the script and enter the website URL when prompted. Choose which scraping methods to use by entering the corresponding numbers (separated by commas). The tool will extract the requested data and print it to the console.

Example Usage

Here are some example usage scenarios:

• To scrape subdomain & related links and pages links from https://example.com, enter: https://example.com press enter and then choose 1,2 or example.com press enter and then choose 1,2

• To scrape robots.txt and embedded links from https://www.example.net, enter: https://www.example.net press enter and then choose 3,4 or www.example.net press enter and then choose 3,4

• To scrape all available data from https://subdomain.example.io, enter: https://subdomain.example.io press enter and then choose 1,2,3,4 or subdomain.example.io press enter and then choose 1,2,3,4

This software is intended for educational purposes only. You agree to use the software solely for educational, research, or academic purposes, and not for any commercial or malicious activities.

You acknowledge that you are solely responsible for any misuse of the software, including but not limited to using it to target websites or systems without their permission. The authors and copyright holders shall not be liable for any damages or claims arising from such misuse.

You are permitted to modify the software for your own educational purposes, but you agree not to modify the software in a way that would compromise its integrity or security. You also agree not to remove or alter any copyright notices, trademarks, or other proprietary rights notices from the software.

When redistributing or sharing modified versions of the software, you must provide appropriate attribution, indicate if changes were made, and include a link to the original license.

This software requires the following dependencies:

1. requests
2. beautifulsoup4
3. urllib.parse
4. time
5. collections

jakk-er

1.0.1