Code Monkey home page Code Monkey logo

fetches-all-links's Introduction

fetches-all-links

image

Web Link Scraper

Web Link Scraper is a Python script that allows you to fetch all links from a given webpage and save them to a text file, grouped by domain. The script also includes a Dracula theme for the terminal interface, a hero section with credits for the author, and options to retry or close the program.

Prerequisites

Before running the script, ensure you have the following installed:

  • Python
  • Required Python libraries (requests, beautifulsoup4, pyfiglet, colorama)

You can install the required libraries using pip:

pip install requests beautifulsoup4 pyfiglet colorama

How to Use

  1. Clone this repository:
git clone https://github.com/harindujayakody/fetches-all-links.git
  1. Navigate to the repository directory:
cd your-repo
  1. Run the Python script:
python fetch.py
  1. Follow the on-screen instructions to enter the URL of the webpage you want to scrape.

  2. The script will save the links to a text file named links.txt, grouped by domain. You can find this file in the same directory where the script is located.

  3. You'll also see a Dracula-themed terminal interface with a hero section displaying credits for the author and a link to the GitHub repository.

  4. After running the script, you can choose to retry or close the program.

Customization

You can customize the script by modifying the following sections in the web_link_scraper.py file:

  • Author and GitHub Repo: Update the author's name and GitHub repository URL in the hero section.

  • ASCII Art Heading: Customize the ASCII art heading by changing the text and font in the pyfiglet.figlet_format function.

  • Dracula Theme: If you prefer a different color theme, you can modify the terminal colors in the script.

Credits

This script is created by Harindu Jayakody.

License

This project is licensed under the MIT License - see the LICENSE file for details.

fetches-all-links's People

Contributors

harindujayakody avatar

Stargazers

 avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.