A simple web crawler which can crawl the web, given a url.
To check the working of the web crawler, please type this command on the command line:
python filename.py url_to_be_crawled
filename.py, refers to the name of the program saved in the system.
url_to_be_crawled, refers to the url the user wants to crawl.
It's better to keep python3 by default.