Torrscrapper

Torrscrapper is a web scraping application designed to extract torrents for various types of media, such as games, movies, and more. It enables users to search for torrents and view the results without the distraction of ads.

Getting Started

These instructions will help you set up and run the Torrscrapper application on your local machine.

Prerequisites

Before you begin, ensure you have the following software installed:

Python 3.x (Download Python)
Django (Download Django)

Start Searching

Run the below commands in the project directory:

pip install -r requirements.txt
python manage.py runserver

Now visit http://127.0.0.1:8000/ and start searching for your torrents without any ads.

Features

Advanced Scraping Techniques

Concurrent Scraping: Utilizes Python modules like asyncio to perform multiple web scraping requests simultaneously, significantly reducing the total time spent in scraping.
Cloudflare Bypass: Employs the cloudscrape module to effectively bypass Cloudflare security measures, ensuring reliable access to torrent sites.

Comprehensive Torrent Databases

Games Database: Features a pre-built SQLite database containing links to magnet files for over 3,000 popular games.
Movies Database: Comes with a pre-built SQLite database housing magnet links for more than 10,000 movies.

Ongoing Enhancements

Database Updates: Ongoing work includes updating the SQLite databases using Python scripts to ensure the latest and most popular content is readily available.
Site Support Expansion: Planning to extend support to additional torrent sites

getting this error when trying to start the server

C:\Users\fqf1f\torrscrapper>python manage.py runserver
Watching for file changes with StatReloader
Performing system checks...

Exception in thread django-main-thread:
Traceback (most recent call last):
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\threading.py", line 1038, in _bootstrap_inner
self.run()
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\threading.py", line 975, in run
self._target(*self._args, **self.kwargs)
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\site-packages\django\utils\autoreload.py", line 64, in wrapper
fn(*args, **kwargs)
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\site-packages\django\core\management\commands\runserver.py", line 133, in inner_run
self.check(display_num_errors=True)
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\site-packages\django\core\management\base.py", line 485, in check
all_issues = checks.run_checks(
^^^^^^^^^^^^^^^^^^
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\site-packages\django\core\checks\registry.py", line 88, in run_checks
new_errors = check(app_configs=app_configs, databases=databases)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\site-packages\django\core\checks\urls.py", line 14, in check_url_config
return check_resolver(resolver)
^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\site-packages\django\core\checks\urls.py", line 24, in check_resolver
return check_method()
^^^^^^^^^^^^^^
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\site-packages\django\urls\resolvers.py", line 494, in check
for pattern in self.url_patterns:
^^^^^^^^^^^^^^^^^
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\site-packages\django\utils\functional.py", line 57, in get
res = instance.dict[self.name] = self.func(instance)
^^^^^^^^^^^^^^^^^^^
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\site-packages\django\urls\resolvers.py", line 715, in url_patterns
patterns = getattr(self.urlconf_module, "urlpatterns", self.urlconf_module)
^^^^^^^^^^^^^^^^^^^
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\site-packages\django\utils\functional.py", line 57, in get
res = instance.dict[self.name] = self.func(instance)
^^^^^^^^^^^^^^^^^^^
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\site-packages\django\urls\resolvers.py", line 708, in urlconf_module
return import_module(self.urlconf_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\importlib_init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "", line 1206, in _gcd_import
File "", line 1178, in _find_and_load
File "", line 1149, in _find_and_load_unlocked
File "", line 690, in _load_unlocked
File "", line 940, in exec_module
File "", line 241, in call_with_frames_removed
File "C:\Users\fqf1f\torrscrapper\webapps\urls.py", line 20, in
path('',include('torrscrapper.urls')),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\site-packages\django\urls\conf.py", line 38, in include
urlconf_module = import_module(urlconf_module)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\fqf1f\AppData\Local\Programs\Python\Python311\Lib\importlib_init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "", line 1206, in _gcd_import
File "", line 1178, in _find_and_load
File "", line 1149, in _find_and_load_unlocked
File "", line 690, in _load_unlocked
File "", line 940, in exec_module
File "", line 241, in _call_with_frames_removed
File "C:\Users\fqf1f\torrscrapper\torrscrapper\urls.py", line 2, in
from . import views
File "C:\Users\fqf1f\torrscrapper\torrscrapper\views.py", line 6, in
from .scraping_utils import scrape_data
File "C:\Users\fqf1f\torrscrapper\torrscrapper\scraping_utils.py", line 9, in
import humanize
ModuleNotFoundError: No module named 'humanize'

izoogood / torrscrapper Goto Github PK

torrscrapper's Introduction

Torrscrapper

Getting Started

Prerequisites

Start Searching

Features

Advanced Scraping Techniques

Comprehensive Torrent Databases

Ongoing Enhancements

torrscrapper's People

Contributors

Stargazers

Watchers

Forkers

torrscrapper's Issues

Description

Logs

Steps to Reproduce

Possible Solutions

Recommend Projects

Recommend Topics

Recommend Org