Code Monkey home page Code Monkey logo

grimoire's Introduction


πŸͺ­ - Grimoire is self-hosted manga reader & downloader. Supporting multiple scan-sites and aggregating sites.

βš”οΈ Features:

For full list of planned features or features in development, please check issues

  • Currently supports saving mangas from sources to database to reduce requests
  • Memory cache for quicker access to manga/chapters/images | Can be disabled for direct access
  • Supporting multiple sources (more added with time)
  • Parallel & Asynchronous for faster parsing and fetching data

🐳 Docker:

  • To build it yourself, download Dockerfile from here.
  • To use pre-built images, download docker-compose.yml from here and run docker compose up -d.

πŸ“Έ Images:

image

image

image

πŸ€” FAQ:

  • Can I use it? Is it production ready?

Absolutely YES! Use it at your own risk though.

  • Why not some 3rd party pre-existing program that does what your program does already with support for 500 sites?

L + ratio + too many sites + too slow + doesn't work as expected + can't relate + old UI + be better

  • Can you add xyz site please?

yeah sure, just make sure you give all the necessary information for scraping πŸ˜’

  • I GOT BANNED FROM WEBSITE XYZ IP BLACKLISTED HELPPPP!!!

refer to FAQ #1, welcome to the club! Use a VPN next time.

grimoire's People

Contributors

yucked avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

grimoire's Issues

[BREAKFIX] Encoding Urls & Sources

  • Blazor doesn't encode URLs by default
    Resources names have been replaced with encoded ids instead

  • Replace white space in source name with '_' underscore (for images)

[SOURCE] aquamanga.com

action | "madara_load_more"
page | "4"
template | "madara-core/content/content-archive"
vars[paged] | "1"
vars[orderby] | "meta_value_num"
vars[template] | "archive"
vars[sidebar] | "right"
vars[post_type] | "wp-manga"
vars[post_status] | "publish"
vars[meta_key] | "_latest_update"
vars[order] | "desc"
vars[meta_query][relation] | "AND"
vars[manga_archives_item_layout] | "big_thumbnail"

[FEATURE] Queue-ing HTTP requests

Project on hold till I can figure out a way to queue HTTP requests with a delay to avoid being banned from websites and/or some proxy.

Tried TOR but cloudflare says πŸ«·πŸ€šβœ‹πŸ«ΈπŸ›‘πŸš«β›”, most of the HTTP/HTTPS/SOCKS5 proxies are crap and fail 85% of the time.

Web Server not starting

failed to load cinfugration from /app/out/config.json

the input does not contain any json tokens ?

After I docker compose up -d

and check the logs it did say that error, please help, Thanks!

[FEATURE] Caching

Few options here:

01:

No caching, everything gets loaded directly from sources and displayed as is

02:

In-memory cache & directory caching. Images are stored in local directory for faster access. May require calculating md5 hash of images to avoid outdated images. In-memory cache keeps track of loaded sources and manga.

03:

SurrealDB for long-term storage along with directory based storage.

Cache will expire after certain period of time (defined by user). An automatic service that fetches data every x minutes or hours https://learn.microsoft.com/en-us/dotnet/architecture/microservices/multi-container-microservice-net-applications/background-tasks-with-ihostedservice

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.