Code Monkey home page Code Monkey logo

civitdl's Introduction

civitdl (civitai-batch-download)

(QUICK NOTE: CivitAI seems to have changed their API so that it will require an API key for all model downloads, please see API Key Page for instructions)

Note v2 has some changes regarding the cli args of the program. Please read the README below or run civitdl --help for the new arguments!

Uses CLI to batch download Stable Diffusion models, metadata (including description of model, author, base model, example prompts and etc.) and example images (default is 3) of checkpoints, loras, and TI models from civitai!

One thing to note is that for sfw models, currently, the program is set to only download sfw images. Please note that there may be sfw models that are rated as nsfw by CivitAI (and vice versa).


Navigate


Table Of Contents


Getting Started

Dependencies

  • Python3.8 or above
  • requirements.txt

Installing

Install using PIP

pip3 install civitdl 
# pip install civitdl # if pip3 is not found

Build from source 1

git clone https://github.com/OwenTruong/civitdl.git # Clone the project
cd civitdl # CD into project directory
pip3 install . # Use pip if pip3 is not found

Build from source 2 (if the instruction above fails with UNKNOWN package installed, else ignore this section)

# Make sure you are in project directory # use pip if pip3 is not found
python3 -m build
pip3 install -r ./requirements.txt
pip3 install --upgrade dist/*.whl

Quick Start

To get started quickly, copy the command below.

civitdl 123456 ./models
  • Replace 123456 your model of choice (it can be a civitai.com url or model id).
  • Replace ./models with the directory you wish to download the model to.

Configuration Program Options - civitconfig

  • Configuring the program might make your life easier. You would be able to set default sorter, max images, and api key to use without running any of those options in the main program!
    • You would also be able to add and delete sorters and aliases from the program.
    • Check civitconfig doc.
  • Run civitconfig --help to check what options are available!

Changes in v2 from v1

  • basic and tags sorter now downloads metadata and images to /parent_dir/extra_data/ instead of to /parent_dir/
  • Sorter is now more flexible/customizable (i.e. able to select individual paths model, metadata and images should go to)
  • Added support for providing API Key to program to download restricted models.
  • Added multiple new options to the main program, civitdl.
  • Added configuration to set defaults for options, and to create alias + sorters.
  • Concurrently download images.
  • Isolates each image's prompt/metadata from the model's metadata.
  • Able to retry download if model fails initially.
  • Faster requests.
  • Added features to skip model download if model already exists in path, or locally in cache.

Troubleshooting


If you encounter similar warning on Linux/Windows while building and installing manually:

  WARNING: The script civitdl is installed in '/home/OwenTruong/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.

For Linux, please concat the path to your PATH env, example:

echo 'PATH="$HOME/.local/bin:"$PATH' >> ~/.bashrc
source ~/.bashrc

For Windows, this may help: https://www.computerhope.com/issues/ch000549.htm

If you are building from source and the following packages are not available setuptools, wheel, build, please install them with pip install setuptools wheel build



Contributing

Thanks for the interest in the project!

Please create an issue if you encounter any problem, bugs or if you have a feature request.

To debug things, it is recommended to run with --verbose option.

  • Running in verbose allows users to print tracebacks and other messages useful for debugging.
  • Example: civitdl 123456 ./models --verbose

To work on an issue:

  • Please create a fork.
  • Then clone your fork locally.
  • Then create a local branch that describes the issue.
  • Once you have commited your changes, push the branch to your forked repository.
  • Then open a pull request to this repository.

License

This project is licensed under the Apache License 2.0 - see the LICENSE.md file for details

civitdl's People

Contributors

owentruong avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.