Code Monkey home page Code Monkey logo

large-file-playground's Introduction

large-file-playground

Playground repo to explore git extensions for large files

Over the years, I've had visual assets stored in repositories or some derivative asset stored (e.g. perceptual hash). Unfortunately, there have been drawbacks (e.g. repo bloat, loss of original file). This repo is to explore the different options for storing large files in git

Overview

This list from https://www.perforce.com/blog/storing-large-binary-files-in-git-repositories covers a very large set of options. Here's our take on them:

Skipped: One-off commands

Some of these projects require their own one-off commands instead of git add and similar. We're skipping them for now as it'd be one more thing for developers to learn

Skipped: Not third party

We've skipped these projects due to requiring a non-3rd party hosting service (e.g. rsync server, git-lfs server). We might revisit them but we're prioritzing projects that support services like S3, Google Drive, or similar first

  • git-lfs
    • ๐Ÿ‘Ž Requires custom server which likely means using GitHub's server
      • GitHub's server costs $5/month, even if not many files are stored (e.g. 100kb -> $5, 5MB -> $5, 1GB -> $5)
  • git-fat
    • ๐Ÿ‘Ž Sounds great but only supports rsync

Rejected

Pending exploration

  • git-bigstore
    • Looks great, let's check it out (purpose of this repo)

Unlicense

As of Mar 19 2018, Todd Wolfson has released this repository and its contents to the public domain.

It has been released under the UNLICENSE.

large-file-playground's People

Contributors

twolfson avatar

Watchers

James Cloos avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.