Playground repo to explore git extensions for large files
Over the years, I've had visual assets stored in repositories or some derivative asset stored (e.g. perceptual hash). Unfortunately, there have been drawbacks (e.g. repo bloat, loss of original file). This repo is to explore the different options for storing large files in git
This list from https://www.perforce.com/blog/storing-large-binary-files-in-git-repositories covers a very large set of options. Here's our take on them:
Some of these projects require their own one-off commands instead of git add
and similar. We're skipping them for now as it'd be one more thing for developers to learn
We've skipped these projects due to requiring a non-3rd party hosting service (e.g. rsync
server, git-lfs
server). We might revisit them but we're prioritzing projects that support services like S3, Google Drive, or similar first
- git-lfs
- ๐ Requires custom server which likely means using GitHub's server
- GitHub's server costs $5/month, even if not many files are stored (e.g. 100kb -> $5, 5MB -> $5, 1GB -> $5)
- ๐ Requires custom server which likely means using GitHub's server
- git-fat
- ๐ Sounds great but only supports
rsync
- ๐ Sounds great but only supports
- git-bigfiles
- โ No updates since 2009
- git-sym
- โ No data integrity guarantee
- git-bigstore
- Looks great, let's check it out (purpose of this repo)
As of Mar 19 2018, Todd Wolfson has released this repository and its contents to the public domain.
It has been released under the UNLICENSE.