Deduplication

[calebcase]

Forks of large repos can result in considerable wasted space due to duplicates.

Here are some related issues from gitlab and github attempting to deal with the duplication:
https://gitlab.com/gitlab-org/gitlab-foss/issues/23029
https://gitlab.com/groups/gitlab-org/-/epics/189
https://github.blog/2015-09-22-counting-objects/

This related feature was merged to upstream git tooling:
https://github.blog/2019-02-24-highlights-from-git-2-21/#delta-islands

Additionally GIT_COMMON_DIR may be useful in this situation.

We should test out different methods with the intention of making it easy to clone directly from storj and have it "just work" ™️.

[montyanderson]

@calebcase Do you have any idea which of these solutions could be the best?

[calebcase]

I think the most promising option is to use git alternates, but more experimentation needs to be done to confirm it will work.