Skip to content

Commit 3f5d174

Browse files
aaronp24gitster
authored andcommitted
packfile: skip hash checks in add_promisor_object()
When is_promisor_object() is called for the first time, it lazily initializes a set of all promisor objects by iterating through all objects in promisor packs. For each object, add_promisor_object() calls parse_object(), which decompresses and hashes the entire object. For repositories with large pack files, this can take an extremely long time. For example, on a production repository with a 176 GB promisor pack: $ time ~/git/git/git-rev-list --objects --all --exclude-promisor-objects --quiet ________________________________________________________ Executed in 76.10 mins fish external usr time 72.10 mins 1.83 millis 72.10 mins sys time 3.56 mins 0.17 millis 3.56 mins add_promisor_object() just wants to construct the set of all promisor objects, so it doesn't really need to verify the hash of every object. Set PARSE_OBJECT_SKIP_HASH_CHECK to skip the hash check. This has the side effect of skipping decompression of blob objects completely, saving a significant amount of time: $ time ~/git/git/git-rev-list --objects --all --exclude-promisor-objects --quiet ________________________________________________________ Executed in 124.70 secs fish external usr time 46.94 secs 0.00 millis 46.94 secs sys time 43.11 secs 1.03 millis 43.11 secs Signed-off-by: Aaron Plattner <[email protected]> Signed-off-by: Junio C Hamano <[email protected]>
1 parent 3c7c41d commit 3f5d174

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

packfile.c

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2310,7 +2310,8 @@ static int add_promisor_object(const struct object_id *oid,
23102310
we_parsed_object = 0;
23112311
} else {
23122312
we_parsed_object = 1;
2313-
obj = parse_object(pack->repo, oid);
2313+
obj = parse_object_with_flags(pack->repo, oid,
2314+
PARSE_OBJECT_SKIP_HASH_CHECK);
23142315
}
23152316

23162317
if (!obj)

0 commit comments

Comments
 (0)