Duplicate digest handling is overly conservative for media archives

[mervenator]

So far every time I run the tool, I have found that it renamed loads of folders and files, but forgets to move a few files/folders within renamed folders, while moving most of the other files/folders listed there.

I could understand when the restructuring is too complicated for the tool to handle, but it actually does find the folders that need to be renamed and moves loads of files/subfolders from the folders, so it does a good job, but for some reason sometimes it does not move all of them.

Reproducibility:
I have reproduced this behavior several times, using mostly a large amount of changes by renaming and moving folders only (so no changes to files or moving files around). Often it seems all files in a certain subfolder have not been moved, but it also happens that only part of the files in a subfolder were moved. I cannot see any pattern.

NOTE: I have not been able to reproduce it yet with small data sets

Workarounds:
Not sure if this is behavior is known, but it sounds like an issue to me. Of course rsync will do the work afterwords, so no harm done, but it makes the tool much less efficient when large files are involved.

Repeating the action (executing sidekick again) will not find any files to move anymore, I am not sure if this is normal, or that it actually confirms the problem that it does not want to moved these files. In general it would be great if it could figure out that the 'forgotten' files still have to be moved, to have a workaround by simply running sidekick twice.

Environment:
Mac Air, sidekick v1.8.0, sync with external drive (at least from MacOs extended to APFS, but also seen without APFS)