Fix skip-existing infinite loop and add --debug flag - #47
Fix skip-existing infinite loop and add --debug flag#47WesleyBlancoYuan wants to merge 1 commit into
Conversation
|
Sorry for the urgent commit again(really sorry!), as midnight of 2026.3.28 is approaching (~4h left at the moment when I am writing this), and Kanata membership will end soon. It is still somehow fragile, but is better than before. |
When using --skip-existing, skipped post URLs were never added to self.seen, causing find_posts() to return the same URL repeatedly and the archiver to stall instead of advancing to new posts. Also adds a --debug CLI flag that enables detailed logging for post processing, comment collection, tab management, and scroll detection to aid future troubleshooting. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
|
@Pyreko you can separate this to 2 commits or do whatever you want with it. The fix itself is one line, the rest is adding debug flag to everywhere. I am working on a non-usual PC so I cannot do it properly and sorry for that. |
|
All good, I'll probably remove the debug stuff as there's a better way of doing it. |
2 participants
When using --skip-existing, skipped post URLs were never added to self.seen, causing find_posts() to return the same URL repeatedly and the archiver to stall instead of advancing to new posts.
Also adds a --debug CLI flag that enables detailed logging for post processing, comment collection, tab management, and scroll detection to aid future troubleshooting.