fs traversal caching causes generation changes

[jbedard]

There have been confirmed reports of 4b308b7 causing issues when using --watch mode. Incremental gazelle executions with the same changes (and passing those changed directories on the CLI) does not reproduce the same issue so it seems to be something related to 4b308b7 that only takes effect when using --watch.