Add recent_days parameter to crawler API for backfills

[prasjaiswal]

Summary

• Adds optional recent_days parameter to the POST /api/sites/{site}/schema-files endpoint
• Currently only affects aajtak.in, which filters to recent files to avoid processing 1,500+ historical files on every refresh
• Pass "recent_days": 1501 for a one-time full historical backfill; omit it for normal scheduled crawling (default 2 days)

Usage

# One-time full backfill
curl -X POST ".../api/sites/aajtak.in/schema-files" \
  -d '{"schema_map_url": "...", "recent_days": 1501}'

# Normal scheduled crawl (uses default 2 days)
curl -X POST ".../api/sites/aajtak.in/schema-files" \
  -d '{"schema_map_url": "..."}'

Test plan

• make check passes (ruff, pyright 0 errors, 23 tests pass)
• Tested locally: recent_days=1501 queued 1,501 jobs; default queued 3

🤖 Generated with Claude Code