Implement Nuget Data Sync Spider

[tonyqus]

• This spider will be used to crawl nuget.org and get a snapshot of the data of that day
• There are 500,000 packages there. We cannot monitor all. It's too much. We should set a number. Each day, it will catch daliy data per package.
• The spider should be polite enough to crawl the nuget website to avoid ban.
• We need all the package names from nuget.org to enable full site search. Even there is no history data for the package, we show a message on the package detail page
• We may consider use Serverless (AWS Lambda) to implement this spider
• The data will be saved in PostgreSQL

Nuget API Check

If possible, we can also use Nuget API. But I'm worrying it's too polite and has limitations to get all the data.

Nugettrends.com Check

This data source is mainly for history data.