Error 503 with lychee / OK with browser

[smutel]

Hello,

We encounter this issue:

[403] https://developers.redhat.com/articles/2024/02/08/how-visualize-your-openscap-compliance-reports | Rejected status code (this depends on your "accept" configuration): Forbidden

However this site is available with a web browser.

Regards.

[mre]

This works:

echo 'https://developers.redhat.com/articles/2024/02/08/how-visualize-your-openscap-compliance-reports' | lychee -vvv --user-agent "curl/8.4.0" -

So you need to use a different user agent. This is not a lychee problem, but an issue with the website configuration. It doesn't accept our user agent and thinks it's a bot.

[thomas-zahner]

Thanks for reporting, we try to address this in the future by making lychee use an accepted User-Agent header by default by using adding host config defaults: #1960. This way you won't need to override the header value as it is known as a quirk by lychee.