Health check endpoint gets unresponsive

[astsiapanay]

Name and Version

core 0.40

What steps will reproduce the bug?

1. Send a batch of file upload requests to the Core let's 300 requests in batch
2. Keep the batch active for a while let's say for a couple minutes. That means if we have 1000 files to be uploaded we send more files if the batch size is less than 300 at any time.
3. Periodically sends requests to the health check endpoint let's say every 10 seconds

What is the expected behavior?

The health endpoint should responds with 200

What do you see instead?

Warning Unhealthy 2m46s (x34 over 7m55s) kubelet Readiness probe failed: Get "http://localhost:8080/health": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

Additional information

No response

[astsiapanay]

All worker(carrier) threads are in the waiting state. Virtual threads to upload files parked carrier threads because of a block synchronize appears in the execution flow.