es[][o.e.t.TransportService] Received response for a request that has timed out

Hello,

While sonarqube is up in container (running state) as service (sonarqube + postgres running in k8s cluster and data is mounted on NFS) but its not accessible from web.
When we fetched the logs we are getting

es.log

es[][o.e.c.InternalClusterInfoService] failed to retrieve shard stats from node [fewalphabetslookslikeid]: [sonarqube][127.0.0.1:39167][indices:monitor/stats[n]] request_id [number2] timed out after [15008ms]
2022.11.13 17:25:27 WARN  es[][o.e.c.InternalClusterInfoService] failed to retrieve stats for node [fewalphabetslookslikeid]: [sonarqube][127.0.0.1:39167][cluster:monitor/nodes/stats[n]] request_id [number] timed out after [15008ms]
2022.11.13 17:25:35 WARN  es[][o.e.t.TransportService] Received response for a request that has timed out, sent [23.4s/23412ms] ago, timed out [8.4s/8404ms] ago, action [cluster:monitor/nodes/stats[n]], node [{sonarqube}{fewalphabetslookslikeid}{fewalphabetslookslikeid}{127.0.0.1}{127.0.0.1:39167}{cdfhimrsw}{rack_id=sonarqube}], id [number] 

sonar.log

WARN  es[][o.e.m.f.FsHealthService] health check of [/opt/sonarqube/data/es7/nodes/0] took [59635ms] which is above the warn threshold of [5s]

SonarQube Version - 8.9.
Tried changing permission on nfs share and deleting es7 folder and restarting the service then it works but issue comes again after a day or two.

Could you please help here?

Thx

Hi there, many thanks for reaching out.

Would it be possible to provide us with some more information, as below:

  1. What Kubernetes version are you using, and is it self-hosted?
  2. How is the NFS share configured (storage class by a cloud provider, or self-installed)?
  3. Is that specific mount used by many pods or just a single one? This could help us determine whether or not permissions are being affected from elsewhere.
  4. If you are using helm charts, could you provide us with the values file (ensure only non-sensitive data is provided :slight_smile:)

Looking forward to hearing from you.