SonarQube is down after connecting with SonarLint

If your question is about SonarLint in the IntelliJ Platform, VS Code, Visual Studio, or Eclipse, please post it in that sub-category.

Otherwise, please provide:

  • Operating system: Latest Instance of Amazon Linux 2 and connected to external postgres DB via RDS service
  • IDE name and flavor/env: VScode 1.84.1

And a thorough description of the problem / question:
SonarQube through 504 Gateway timeout / 502 Bad gateway error once connected with SonarLint for sometime

It is the latest version of 10.3, installed without Docker.
We have switched to the standalone version instead of Docker, as we suspected Docker is causing these issues, later figured it out that sonarlint connection is causing these issues.

I have added list of logs below, compute log, process logs, etc

2024.02.13 11:32:47 INFO  app[][o.s.a.SchedulerImpl] Stopping SonarQube
2024.02.13 11:32:47 INFO  app[][o.s.a.SchedulerImpl] Sonarqube has been requested to stop
2024.02.13 11:32:47 INFO  app[][o.s.a.SchedulerImpl] Stopping [Compute Engine] process...
2024.02.13 11:32:48 WARN  app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [Compute Engine]: 143
2024.02.13 11:32:48 INFO  app[][o.s.a.SchedulerImpl] Process[Compute Engine] is stopped
2024.02.13 11:32:48 INFO  app[][o.s.a.SchedulerImpl] Stopping [Web Server] process...
2024.02.13 11:32:48 WARN  app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [ElasticSearch]: 143
2024.02.13 11:32:48 INFO  app[][o.s.a.SchedulerImpl] Process[ElasticSearch] is stopped
2024.02.13 11:32:50 INFO  app[][o.s.a.SchedulerImpl] Process[Web Server] is stopped
2024.02.13 11:32:50 WARN  app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [Web Server]: 143
2024.02.13 11:32:50 INFO  app[][o.s.a.SchedulerImpl] SonarQube is stopped
2024.02.13 11:32:50 INFO  app[][o.s.a.SchedulerImpl] Stopping [ElasticSearch] process...
2024.02.13 11:39:17 INFO  app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /var/sonarqube/temp
2024.02.13 11:39:17 INFO  app[][o.s.a.es.EsSettings] Elasticsearch listening on [HTTP: 127.0.0.1:9001, TCP: 127.0.0.1:35473]
2024.02.13 11:39:18 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[ELASTICSEARCH] from [/opt/sonarqube-10.3.0.82913/elasticsearch]: /opt/java/jdk-17.0.10/bin/java -Xms4m -Xmx64m -XX:+UseSerialGC -Dcli.name=server -Dcli.script=./bin/elasticsearch -Dcli.libs=lib/tools/server-cli -Des.path.home=/opt/sonarqube-10.3.0.82913/elasticsearch -Des.path.conf=/var/sonarqube/temp/conf/es -Des.distribution.type=tar -cp /opt/sonarqube-10.3.0.82913/elasticsearch/lib/*:/opt/sonarqube-10.3.0.82913/elasticsearch/lib/cli-launcher/* org.elasticsearch.launcher.CliToolLauncher
2024.02.13 11:39:18 INFO  app[][o.s.a.SchedulerImpl] Waiting for Elasticsearch to be up and running
2024.02.13 11:39:25 INFO  app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /var/sonarqube/temp
2024.02.13 11:39:26 INFO  app[][o.s.a.es.EsSettings] Elasticsearch listening on [HTTP: 127.0.0.1:9001, TCP: 127.0.0.1:40173]
2024.02.13 11:39:26 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[ELASTICSEARCH] from [/opt/sonarqube-10.3.0.82913/elasticsearch]: /opt/java/jdk-17.0.10/bin/java -Xms4m -Xmx64m -XX:+UseSerialGC -Dcli.name=server -Dcli.script=./bin/elasticsearch -Dcli.libs=lib/tools/server-cli -Des.path.home=/opt/sonarqube-10.3.0.82913/elasticsearch -Des.path.conf=/var/sonarqube/temp/conf/es -Des.distribution.type=tar -cp /opt/sonarqube-10.3.0.82913/elasticsearch/lib/*:/opt/sonarqube-10.3.0.82913/elasticsearch/lib/cli-launcher/* org.elasticsearch.launcher.CliToolLauncher
2024.02.13 11:39:26 INFO  app[][o.s.a.SchedulerImpl] Waiting for Elasticsearch to be up and running
2024.02.13 11:39:49 INFO  app[][o.s.a.SchedulerImpl] Process[es] is up
2024.02.13 11:39:49 INFO  app[][o.s.a.SchedulerImpl] Process[es] is up
2024.02.13 11:39:49 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[WEB_SERVER] from [/opt/sonarqube-10.3.0.82913]: /opt/java/jdk-17.0.10/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/var/sonarqube/temp -XX:-OmitStackTraceInFastThrow --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED --add-exports=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.management/sun.management=ALL-UNNAMED --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED -Dcom.redhat.fips=false -Xmx512m -Xms128m -XX:+HeapDumpOnOutOfMemoryError -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/sonar-application-10.3.0.82913.jar:/opt/sonarqube-10.3.0.82913/lib/jdbc/postgresql/postgresql-42.6.0.jar org.sonar.server.app.WebServer /var/sonarqube/temp/sq-process3801993330722922097properties
2024.02.13 11:39:49 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[WEB_SERVER] from [/opt/sonarqube-10.3.0.82913]: /opt/java/jdk-17.0.10/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/var/sonarqube/temp -XX:-OmitStackTraceInFastThrow --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED --add-exports=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.management/sun.management=ALL-UNNAMED --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED -Dcom.redhat.fips=false -Xmx512m -Xms128m -XX:+HeapDumpOnOutOfMemoryError -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/sonar-application-10.3.0.82913.jar:/opt/sonarqube-10.3.0.82913/lib/jdbc/postgresql/postgresql-42.6.0.jar org.sonar.server.app.WebServer /var/sonarqube/temp/sq-process15500555260127536714properties
2024.02.13 11:39:51 WARN  app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [ElasticSearch]: 1
2024.02.13 11:39:51 INFO  app[][o.s.a.SchedulerImpl] Process[ElasticSearch] is stopped
2024.02.13 11:39:51 INFO  app[][o.s.a.SchedulerImpl] Process[Web Server] is stopped
2024.02.13 11:39:51 INFO  app[][o.s.a.SchedulerImpl] SonarQube is stopped
2024.02.13 11:40:07 INFO  app[][o.s.a.SchedulerImpl] Process[web] is up
2024.02.13 11:40:07 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[COMPUTE_ENGINE] from [/opt/sonarqube-10.3.0.82913]: /opt/java/jdk-17.0.10/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/var/sonarqube/temp -XX:-OmitStackTraceInFastThrow --add-opens=java.base/java.util=ALL-UNNAMED --add-exports=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.management/sun.management=ALL-UNNAMED --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED -Dcom.redhat.fips=false -Xmx512m -Xms128m -XX:+HeapDumpOnOutOfMemoryError -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/sonar-application-10.3.0.82913.jar:/opt/sonarqube-10.3.0.82913/lib/jdbc/postgresql/postgresql-42.6.0.jar org.sonar.ce.app.CeServer /var/sonarqube/temp/sq-process2819395058009176609properties
2024.02.13 11:40:14 INFO  app[][o.s.a.SchedulerImpl] Process[ce] is up
2024.02.13 11:40:14 INFO  app[][o.s.a.SchedulerImpl] SonarQube is operational
2024.02.13 11:41:11 INFO  app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /var/sonarqube/temp
2024.02.13 11:41:12 INFO  app[][o.s.a.es.EsSettings] Elasticsearch listening on [HTTP: 127.0.0.1:9001, TCP: 127.0.0.1:35119]
2024.02.13 11:41:12 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[ELASTICSEARCH] from [/opt/sonarqube-10.3.0.82913/elasticsearch]: /opt/java/jdk-17.0.10/bin/java -Xms4m -Xmx64m -XX:+UseSerialGC -Dcli.name=server -Dcli.script=./bin/elasticsearch -Dcli.libs=lib/tools/server-cli -Des.path.home=/opt/sonarqube-10.3.0.82913/elasticsearch -Des.path.conf=/var/sonarqube/temp/conf/es -Des.distribution.type=tar -cp /opt/sonarqube-10.3.0.82913/elasticsearch/lib/*:/opt/sonarqube-10.3.0.82913/elasticsearch/lib/cli-launcher/* org.elasticsearch.launcher.CliToolLauncher
2024.02.13 11:41:12 INFO  app[][o.s.a.SchedulerImpl] Waiting for Elasticsearch to be up and running
2024.02.13 11:41:13 INFO  app[][o.s.a.SchedulerImpl] Process[es] is up
2024.02.13 11:41:13 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[WEB_SERVER] from [/opt/sonarqube-10.3.0.82913]: /opt/java/jdk-17.0.10/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/var/sonarqube/temp -XX:-OmitStackTraceInFastThrow --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED --add-exports=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.management/sun.management=ALL-UNNAMED --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED -Dcom.redhat.fips=false -Xmx512m -Xms128m -XX:+HeapDumpOnOutOfMemoryError -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/sonar-application-10.3.0.82913.jar:/opt/sonarqube-10.3.0.82913/lib/jdbc/postgresql/postgresql-42.6.0.jar org.sonar.server.app.WebServer /var/sonarqube/temp/sq-process2968364634623369223properties
2024.02.13 11:41:16 INFO  app[][o.s.a.SchedulerImpl] Process[Web Server] is stopped
2024.02.13 11:41:16 WARN  app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [ElasticSearch]: 143
2024.02.13 11:41:16 INFO  app[][o.s.a.SchedulerImpl] Process[ElasticSearch] is stopped
2024.02.13 11:41:16 INFO  app[][o.s.a.SchedulerImpl] SonarQube is stopped
2024.02.13 11:32:47 INFO  ce[][o.s.p.ProcessEntryPoint] Gracefully stopping process
2024.02.13 11:32:47 INFO  ce[][o.s.ce.app.CeServer] Compute Engine is stopping...
2024.02.13 11:32:47 INFO  ce[][o.s.c.t.CeProcessingSchedulerImpl] Gracefully stopping workers...
2024.02.13 11:32:47 INFO  ce[][c.z.h.HikariDataSource] HikariPool-1 - Shutdown initiated...
2024.02.13 11:32:47 INFO  ce[][c.z.h.HikariDataSource] HikariPool-1 - Shutdown completed.
2024.02.13 11:32:47 INFO  ce[][o.s.ce.app.CeServer] Compute Engine is stopped
2024.02.13 11:40:08 INFO  ce[][o.s.p.ProcessEntryPoint] Starting Compute Engine
2024.02.13 11:40:08 INFO  ce[][o.s.ce.app.CeServer] Compute Engine starting up...
2024.02.13 11:40:09 INFO  ce[][o.s.d.DefaultDatabase] Create JDBC data source for jdbc:postgresql://sonarqubedb.cluster-cuns18w5lha2.us-east-1.rds.amazonaws.com/sonarqube
2024.02.13 11:40:09 INFO  ce[][c.z.h.HikariDataSource] HikariPool-1 - Starting...
2024.02.13 11:40:09 INFO  ce[][c.z.h.p.HikariPool] HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@476f9ca8
2024.02.13 11:40:09 INFO  ce[][c.z.h.HikariDataSource] HikariPool-1 - Start completed.
2024.02.13 11:40:12 INFO  ce[][o.s.s.p.ServerFileSystemImpl] SonarQube home: /opt/sonarqube-10.3.0.82913
2024.02.13 11:40:12 INFO  ce[][o.s.c.c.CePluginRepository] Load plugins
2024.02.13 11:40:13 INFO  ce[][o.s.c.c.ComputeEngineContainerImpl] Running Community edition
2024.02.13 11:40:13 INFO  ce[][o.s.ce.app.CeServer] Compute Engine is started
2024.02.13 11:32:47 INFO  app[][o.s.a.SchedulerImpl] Stopping SonarQube
2024.02.13 11:32:47 INFO  app[][o.s.a.SchedulerImpl] Sonarqube has been requested to stop
2024.02.13 11:32:47 INFO  app[][o.s.a.SchedulerImpl] Stopping [Compute Engine] process...
2024.02.13 11:32:48 WARN  app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [Compute Engine]: 143
2024.02.13 11:32:48 INFO  app[][o.s.a.SchedulerImpl] Process[Compute Engine] is stopped
2024.02.13 11:32:48 INFO  app[][o.s.a.SchedulerImpl] Stopping [Web Server] process...
2024.02.13 11:32:48 WARN  app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [ElasticSearch]: 143
2024.02.13 11:32:48 INFO  app[][o.s.a.SchedulerImpl] Process[ElasticSearch] is stopped
2024.02.13 11:32:50 INFO  app[][o.s.a.SchedulerImpl] Process[Web Server] is stopped
2024.02.13 11:32:50 WARN  app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [Web Server]: 143
2024.02.13 11:32:50 INFO  app[][o.s.a.SchedulerImpl] SonarQube is stopped
2024.02.13 11:32:50 INFO  app[][o.s.a.SchedulerImpl] Stopping [ElasticSearch] process...
2024.02.13 11:39:17 INFO  app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /var/sonarqube/temp
2024.02.13 11:39:17 INFO  app[][o.s.a.es.EsSettings] Elasticsearch listening on [HTTP: 127.0.0.1:9001, TCP: 127.0.0.1:35473]
2024.02.13 11:39:18 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[ELASTICSEARCH] from [/opt/sonarqube-10.3.0.82913/elasticsearch]: /opt/java/jdk-17.0.10/bin/java -Xms4m -Xmx64m -XX:+UseSerialGC -Dcli.name=server -Dcli.script=./bin/elasticsearch -Dcli.libs=lib/tools/server-cli -Des.path.home=/opt/sonarqube-10.3.0.82913/elasticsearch -Des.path.conf=/var/sonarqube/temp/conf/es -Des.distribution.type=tar -cp /opt/sonarqube-10.3.0.82913/elasticsearch/lib/*:/opt/sonarqube-10.3.0.82913/elasticsearch/lib/cli-launcher/* org.elasticsearch.launcher.CliToolLauncher
2024.02.13 11:39:18 INFO  app[][o.s.a.SchedulerImpl] Waiting for Elasticsearch to be up and running
2024.02.13 11:39:25 INFO  app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /var/sonarqube/temp
2024.02.13 11:39:26 INFO  app[][o.s.a.es.EsSettings] Elasticsearch listening on [HTTP: 127.0.0.1:9001, TCP: 127.0.0.1:40173]
2024.02.13 11:39:26 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[ELASTICSEARCH] from [/opt/sonarqube-10.3.0.82913/elasticsearch]: /opt/java/jdk-17.0.10/bin/java -Xms4m -Xmx64m -XX:+UseSerialGC -Dcli.name=server -Dcli.script=./bin/elasticsearch -Dcli.libs=lib/tools/server-cli -Des.path.home=/opt/sonarqube-10.3.0.82913/elasticsearch -Des.path.conf=/var/sonarqube/temp/conf/es -Des.distribution.type=tar -cp /opt/sonarqube-10.3.0.82913/elasticsearch/lib/*:/opt/sonarqube-10.3.0.82913/elasticsearch/lib/cli-launcher/* org.elasticsearch.launcher.CliToolLauncher
2024.02.13 11:39:26 INFO  app[][o.s.a.SchedulerImpl] Waiting for Elasticsearch to be up and running
2024.02.13 11:39:49 INFO  app[][o.s.a.SchedulerImpl] Process[es] is up
2024.02.13 11:39:49 INFO  app[][o.s.a.SchedulerImpl] Process[es] is up
2024.02.13 11:39:49 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[WEB_SERVER] from [/opt/sonarqube-10.3.0.82913]: /opt/java/jdk-17.0.10/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/var/sonarqube/temp -XX:-OmitStackTraceInFastThrow --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED --add-exports=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.management/sun.management=ALL-UNNAMED --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED -Dcom.redhat.fips=false -Xmx512m -Xms128m -XX:+HeapDumpOnOutOfMemoryError -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/sonar-application-10.3.0.82913.jar:/opt/sonarqube-10.3.0.82913/lib/jdbc/postgresql/postgresql-42.6.0.jar org.sonar.server.app.WebServer /var/sonarqube/temp/sq-process3801993330722922097properties
2024.02.13 11:39:49 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[WEB_SERVER] from [/opt/sonarqube-10.3.0.82913]: /opt/java/jdk-17.0.10/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/var/sonarqube/temp -XX:-OmitStackTraceInFastThrow --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED --add-exports=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.management/sun.management=ALL-UNNAMED --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED -Dcom.redhat.fips=false -Xmx512m -Xms128m -XX:+HeapDumpOnOutOfMemoryError -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/sonar-application-10.3.0.82913.jar:/opt/sonarqube-10.3.0.82913/lib/jdbc/postgresql/postgresql-42.6.0.jar org.sonar.server.app.WebServer /var/sonarqube/temp/sq-process15500555260127536714properties
2024.02.13 11:39:51 WARN  app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [ElasticSearch]: 1
2024.02.13 11:39:51 INFO  app[][o.s.a.SchedulerImpl] Process[ElasticSearch] is stopped
2024.02.13 11:39:51 INFO  app[][o.s.a.SchedulerImpl] Process[Web Server] is stopped
2024.02.13 11:39:51 INFO  app[][o.s.a.SchedulerImpl] SonarQube is stopped
2024.02.13 11:40:07 INFO  app[][o.s.a.SchedulerImpl] Process[web] is up
2024.02.13 11:40:07 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[COMPUTE_ENGINE] from [/opt/sonarqube-10.3.0.82913]: /opt/java/jdk-17.0.10/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/var/sonarqube/temp -XX:-OmitStackTraceInFastThrow --add-opens=java.base/java.util=ALL-UNNAMED --add-exports=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.management/sun.management=ALL-UNNAMED --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED -Dcom.redhat.fips=false -Xmx512m -Xms128m -XX:+HeapDumpOnOutOfMemoryError -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/sonar-application-10.3.0.82913.jar:/opt/sonarqube-10.3.0.82913/lib/jdbc/postgresql/postgresql-42.6.0.jar org.sonar.ce.app.CeServer /var/sonarqube/temp/sq-process2819395058009176609properties
2024.02.13 11:40:14 INFO  app[][o.s.a.SchedulerImpl] Process[ce] is up
2024.02.13 11:40:14 INFO  app[][o.s.a.SchedulerImpl] SonarQube is operational
2024.02.13 11:41:11 INFO  app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /var/sonarqube/temp
2024.02.13 11:41:12 INFO  app[][o.s.a.es.EsSettings] Elasticsearch listening on [HTTP: 127.0.0.1:9001, TCP: 127.0.0.1:35119]
2024.02.13 11:41:12 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[ELASTICSEARCH] from [/opt/sonarqube-10.3.0.82913/elasticsearch]: /opt/java/jdk-17.0.10/bin/java -Xms4m -Xmx64m -XX:+UseSerialGC -Dcli.name=server -Dcli.script=./bin/elasticsearch -Dcli.libs=lib/tools/server-cli -Des.path.home=/opt/sonarqube-10.3.0.82913/elasticsearch -Des.path.conf=/var/sonarqube/temp/conf/es -Des.distribution.type=tar -cp /opt/sonarqube-10.3.0.82913/elasticsearch/lib/*:/opt/sonarqube-10.3.0.82913/elasticsearch/lib/cli-launcher/* org.elasticsearch.launcher.CliToolLauncher
2024.02.13 11:41:12 INFO  app[][o.s.a.SchedulerImpl] Waiting for Elasticsearch to be up and running
2024.02.13 11:41:13 INFO  app[][o.s.a.SchedulerImpl] Process[es] is up
2024.02.13 11:41:13 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[WEB_SERVER] from [/opt/sonarqube-10.3.0.82913]: /opt/java/jdk-17.0.10/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/var/sonarqube/temp -XX:-OmitStackTraceInFastThrow --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED --add-exports=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.management/sun.management=ALL-UNNAMED --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED -Dcom.redhat.fips=false -Xmx512m -Xms128m -XX:+HeapDumpOnOutOfMemoryError -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/sonar-application-10.3.0.82913.jar:/opt/sonarqube-10.3.0.82913/lib/jdbc/postgresql/postgresql-42.6.0.jar org.sonar.server.app.WebServer /var/sonarqube/temp/sq-process2968364634623369223properties
2024.02.13 11:41:16 INFO  app[][o.s.a.SchedulerImpl] Process[Web Server] is stopped
2024.02.13 11:41:16 WARN  app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [ElasticSearch]: 143
2024.02.13 11:41:16 INFO  app[][o.s.a.SchedulerImpl] Process[ElasticSearch] is stopped
2024.02.13 11:41:16 INFO  app[][o.s.a.SchedulerImpl] SonarQube is stopped

Hi,

What’s your version of SonarLint? And if it’s not the latest (4.3.0+76012), could you upgrade and see if this is still replicable?

 
Thx,
Ann

The thing is we observed the same error after integratig with AzureAD, we are using external PostgreSQL Database

Hi,

Then this is not related to SonarLint, and I suspect it’s external to SonarQube as well.

In the server logs you excerpted above, you did not include the es.log, despite this:

So, can you share that log?

 
Ann

Hi Ann, these are the values taken from sonarqube_es

2024.02.13 11:32:47 INFO  es[][o.e.n.Node] stopping ...
2024.02.13 11:32:47 INFO  es[][o.e.c.f.AbstractFileWatchingService] shutting down watcher thread
2024.02.13 11:32:47 INFO  es[][o.e.c.f.AbstractFileWatchingService] watcher service stopped
2024.02.13 11:32:48 INFO  es[][o.e.n.Node] stopped
2024.02.13 11:32:48 INFO  es[][o.e.n.Node] closing ...
2024.02.13 11:32:48 INFO  es[][o.e.n.Node] closed
2024.02.13 11:39:26 INFO  es[][o.e.n.Node] version[8.11.0], pid[2210], build[tar/d9ec3fa628c7b0ba3d25692e277ba26814820b20/2023-11-04T10:04:57.184859352Z], OS[Linux/6.1.72-96.166.amzn2023.x86_64/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/17.0.10/17.0.10+11-LTS-240]
2024.02.13 11:39:26 INFO  es[][o.e.n.Node] JVM home [/opt/java/jdk-17.0.10], using bundled JDK [false]
2024.02.13 11:39:26 INFO  es[][o.e.n.Node] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=org.elasticsearch.preallocate, -XX:+UseG1GC, -Djava.io.tmpdir=/var/sonarqube/temp, -XX:ErrorFile=/var/sonarqube/logs/es_hs_err_pid%p.log, -Xlog:disable, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -Djna.tmpdir=/var/sonarqube/temp, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=COMPAT, -Dcom.redhat.fips=false, -Des.enforce.bootstrap.checks=true, -Xmx1G, -Xms1G, -XX:MaxDirectMemorySize=256m, -XX:+HeapDumpOnOutOfMemoryError, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=tar, --module-path=/opt/sonarqube-10.3.0.82913/elasticsearch/lib, --add-modules=jdk.net, --add-modules=ALL-MODULE-PATH, -Djdk.module.main=org.elasticsearch.server]
2024.02.13 11:39:30 INFO  es[][o.e.p.PluginsService] loaded module [x-pack-core]
2024.02.13 11:39:30 INFO  es[][o.e.p.PluginsService] loaded module [old-lucene-versions]
2024.02.13 11:39:30 INFO  es[][o.e.p.PluginsService] loaded module [parent-join]
2024.02.13 11:39:30 INFO  es[][o.e.p.PluginsService] loaded module [lang-painless]
2024.02.13 11:39:30 INFO  es[][o.e.p.PluginsService] loaded module [rest-root]
2024.02.13 11:39:30 INFO  es[][o.e.p.PluginsService] loaded module [x-pack-redact]
2024.02.13 11:39:30 INFO  es[][o.e.p.PluginsService] loaded module [reindex]
2024.02.13 11:39:30 INFO  es[][o.e.p.PluginsService] loaded module [analysis-common]
2024.02.13 11:39:30 INFO  es[][o.e.p.PluginsService] loaded module [x-pack-security]
2024.02.13 11:39:30 INFO  es[][o.e.p.PluginsService] loaded module [transport-netty4]
2024.02.13 11:39:30 INFO  es[][o.e.p.PluginsService] loaded module [apm]
2024.02.13 11:39:30 INFO  es[][o.e.p.PluginsService] loaded module [aggregations]
2024.02.13 11:39:38 INFO  es[][o.e.n.Node] version[8.11.0], pid[2375], build[tar/d9ec3fa628c7b0ba3d25692e277ba26814820b20/2023-11-04T10:04:57.184859352Z], OS[Linux/6.1.72-96.166.amzn2023.x86_64/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/17.0.10/17.0.10+11-LTS-240]
2024.02.13 11:39:38 INFO  es[][o.e.n.Node] JVM home [/opt/java/jdk-17.0.10], using bundled JDK [false]
2024.02.13 11:39:38 INFO  es[][o.e.n.Node] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=org.elasticsearch.preallocate, -XX:+UseG1GC, -Djava.io.tmpdir=/var/sonarqube/temp, -XX:ErrorFile=/var/sonarqube/logs/es_hs_err_pid%p.log, -Xlog:disable, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -Djna.tmpdir=/var/sonarqube/temp, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=COMPAT, -Dcom.redhat.fips=false, -Des.enforce.bootstrap.checks=true, -Xmx1G, -Xms1G, -XX:MaxDirectMemorySize=256m, -XX:+HeapDumpOnOutOfMemoryError, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=tar, --module-path=/opt/sonarqube-10.3.0.82913/elasticsearch/lib, --add-modules=jdk.net, --add-modules=ALL-MODULE-PATH, -Djdk.module.main=org.elasticsearch.server]
2024.02.13 11:39:39 INFO  es[][o.e.e.NodeEnvironment] using [1] data paths, mounts [[/ (/dev/nvme0n1p1)]], net usable_space [41.8gb], net total_space [49.9gb], types [xfs]
2024.02.13 11:39:39 INFO  es[][o.e.e.NodeEnvironment] heap size [1gb], compressed ordinary object pointers [true]
2024.02.13 11:39:39 INFO  es[][o.e.n.Node] node name [sonarqube], node ID [WOanpSjNQaKEFPZ62csZ0A], cluster name [sonarqube], roles [data_cold, data, remote_cluster_client, master, data_warm, data_content, transform, data_hot, ml, data_frozen, ingest]
2024.02.13 11:39:41 INFO  es[][o.e.p.PluginsService] loaded module [x-pack-core]
2024.02.13 11:39:41 INFO  es[][o.e.p.PluginsService] loaded module [old-lucene-versions]
2024.02.13 11:39:41 INFO  es[][o.e.p.PluginsService] loaded module [parent-join]
2024.02.13 11:39:41 INFO  es[][o.e.p.PluginsService] loaded module [lang-painless]
2024.02.13 11:39:41 INFO  es[][o.e.p.PluginsService] loaded module [rest-root]
2024.02.13 11:39:41 INFO  es[][o.e.p.PluginsService] loaded module [x-pack-redact]
2024.02.13 11:39:41 INFO  es[][o.e.p.PluginsService] loaded module [reindex]
2024.02.13 11:39:41 INFO  es[][o.e.p.PluginsService] loaded module [analysis-common]
2024.02.13 11:39:41 INFO  es[][o.e.p.PluginsService] loaded module [x-pack-security]
2024.02.13 11:39:41 INFO  es[][o.e.p.PluginsService] loaded module [transport-netty4]
2024.02.13 11:39:41 INFO  es[][o.e.p.PluginsService] loaded module [apm]
2024.02.13 11:39:41 INFO  es[][o.e.p.PluginsService] loaded module [aggregations]
2024.02.13 11:39:42 INFO  es[][o.e.x.s.Security] Security is disabled
2024.02.13 11:39:43 INFO  es[][o.e.t.n.NettyAllocator] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=1mb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=4mb, heap_size=1gb}]
2024.02.13 11:39:43 INFO  es[][o.e.i.r.RecoverySettings] using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b]
2024.02.13 11:39:43 INFO  es[][o.e.d.DiscoveryModule] using discovery type [single-node] and seed hosts providers [settings]
2024.02.13 11:39:44 INFO  es[][o.e.n.Node] initialized
2024.02.13 11:39:44 INFO  es[][o.e.n.Node] starting ...
2024.02.13 11:39:45 INFO  es[][o.e.t.TransportService] publish_address {127.0.0.1:35473}, bound_addresses {127.0.0.1:35473}
2024.02.13 11:39:46 INFO  es[][o.e.b.BootstrapChecks] explicitly enforcing bootstrap checks
2024.02.13 11:39:46 INFO  es[][o.e.c.c.ClusterBootstrapService] this node is locked into cluster UUID [rWhxDv4PRmWgiLPu91xG5w] and will not attempt further cluster bootstrapping
2024.02.13 11:39:46 INFO  es[][o.e.c.s.MasterService] elected-as-master ([1] nodes joined in term 11)[_FINISH_ELECTION_, {sonarqube}{WOanpSjNQaKEFPZ62csZ0A}{hlZncyd2Qt-2D3j4Kh9t5w}{sonarqube}{127.0.0.1}{127.0.0.1:35473}{cdfhilmrstw}{8.11.0}{7000099-8500003} completing election], term: 11, version: 289, delta: master node changed {previous [], current [{sonarqube}{WOanpSjNQaKEFPZ62csZ0A}{hlZncyd2Qt-2D3j4Kh9t5w}{sonarqube}{127.0.0.1}{127.0.0.1:35473}{cdfhilmrstw}{8.11.0}{7000099-8500003}]}
2024.02.13 11:39:46 INFO  es[][o.e.c.s.ClusterApplierService] master node changed {previous [], current [{sonarqube}{WOanpSjNQaKEFPZ62csZ0A}{hlZncyd2Qt-2D3j4Kh9t5w}{sonarqube}{127.0.0.1}{127.0.0.1:35473}{cdfhilmrstw}{8.11.0}{7000099-8500003}]}, term: 11, version: 289, reason: Publication{term=11, version=289}
2024.02.13 11:39:46 INFO  es[][o.e.c.f.AbstractFileWatchingService] starting file watcher ...
2024.02.13 11:39:46 INFO  es[][o.e.c.f.AbstractFileWatchingService] file settings service up and running [tid=31]
2024.02.13 11:39:46 INFO  es[][o.e.h.AbstractHttpServerTransport] publish_address {127.0.0.1:9001}, bound_addresses {127.0.0.1:9001}
2024.02.13 11:39:46 INFO  es[][o.e.n.Node] started {sonarqube}{WOanpSjNQaKEFPZ62csZ0A}{hlZncyd2Qt-2D3j4Kh9t5w}{sonarqube}{127.0.0.1}{127.0.0.1:35473}{cdfhilmrstw}{8.11.0}{7000099-8500003}{xpack.installed=true, rack_id=sonarqube}
2024.02.13 11:39:46 INFO  es[][o.e.c.c.NodeJoinExecutor] node-join: [{sonarqube}{WOanpSjNQaKEFPZ62csZ0A}{hlZncyd2Qt-2D3j4Kh9t5w}{sonarqube}{127.0.0.1}{127.0.0.1:35473}{cdfhilmrstw}{8.11.0}{7000099-8500003}] with reason [completing election]
2024.02.13 11:39:47 INFO  es[][o.e.l.ClusterStateLicenseService] license [0db12869-179d-44c0-b8a5-39f0c658601a] mode [basic] - valid
2024.02.13 11:39:47 INFO  es[][o.e.g.GatewayService] recovered [6] indices into cluster_state
2024.02.13 11:39:48 INFO  es[][o.e.i.m.MapperService] reloading search analyzers
2024.02.13 11:39:48 INFO  es[][o.e.h.n.s.HealthNodeTaskExecutor] Node [{sonarqube}{WOanpSjNQaKEFPZ62csZ0A}] is selected as the current health node.
2024.02.13 11:39:48 INFO  es[][o.e.i.m.MapperService] reloading search analyzers
2024.02.13 11:39:48 INFO  es[][o.e.i.m.MapperService] reloading search analyzers
2024.02.13 11:39:48 INFO  es[][o.e.i.m.MapperService] reloading search analyzers
2024.02.13 11:39:49 INFO  es[][o.e.i.m.MapperService] reloading search analyzers
2024.02.13 11:39:49 INFO  es[][o.e.i.m.MapperService] reloading search analyzers
2024.02.13 11:39:49 INFO  es[][o.e.c.r.a.AllocationService] current.health="GREEN" message="Cluster health status changed from [RED] to [GREEN] (reason: [shards started [[metadatas][0]]])." previous.health="RED" reason="shards started [[metadatas][0]]"
2024.02.13 11:39:51 ERROR es[][o.e.b.Elasticsearch] fatal exception while booting Elasticsearch
java.lang.IllegalStateException: failed to obtain node locks, tried [/var/sonarqube/data/es8]; maybe these locations are not writable or multiple nodes were started on the same data path?
	at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:294) ~[elasticsearch-8.11.0.jar:?]
	at org.elasticsearch.node.Node.<init>(Node.java:499) ~[elasticsearch-8.11.0.jar:?]
	at org.elasticsearch.node.Node.<init>(Node.java:344) ~[elasticsearch-8.11.0.jar:?]
	at org.elasticsearch.bootstrap.Elasticsearch$2.<init>(Elasticsearch.java:236) ~[elasticsearch-8.11.0.jar:?]
	at org.elasticsearch.bootstrap.Elasticsearch.initPhase3(Elasticsearch.java:236) ~[elasticsearch-8.11.0.jar:?]
	at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:73) ~[elasticsearch-8.11.0.jar:?]
Caused by: org.apache.lucene.store.LockObtainFailedException: Lock held by another program: /var/sonarqube/data/es8/node.lock
	at org.apache.lucene.store.NativeFSLockFactory.obtainFSLock(NativeFSLockFactory.java:117) ~[lucene-core-9.8.0.jar:?]
	at org.apache.lucene.store.FSLockFactory.obtainLock(FSLockFactory.java:43) ~[lucene-core-9.8.0.jar:?]
	at org.apache.lucene.store.BaseDirectory.obtainLock(BaseDirectory.java:44) ~[lucene-core-9.8.0.jar:?]
	at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:232) ~[elasticsearch-8.11.0.jar:?]
	at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:206) ~[elasticsearch-8.11.0.jar:?]
	at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:286) ~[elasticsearch-8.11.0.jar:?]
	... 5 more

Hi,

SonarQube’s embedded Elasticsearch can’t get to its resources. Either you have a zombie ES process from a previous run that’s still holding on to that lock, or there’s some other process (maybe something “helpful” like Windows Defender or another virus scan) that’s locked it out of that file.

Note that this is entirely unrelated to either SonarLint or Azure.

 
HTH,
Ann

Thanks for the clarification, can you suggest any ideas to fix this issue? The only thing currently we are doing is to restart sonarqube whenever it goes down and throwing 504 Gateway Timeout.

Hi,

You’re going to need to figure out what process on your box is locking that file.

 
Ann

1 Like

Thanks, is there anyone else on the forum had similar problem but manage to resolve it?