SonarQube EE [ElasticSearch]: 137 warning Stop Server

SonarQube Server / Community Build
1

Installled into Docker container.
SonarQube Enterprise Edition - Version 9.9.1 (build 69595)
Docker version 20.10.21, build baeda1f
Connect PSQL - (in Docker too) PostgreSQL 15.2 (Debian 15.2-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit

It is working good a vew minutes or hours, after the SQ stop itself… There is a project in the SQ yet.

(...)
2023.05.30 11:26:20 INFO  app[][o.s.a.SchedulerImpl] SonarQube is operational
2023.05.30 12:32:49 **WARN  app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [ElasticSearch]: 137**
2023.05.30 12:32:49 INFO  app[][o.s.a.SchedulerImpl] Process[ElasticSearch] is stopped
2023.05.30 12:32:49 INFO  app[][o.s.a.SchedulerImpl] Process[Compute Engine] is stopped
2023.05.30 12:32:50 INFO  app[][o.s.a.SchedulerImpl] Process[Web Server] is stopped
2023.05.30 12:32:50 INFO  app[][o.s.a.SchedulerImpl] SonarQube is stopped
2

Hey there.

What do the different log files say? (specifically, es.log since it appears to be the first process to stop)

3

Thanks for your response.
sonar.log

4

Updeted!
Today morning it has worked for 20 minutes…

ce.log

2023.06.01 08:33:54 INFO  ce[][o.s.p.ProcessEntryPoint] Hard stopping process
2023.06.01 08:33:55 INFO  ce[][o.s.ce.app.CeServer] Compute Engine is stopping...
2023.06.01 08:33:55 INFO  ce[][o.s.c.t.CeProcessingSchedulerImpl] Hard stopping workers...
2023.06.01 08:33:55 INFO  ce[][o.s.s.e.CoreExtensionStopper] Stopping Governance
2023.06.01 08:33:55 INFO  ce[][o.s.s.e.CoreExtensionStopper] Stopping Governance (done) | time=1ms
2023.06.01 08:33:55 INFO  ce[][c.z.h.HikariDataSource] HikariPool-1 - Shutdown initiated...
2023.06.01 08:33:55 INFO  ce[][c.z.h.HikariDataSource] HikariPool-1 - Shutdown completed.
2023.06.01 08:33:55 INFO  ce[][o.s.ce.app.CeServer] Compute Engine is stopped

sonar.log

2023.06.01 08:14:36 INFO  app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /opt/sonarqube/temp
2023.06.01 08:14:36 INFO  app[][o.s.a.es.EsSettings] Elasticsearch listening on [HTTP: 127.0.0.1:9001, TCP: 127.0.0.1:36781]
2023.06.01 08:14:36 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[ELASTICSEARCH] from [/opt/sonarqube/elasticsearch]: /opt/sonarqube/elasticsearch/bin/elasticsearch
2023.06.01 08:14:36 INFO  app[][o.s.a.SchedulerImpl] Waiting for Elasticsearch to be up and running
2023.06.01 08:14:52 INFO  app[][o.s.a.SchedulerImpl] Process[es] is up
2023.06.01 08:14:52 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[WEB_SERVER] from [/opt/sonarqube]: /opt/java/openjdk/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmp>
2023.06.01 08:15:11 INFO  app[][o.s.a.SchedulerImpl] Process[web] is up
2023.06.01 08:15:11 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[COMPUTE_ENGINE] from [/opt/sonarqube]: /opt/java/openjdk/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io>
2023.06.01 08:15:18 INFO  app[][o.s.a.SchedulerImpl] Process[ce] is up
2023.06.01 08:15:18 INFO  app[][o.s.a.SchedulerImpl] SonarQube is operational
2023.06.01 08:33:54 WARN  app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [ElasticSearch]: 137
2023.06.01 08:33:54 INFO  app[][o.s.a.SchedulerImpl] Process[ElasticSearch] is stopped
2023.06.01 08:33:55 INFO  app[][o.s.a.SchedulerImpl] Process[Compute Engine] is stopped
2023.06.01 08:33:55 INFO  app[][o.s.a.SchedulerImpl] Process[Web Server] is stopped
2023.06.01 08:33:55 INFO  app[][o.s.a.SchedulerImpl] SonarQube is stopped

es.log

2023.06.01 08:14:43 INFO  es[][o.e.n.Node] version[7.17.8], pid[26], build[default/tar/120eabe1c8a0cb2ae87cffc109a5b65d213e9df1/2022-12-02T17:33:09.727072865Z], OS[Linux/5.15.0-25-generic/amd64], >
2023.06.01 08:14:43 INFO  es[][o.e.n.Node] JVM home [/opt/java/openjdk]
2023.06.01 08:14:43 INFO  es[][o.e.n.Node] JVM arguments [-XX:+UseG1GC, -Djava.io.tmpdir=/opt/sonarqube/temp, -XX:ErrorFile=/opt/sonarqube/logs/es_hs_err_pid%p.log, -Des.networkaddress.cache.ttl=6>
2023.06.01 08:14:44 INFO  es[][o.e.p.PluginsService] loaded module [analysis-common]
2023.06.01 08:14:44 INFO  es[][o.e.p.PluginsService] loaded module [lang-painless]
2023.06.01 08:14:44 INFO  es[][o.e.p.PluginsService] loaded module [parent-join]
2023.06.01 08:14:44 INFO  es[][o.e.p.PluginsService] loaded module [reindex]
2023.06.01 08:14:44 INFO  es[][o.e.p.PluginsService] loaded module [transport-netty4]
2023.06.01 08:14:44 INFO  es[][o.e.p.PluginsService] no plugins loaded
2023.06.01 08:14:44 INFO  es[][o.e.e.NodeEnvironment] using [1] data paths, mounts [[/opt/sonarqube/data (/dev/sda3)]], net usable_space [150.5gb], net total_space [193.8gb], types [ext4]
2023.06.01 08:14:44 INFO  es[][o.e.e.NodeEnvironment] heap size [2gb], compressed ordinary object pointers [true]
2023.06.01 08:14:44 INFO  es[][o.e.n.Node] node name [sonarqube], node ID [YRMEy495Tpu5VZJNhhPoNQ], cluster name [sonarqube], roles [data_frozen, master, remote_cluster_client, data, data_content,>
2023.06.01 08:14:48 INFO  es[][o.e.t.NettyAllocator] creating NettyAllocator with the following configs: [name=elasticsearch_configured, chunk_size=256kb, suggested_max_allocation_size=256kb, fact>
2023.06.01 08:14:48 INFO  es[][o.e.i.r.RecoverySettings] using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b]
2023.06.01 08:14:48 INFO  es[][o.e.d.DiscoveryModule] using discovery type [zen] and seed hosts providers [settings]
2023.06.01 08:14:48 INFO  es[][o.e.g.DanglingIndicesState] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed man>
2023.06.01 08:14:49 INFO  es[][o.e.n.Node] initialized
2023.06.01 08:14:49 INFO  es[][o.e.n.Node] starting ...
2023.06.01 08:14:49 INFO  es[][o.e.t.TransportService] publish_address {127.0.0.1:36781}, bound_addresses {127.0.0.1:36781}
2023.06.01 08:14:49 INFO  es[][o.e.b.BootstrapChecks] explicitly enforcing bootstrap checks
2023.06.01 08:14:49 INFO  es[][o.e.c.c.Coordinator] cluster UUID [F6WA8B2GTqGdpu3EvDllWQ]
2023.06.01 08:14:50 INFO  es[][o.e.c.s.MasterService] elected-as-master ([1] nodes joined)[{sonarqube}{YRMEy495Tpu5VZJNhhPoNQ}{geZO-J8JTFeD3L8gKu6bLA}{127.0.0.1}{127.0.0.1:36781}{cdfhimrsw} elect >
2023.06.01 08:14:50 INFO  es[][o.e.c.s.ClusterApplierService] master node changed {previous [], current [{sonarqube}{YRMEy495Tpu5VZJNhhPoNQ}{geZO-J8JTFeD3L8gKu6bLA}{127.0.0.1}{127.0.0.1:36781}{cdf>
2023.06.01 08:14:50 INFO  es[][o.e.h.AbstractHttpServerTransport] publish_address {127.0.0.1:9001}, bound_addresses {127.0.0.1:9001}
2023.06.01 08:14:50 INFO  es[][o.e.n.Node] started
2023.06.01 08:14:50 INFO  es[][o.e.g.GatewayService] recovered [7] indices into cluster_state
2023.06.01 08:14:52 INFO  es[][o.e.c.r.a.AllocationService] Cluster health status changed from [RED] to [GREEN] (reason: [shards started [[metadatas][0]]]).

web.log

2023.06.01 08:16:24 INFO  web[AYh2BztaZnZv7dRcAAAq][o.s.u.c.UpdateCenter] The plugin 'xml' version : 2.7.0.3820 has not been found on the update center.
2023.06.01 08:33:54 ERROR web[][o.s.s.m.ElasticSearchMetricTask] Failed to query ES status
(...)
2023.06.01 08:33:54 ERROR web[][o.s.s.m.ElasticSearchMetricTask] Failed to query ES status
org.sonar.server.es.ElasticsearchException: Fail to execute es request
        at org.sonar.server.es.EsClient.execute(EsClient.java:313)
        at org.sonar.server.es.EsClient.execute(EsClient.java:305)
        at org.sonar.server.es.EsClient.nodesStats(EsClient.java:216)
        at org.sonar.server.monitoring.ElasticSearchMetricTask.updateFileSystemMetrics(ElasticSearchMetricTask.java:77)
        at org.sonar.server.monitoring.ElasticSearchMetricTask.run(ElasticSearchMetricTask.java:51)
        at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
        at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source)
        at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.net.ConnectException: Connection refused
        at org.elasticsearch.client.RestClient.extractAndWrapCause(RestClient.java:932)
        at org.elasticsearch.client.RestClient.performRequest(RestClient.java:300)
        at org.elasticsearch.client.RestClient.performRequest(RestClient.java:288)
        at org.sonar.server.es.EsClient.lambda$nodesStats$29(EsClient.java:218)
        at org.sonar.server.es.EsClient.execute(EsClient.java:311)
        ... 10 common frames omitted
Caused by: java.net.ConnectException: Connection refused
        at java.base/sun.nio.ch.Net.pollConnect(Native Method)
        at java.base/sun.nio.ch.Net.pollConnectNow(Unknown Source)
        at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(Unknown Source)
        at org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.processEvent(DefaultConnectingIOReactor.java:174)
        at org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.processEvents(DefaultConnectingIOReactor.java:148)
        at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(AbstractMultiworkerIOReactor.java:351)
        at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(PoolingNHttpClientConnectionManager.java:221)
        at org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(CloseableHttpAsyncClientBase.java:64)
        ... 1 common frames omitted
2023.06.01 08:33:55 INFO  web[][o.s.p.ProcessEntryPoint] Hard stopping process
2023.06.01 08:33:55 INFO  web[][o.s.s.e.CoreExtensionStopper] Stopping Governance
2023.06.01 08:33:55 INFO  web[][o.s.s.e.CoreExtensionStopper] Stopping Governance (done) | time=0ms
2023.06.01 08:33:55 INFO  web[][o.s.s.n.NotificationDaemon] Notification service stopped
2023.06.01 08:33:55 INFO  web[][c.z.h.HikariDataSource] HikariPool-1 - Shutdown initiated...
2023.06.01 08:33:55 INFO  web[][c.z.h.HikariDataSource] HikariPool-1 - Shutdown completed.
2023.06.01 08:33:55 WARN  web[][o.a.c.l.WebappClassLoaderBase] The web application [ROOT] appears to have started a thread named [OkHttp TaskRunner] but has failed to stop it. This is very likely >
2023.06.01 08:33:55 WARN  web[][o.a.c.l.WebappClassLoaderBase] The web application [ROOT] appears to have started a thread named [OkHttp TaskRunner] but has failed to stop it. This is very likely >
6

@BMSzitar I guess the issue is due to allocated memory please go through this post elasticsearch - SonarQube Process exited with exit value [es]: 137 - Stack Overflow also please check the sonar recommended hardware requirements Prerequisites and overview

I also faced the similar issue for enterprise edition when I installed in 4 gb server, the entire server itself crashed, after increasing the memory to 8 gb it worked.