HeapDumpOnOutOfMemoryError, -Des.path.home=/opt/sonarqube/sonarqube-7.5/elasticsearch

Anand_Krishnamoorthy · November 24, 2020, 1:29pm

Hi Life savers,
I am new to Sonar and I have installed Sonar CE 7.5 on the cloud. It was working good during a couple of days. Later on, I tried to install the plugins, but in vain. Then I read somewhere to start and stop the sonar service. After that, Sonar didn’t even start. Getting a 502 bad gateway nginx error as there is a reserve proxy. Nginx works well on port 80, thats no problem. While I was looking at the logs under /sonar dir, I checked upon es.logs and found that the memory has exceeded and after searching for a solution in google, I increased and still stuck the same problem.

Can someone please help me resolve this.

azuser@SonaQube:/opt/sonarqube/sonarqube-7.5/logs$ tail -f es.log
2020.11.24 13:28:18 INFO  es[][o.e.p.PluginsService] loaded module [reindex]
2020.11.24 13:28:18 INFO  es[][o.e.p.PluginsService] loaded module [transport-netty4]
2020.11.24 13:28:18 INFO  es[][o.e.p.PluginsService] no plugins loaded
2020.11.24 13:28:19 INFO  es[][o.e.d.DiscoveryModule] using discovery type [zen]
2020.11.24 13:28:20 INFO  es[][o.e.n.Node] initialized
2020.11.24 13:28:20 INFO  es[][o.e.n.Node] starting ...
2020.11.24 13:28:20 INFO  es[][o.e.t.TransportService] publish_address {127.0.0.1:9001}, bound_addresses {127.0.0.1:9001}
2020.11.24 13:28:23 INFO  es[][o.e.c.s.ClusterService] new_master {sonarqube}{UMtEAq5dQim3rU3mPAZ5EA}{1O5j-FUeTaaMcJpIvcI30Q}{127.0.0.1}{127.0.0.1:9001}{rack_id=sonarqube}, reason: zen-disco-elected-as-master ([0] nodes joined)
2020.11.24 13:28:23 INFO  es[][o.e.n.Node] started
2020.11.24 13:28:23 INFO  es[][o.e.g.GatewayService] recovered [0] indices into cluster_state
2020.11.24 13:28:29 INFO  es[][o.e.n.Node] stopping ...
2020.11.24 13:28:29 INFO  es[][o.e.n.Node] stopped
2020.11.24 13:28:29 INFO  es[][o.e.n.Node] closing ...
2020.11.24 13:28:29 INFO  es[][o.e.n.Node] closed
2020.11.24 13:28:35 INFO  es[][o.e.n.Node] initializing ...
2020.11.24 13:28:36 INFO  es[][o.e.e.NodeEnvironment] using [1] data paths, mounts [[/ (/dev/sdb1)]], net usable_space [22.8gb], net total_space [28.9gb], spins? [possibly], types [ext4]
2020.11.24 13:28:36 INFO  es[][o.e.e.NodeEnvironment] heap size [495.3mb], compressed ordinary object pointers [true]
2020.11.24 13:28:36 INFO  es[][o.e.n.Node] node name [sonarqube], node ID [UMtEAq5dQim3rU3mPAZ5EA]
2020.11.24 13:28:36 INFO  es[][o.e.n.Node] version[5.6.3], pid[7309], build[1a2f265/2017-10-06T20:33:39.012Z], OS[Linux/5.4.0-1031-azure/amd64], JVM[Ubuntu/OpenJDK 64-Bit Server VM/11.0.9.1/11.0.9.1+1-Ubuntu-0ubuntu1.18.04]
2020.11.24 13:28:36 INFO  es[][o.e.n.Node] JVM arguments [-XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -Djdk.io.permissionsUseCanonicalPath=true, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j.skipJansi=true, -Xms512m, -Xmx512m, -XX:+HeapDumpOnOutOfMemoryError, -Des.path.home=/opt/sonarqube/sonarqube-7.5/elasticsearch]
2020.11.24 13:28:36 INFO  es[][o.e.p.PluginsService] loaded module [aggs-matrix-stats]
2020.11.24 13:28:36 INFO  es[][o.e.p.PluginsService] loaded module [ingest-common]
2020.11.24 13:28:36 INFO  es[][o.e.p.PluginsService] loaded module [parent-join]
2020.11.24 13:28:36 INFO  es[][o.e.p.PluginsService] loaded module [percolator]
2020.11.24 13:28:36 INFO  es[][o.e.p.PluginsService] loaded module [reindex]
2020.11.24 13:28:36 INFO  es[][o.e.p.PluginsService] loaded module [transport-netty4]
2020.11.24 13:28:36 INFO  es[][o.e.p.PluginsService] no plugins loaded
2020.11.24 13:28:37 INFO  es[][o.e.d.DiscoveryModule] using discovery type [zen]
2020.11.24 13:28:37 INFO  es[][o.e.n.Node] initialized
2020.11.24 13:28:37 INFO  es[][o.e.n.Node] starting ...
2020.11.24 13:28:38 INFO  es[][o.e.t.TransportService] publish_address {127.0.0.1:9001}, bound_addresses {127.0.0.1:9001}
2020.11.24 13:28:41 INFO  es[][o.e.c.s.ClusterService] new_master {sonarqube}{UMtEAq5dQim3rU3mPAZ5EA}{JLdz7znATtyXmLTEpHhdCg}{127.0.0.1}{127.0.0.1:9001}{rack_id=sonarqube}, reason: zen-disco-elected-as-master ([0] nodes joined)
2020.11.24 13:28:41 INFO  es[][o.e.n.Node] started
2020.11.24 13:28:41 INFO  es[][o.e.g.GatewayService] recovered [0] indices into cluster_state
2020.11.24 13:28:47 INFO  es[][o.e.n.Node] stopping ...
2020.11.24 13:28:47 INFO  es[][o.e.n.Node] stopped
2020.11.24 13:28:47 INFO  es[][o.e.n.Node] closing ...
2020.11.24 13:28:47 INFO  es[][o.e.n.Node] closed
2020.11.24 13:28:53 INFO  es[][o.e.n.Node] initializing ...
2020.11.24 13:28:53 INFO  es[][o.e.e.NodeEnvironment] using [1] data paths, mounts [[/ (/dev/sdb1)]], net usable_space [22.8gb], net total_space [28.9gb], spins? [possibly], types [ext4]
2020.11.24 13:28:53 INFO  es[][o.e.e.NodeEnvironment] heap size [495.3mb], compressed ordinary object pointers [true]
2020.11.24 13:28:53 INFO  es[][o.e.n.Node] node name [sonarqube], node ID [UMtEAq5dQim3rU3mPAZ5EA]
2020.11.24 13:28:53 INFO  es[][o.e.n.Node] version[5.6.3], pid[7638], build[1a2f265/2017-10-06T20:33:39.012Z], OS[Linux/5.4.0-1031-azure/amd64], JVM[Ubuntu/OpenJDK 64-Bit Server VM/11.0.9.1/11.0.9.1+1-Ubuntu-0ubuntu1.18.04]
2020.11.24 13:28:53 INFO  es[][o.e.n.Node] JVM arguments [-XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -Djdk.io.permissionsUseCanonicalPath=true, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j.skipJansi=true, -Xms512m, -Xmx512m, -XX:+HeapDumpOnOutOfMemoryError, -Des.path.home=/opt/sonarqube/sonarqube-7.5/elasticsearch]
2020.11.24 13:28:53 INFO  es[][o.e.p.PluginsService] loaded module [aggs-matrix-stats]
2020.11.24 13:28:53 INFO  es[][o.e.p.PluginsService] loaded module [ingest-common]
2020.11.24 13:28:53 INFO  es[][o.e.p.PluginsService] loaded module [parent-join]
2020.11.24 13:28:53 INFO  es[][o.e.p.PluginsService] loaded module [percolator]
2020.11.24 13:28:53 INFO  es[][o.e.p.PluginsService] loaded module [reindex]
2020.11.24 13:28:53 INFO  es[][o.e.p.PluginsService] loaded module [transport-netty4]
2020.11.24 13:28:53 INFO  es[][o.e.p.PluginsService] no plugins loaded
2020.11.24 13:28:55 INFO  es[][o.e.d.DiscoveryModule] using discovery type [zen]
2020.11.24 13:28:55 INFO  es[][o.e.n.Node] initialized
2020.11.24 13:28:55 INFO  es[][o.e.n.Node] starting ...
2020.11.24 13:28:55 INFO  es[][o.e.t.TransportService] publish_address {127.0.0.1:9001}, bound_addresses {127.0.0.1:9001}
2020.11.24 13:28:58 INFO  es[][o.e.c.s.ClusterService] new_master {sonarqube}{UMtEAq5dQim3rU3mPAZ5EA}{eFQiebENQfugirun0cVjuw}{127.0.0.1}{127.0.0.1:9001}{rack_id=sonarqube}, reason: zen-disco-elected-as-master ([0] nodes joined)
2020.11.24 13:28:58 INFO  es[][o.e.n.Node] started
2020.11.24 13:28:58 INFO  es[][o.e.g.GatewayService] recovered [0] indices into cluster_state
^C

ganncamp · November 24, 2020, 2:05pm

Hi,

Welcome to the community!

Why would you start with 7.5? It’s past EOL. You should try the current version: 8.5.1, or the current LTS: 7.9.5.

Regarding the log you’ve supplied, I see nothing out of the ordinary (once I add code formatting ). Your problem is probably reflected in web.log instead.

Ann

Anand_Krishnamoorthy · November 24, 2020, 2:22pm

Hi Ann, that was a really fast response. Well, yeah I have been thinking the same about the latest version, but before I move on, I really want to fix it and in case if the same occurs on the latest version, I should be able to solve it with ease.

      azuser@SonaQube:/opt/sonarqube/sonarqube-7.5/logs$ tail -f web.log
2020.11.24 14:16:53 INFO  web[][o.e.p.PluginsService] loaded plugin [org.elasticsearch.join.ParentJoinPlugin]
2020.11.24 14:16:53 INFO  web[][o.e.p.PluginsService] loaded plugin [org.elasticsearch.percolator.PercolatorPlugin]
2020.11.24 14:16:53 INFO  web[][o.e.p.PluginsService] loaded plugin [org.elasticsearch.transport.Netty4Plugin]
2020.11.24 14:16:57 INFO  web[][o.s.s.e.EsClientProvider] Connected to local Elasticsearch: [127.0.0.1:9001]
2020.11.24 14:16:57 INFO  web[][o.s.s.p.LogServerVersion] SonarQube Server / 7.5.0.20543 / 326d99b026f98a9847341db128b71b2be2856c36
2020.11.24 14:16:57 INFO  web[][o.sonar.db.Database] Create JDBC data source for jdbc:mysql://localhost:3306/sonarqube?useUnicode=true&characterEncoding=utf8&rewriteBatchedStatements=true&useConfigs=maxPerformance&useSSL=false
2020.11.24 14:16:58 WARN  web[][o.s.db.dialect.MySql] MySQL support is deprecated and will be dropped soon.
2020.11.24 14:17:01 INFO  web[][o.s.s.p.ServerFileSystemImpl] SonarQube home: /opt/sonarqube/sonarqube-7.5
2020.11.24 14:17:01 INFO  web[][o.s.s.u.SystemPasscodeImpl] System authentication by passcode is disabled
2020.11.24 14:17:02 ERROR web[][o.s.s.p.Platform] Web server startup failed: Plugin Community Branch Plugin [communityBranchPlugin] requires at least SonarQube 8.2.0.32929
2020.11.24 14:17:34 INFO  web[][o.s.p.ProcessEntryPoint] Starting web
2020.11.24 14:17:36 INFO  web[][o.a.t.u.n.NioSelectorPool] Using a shared selector for servlet write/read
2020.11.24 14:17:38 INFO  web[][o.s.c.e.CoreExtensionsLoader] Loaded core extensions:
2020.11.24 14:17:38 INFO  web[][o.e.p.PluginsService] no modules loaded
2020.11.24 14:17:38 INFO  web[][o.e.p.PluginsService] loaded plugin [org.elasticsearch.join.ParentJoinPlugin]
2020.11.24 14:17:38 INFO  web[][o.e.p.PluginsService] loaded plugin [org.elasticsearch.percolator.PercolatorPlugin]
2020.11.24 14:17:38 INFO  web[][o.e.p.PluginsService] loaded plugin [org.elasticsearch.transport.Netty4Plugin]
2020.11.24 14:17:42 INFO  web[][o.s.s.e.EsClientProvider] Connected to local Elasticsearch: [127.0.0.1:9001]
2020.11.24 14:17:42 INFO  web[][o.s.s.p.LogServerVersion] SonarQube Server / 7.5.0.20543 / 326d99b026f98a9847341db128b71b2be2856c36
2020.11.24 14:17:42 INFO  web[][o.sonar.db.Database] Create JDBC data source for jdbc:mysql://localhost:3306/sonarqube?useUnicode=true&characterEncoding=utf8&rewriteBatchedStatements=true&useConfigs=maxPerformance&useSSL=false
2020.11.24 14:17:43 WARN  web[][o.s.db.dialect.MySql] MySQL support is deprecated and will be dropped soon.
2020.11.24 14:17:47 INFO  web[][o.s.s.p.ServerFileSystemImpl] SonarQube home: /opt/sonarqube/sonarqube-7.5
2020.11.24 14:17:47 INFO  web[][o.s.s.u.SystemPasscodeImpl] System authentication by passcode is disabled
2020.11.24 14:17:47 ERROR web[][o.s.s.p.Platform] Web server startup failed: Plugin Community Branch Plugin [communityBranchPlugin] requires at least SonarQube 8.2.0.32929
^C

ganncamp · November 24, 2020, 3:34pm

Hi,

These two things are incompatible:

Anand_Krishnamoorthy:

2020.11.24 14:17:47 ERROR web[][o.s.s.p.Platform] Web server startup failed: Plugin Community Branch Plugin [communityBranchPlugin] requires at least SonarQube 8.2.0.32929

And hopefully you understand why that plugin is not supported in this community.

Ann

Anand_Krishnamoorthy · November 24, 2020, 4:06pm

On the dot.
I’ll decommission the server running 7. 5 and do a fresh installation of 8.2 CE. Any recommendations for server config? Post installation, I want to do a sonarscan of a dotnet application.

Topic		Replies	Views
Sonarqube is not running because of the indexing error SonarQube Server / Community Build sonarqube	1	1445	October 13, 2020
Sonarqube 7.4 crashes after a short time SonarQube Server / Community Build	5	2696	January 16, 2019
java.lang.OutOfMemoryError while starting , disk space usage SonarQube Server / Community Build java , sonarqube , memory	18	6278	September 13, 2018
ERROR: Elasticsearch did not exit normally - check the logs at /opt/sonarqube/logs/sonarqube.log due low value of vm.max_map_count SonarQube Server / Community Build sonarqube , docker	0	5660	March 15, 2021
java.lang.OutOfMemoryError: Java heap space SonarQube Server / Community Build sonarqube	1	2614	October 16, 2019

HeapDumpOnOutOfMemoryError, -Des.path.home=/opt/sonarqube/sonarqube-7.5/elasticsearch

Related topics