Sonar server crashes after scaning medium/large project

Hello Community!

System:

  • Sonar Enterprise Edition Version 10.1 (build 73491)
  • DB: Microsoft SQL Server Version 12.00.2000
  • DB driver: Microsoft JDBC Driver 12.2 for SQL Server Version 12.2.0.0

Deployed:

  • Docker in Azure Container Apps
  • Image: sonarqube:10.1.0-enterprise
  • SONAR_SEARCH_JAVAOPTS: -Xmx6G -Xms6G -XX:MaxDirectMemorySize=2G -XX:+HeapDumpOnOutOfMemoryError
  • Container CPU: 4
  • Container Memory: 8Gi

After trying to perform analysis in medium/large projects, we get a server restart.

In the example, we use maven with the following flags:

mvn clean install sonar:sonar \
-s settings.xml \
-Dsonar.login=*** \
-Dsonar.host.url=SONAR_HOST \
-Dsonar.projectName=PROJECT_NAME \
-Dsonar.branch.name=BRANCH \
-Dsonar.userHome=SONAR_CACHE_PATH       

The process itself completes successfully.

[INFO] ANALYSIS SUCCESSFUL, you can find the results at: https://SONAR_HOST/dashboard?id=PROJECT_NAME&branch=BRANCH
[INFO] Note that you will be able to access the updated dashboard once the server has processed the submitted analysis report
[INFO] More about the report processing at https://SONAR_HOST/api/ce/task?id=TASK_ID
[INFO] Analysis total time: 53.012 s
...
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  30:47 min
[INFO] Finished at: 2024-02-26T05:55:43-06:00

However, after some time during the analysis, the server crashes and the scan is not displayed on the Activity tab.

Logs below.

Sonar CE

2024.02.21 14:00:40 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Extract report | status=SUCCESS | time=305ms
2024.02.21 14:00:40 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Persist scanner context | status=SUCCESS | time=37ms
2024.02.21 14:00:40 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Propagate analysis warnings from scanner report | status=SUCCESS | time=28ms
2024.02.21 14:00:40 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Generate analysis UUID | status=SUCCESS | time=0ms
2024.02.21 14:00:40 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Load analysis metadata | status=SUCCESS | time=50ms
2024.02.21 14:00:40 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Initialize | status=SUCCESS | time=58ms
2024.02.21 14:00:40 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Build tree of components | components=1232 | status=SUCCESS | time=66ms
2024.02.21 14:00:40 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Validate project | status=SUCCESS | time=31ms
2024.02.21 14:00:41 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Load quality profiles | status=SUCCESS | time=833ms
2024.02.21 14:00:41 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Load file hashes and statuses | status=SUCCESS | time=101ms
2024.02.21 14:00:41 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Load Quality gate | status=SUCCESS | time=47ms
2024.02.21 14:00:41 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Load new code period | status=SUCCESS | time=36ms
2024.02.21 14:00:41 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Detect file moves | reportFiles=987 | dbFiles=987 | addedFiles=0 | status=SUCCESS | time=35ms
2024.02.21 14:00:41 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Detect file moves in Pull Request scope | status=SUCCESS | time=0ms
2024.02.21 14:00:41 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Load duplications | duplications=112 | status=SUCCESS | time=18ms
2024.02.21 14:00:41 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Compute cross project duplications | status=SUCCESS | time=0ms
2024.02.21 14:00:42 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Compute size measures | status=SUCCESS | time=284ms
2024.02.21 14:00:53 INFO  ce[][o.s.p.ProcessEntryPoint] Hard stopping process
2024.02.21 14:00:53 INFO  ce[][o.s.ce.app.CeServer] Compute Engine is stopping...
2024.02.21 14:00:53 INFO  ce[][o.s.c.t.CeProcessingSchedulerImpl] Hard stopping workers...
2024.02.21 14:00:53 INFO  ce[][o.s.c.t.CeProcessingSchedulerImpl] Some in-progress tasks are getting killed.
2024.02.21 14:00:54 WARN  ce[][o.s.p.ProcessEntryPoint$HardStopperThread] Can not stop in 1000ms
2024.02.21 14:00:57 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.s.ComputationStepExecutor] Compute new coverage | status=SUCCESS | time=15135ms
2024.02.21 14:00:57 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.p.a.p.PostProjectAnalysisTasksExecutor] Webhooks | globalWebhooks=0 | projectWebhooks=0 | status=SUCCESS | time=29ms
2024.02.21 14:00:57 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.p.a.p.PostProjectAnalysisTasksExecutor] Pull Request decoration | status=SUCCESS | time=0ms
2024.02.21 14:00:57 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.p.a.p.PostProjectAnalysisTasksExecutor] Report branch Quality Gate status to devops platforms | status=SUCCESS | time=15ms
2024.02.21 14:00:57 ERROR ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.CeWorkerImpl] Failed to execute task AY3L9-3ak_UNbZWbffZe
java.lang.IllegalStateException: Unable to load component class org.sonar.ce.task.projectanalysis.step.CoverageMeasuresStep
	at org.sonar.core.platform.SpringComponentContainer.getComponentByType(SpringComponentContainer.java:139)
	at com.google.common.collect.Iterators$6.transform(Iterators.java:829)
	at com.google.common.collect.TransformedIterator.next(TransformedIterator.java:52)
	at org.sonar.ce.task.step.ComputationStepExecutor.executeSteps(ComputationStepExecutor.java:69)
	at org.sonar.ce.task.step.ComputationStepExecutor.execute(ComputationStepExecutor.java:57)
	at org.sonar.ce.task.projectanalysis.taskprocessor.ReportTaskProcessor.process(ReportTaskProcessor.java:75)
	at org.sonar.ce.taskprocessor.CeWorkerImpl$ExecuteTask.executeTask(CeWorkerImpl.java:212)
	at org.sonar.ce.taskprocessor.CeWorkerImpl$ExecuteTask.run(CeWorkerImpl.java:194)
	at org.sonar.ce.taskprocessor.CeWorkerImpl.findAndProcessTask(CeWorkerImpl.java:160)
	at org.sonar.ce.taskprocessor.CeWorkerImpl$TrackRunningState.get(CeWorkerImpl.java:135)
	at org.sonar.ce.taskprocessor.CeWorkerImpl.call(CeWorkerImpl.java:87)
	at org.sonar.ce.taskprocessor.CeWorkerImpl.call(CeWorkerImpl.java:53)
	at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:131)
	at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:74)
	at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:82)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
	at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.lang.IllegalStateException: org.springframework.context.annotation.AnnotationConfigApplicationContext@7b5ed2cf has been closed already
	at org.springframework.context.support.AbstractApplicationContext.assertBeanFactoryActive(AbstractApplicationContext.java:1140)
	at org.springframework.context.support.AbstractApplicationContext.getBean(AbstractApplicationContext.java:1173)
	at org.sonar.core.platform.SpringComponentContainer.getComponentByType(SpringComponentContainer.java:137)
	... 20 common frames omitted
2024.02.21 14:00:57 INFO  ce[AY3L9-3ak_UNbZWbffZe][o.s.c.t.CeWorkerImpl] Executed task | project=PROJECT_NAME | type=REPORT | branch=develop | branchType=BRANCH | id=ID | submitter=SA_USER | status=FAILED | time=17329ms
2024.02.21 14:00:57 INFO  ce[][o.s.s.e.CoreExtensionStopper] Stopping Governance
2024.02.21 14:00:57 INFO  ce[][o.s.s.e.CoreExtensionStopper] Stopping Governance (done) | time=0ms
2024.02.21 14:00:57 INFO  ce[][c.z.h.HikariDataSource] HikariPool-1 - Shutdown initiated...
2024.02.21 14:00:57 INFO  ce[][c.z.h.HikariDataSource] HikariPool-1 - Shutdown completed.
2024.02.21 14:00:57 INFO  ce[][o.s.ce.app.CeServer] Compute Engine is stopped
2024.02.21 14:01:47 INFO  ce[][o.s.p.ProcessEntryPoint] Starting Compute Engine
2024.02.21 14:01:47 INFO  ce[][o.s.ce.app.CeServer] Compute Engine starting up...

Sonar App:

2024.02.21 09:51:35 INFO  app[][o.s.a.SchedulerImpl] Process[ce] is up
2024.02.21 09:51:35 INFO  app[][o.s.a.SchedulerImpl] SonarQube is operational
2024.02.21 14:00:53 WARN  app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [ElasticSearch]: 137
2024.02.21 14:00:53 INFO  app[][o.s.a.SchedulerImpl] Process[ElasticSearch] is stopped
2024.02.21 14:00:57 INFO  app[][o.s.a.SchedulerImpl] Process[Compute Engine] is stopped
2024.02.21 14:00:57 INFO  app[][o.s.a.SchedulerImpl] Process[Web Server] is stopped
2024.02.21 14:00:57 INFO  app[][o.s.a.SchedulerImpl] SonarQube is stopped
2024.02.21 14:01:08 INFO  app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /opt/sonarqube/temp
2024.02.21 14:01:08 INFO  app[][o.s.a.es.EsSettings] Elasticsearch listening on [HTTP: 127.0.0.1:9001, TCP: 127.0.0.1:41963]
2024.02.21 14:01:08 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[ELASTICSEARCH] from [/opt/sonarqube/elasticsearch]: /opt/java/openjdk/bin/java -Xms4m -Xmx64m -XX:+UseSerialGC -Dcli.name=server -Dcli.script=./bin/elasticsearch -Dcli.libs=lib/tools/server-cli -Des.path.home=/opt/sonarqube/elasticsearch -Des.path.conf=/opt/sonarqube/temp/conf/es -Des.distribution.type=tar -cp /opt/sonarqube/elasticsearch/lib/*:/opt/sonarqube/elasticsearch/lib/cli-launcher/* org.elasticsearch.launcher.CliToolLauncher
2024.02.21 14:01:09 INFO  app[][o.s.a.SchedulerImpl] Waiting for Elasticsearch to be up and running
2024.02.21 14:01:19 INFO  app[][o.s.a.SchedulerImpl] Process[es] is up
2024.02.21 14:01:19 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[WEB_SERVER] from [/opt/sonarqube]: /opt/java/openjdk/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/opt/sonarqube/temp -XX:-OmitStackTraceInFastThrow --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED --add-exports=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.management/sun.management=ALL-UNNAMED --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED -Dcom.redhat.fips=false -Xmx1G -Xms128m -XX:+HeapDumpOnOutOfMemoryError -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/sonar-application-10.1.0.73491.jar:/opt/sonarqube/lib/jdbc/mssql/mssql-jdbc-12.2.0.jre11.jar org.sonar.server.app.WebServer /opt/sonarqube/temp/sq-process7689210263446668914properties
2024.02.21 14:01:46 INFO  app[][o.s.a.SchedulerImpl] Process[web] is up
2024.02.21 14:01:46 INFO  app[][o.s.a.ProcessLauncherImpl] Launch process[COMPUTE_ENGINE] from [/opt/sonarqube]: /opt/java/openjdk/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/opt/sonarqube/temp -XX:-OmitStackTraceInFastThrow --add-opens=java.base/java.util=ALL-UNNAMED --add-exports=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.management/sun.management=ALL-UNNAMED --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED -Dcom.redhat.fips=false -Xmx2G -Xms128m -XX:+HeapDumpOnOutOfMemoryError -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/sonar-application-10.1.0.73491.jar:/opt/sonarqube/lib/jdbc/mssql/mssql-jdbc-12.2.0.jre11.jar org.sonar.ce.app.CeServer /opt/sonarqube/temp/sq-process3604529027519823147properties
2024.02.21 14:01:52 INFO  app[][o.s.a.SchedulerImpl] Process[ce] is up
2024.02.21 14:01:52 INFO  app[][o.s.a.SchedulerImpl] SonarQube is operational

Sonar ES:

2024.02.21 09:51:28 INFO  es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [30s] to [-1]
2024.02.21 09:51:28 INFO  es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [30s] to [-1]
2024.02.21 09:51:28 INFO  es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [-1] to [30s]
2024.02.21 09:51:28 INFO  es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [-1] to [30s]
2024.02.21 14:01:13 INFO  es[][o.e.n.Node] version[8.7.0], pid[101], build[tar/09520b59b6bc1057340b55750186466ea715e30e/2023-03-27T16:31:09.816451435Z], OS[Linux/5.15.118.1-1.cm2/amd64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.8.1/17.0.8.1+1]
2024.02.21 14:01:13 INFO  es[][o.e.n.Node] JVM home [/opt/java/openjdk], using bundled JDK [false]
2024.02.21 14:01:13 INFO  es[][o.e.n.Node] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/opt/sonarqube/temp, -XX:ErrorFile=/opt/sonarqube/logs/es_hs_err_pid%p.log, -Xlog:disable, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -Djna.tmpdir=/opt/sonarqube/temp, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=COMPAT, -Dcom.redhat.fips=false, -Des.enforce.bootstrap.checks=true, -Xmx6G, -Xms6G, -XX:MaxDirectMemorySize=2G, -XX:+HeapDumpOnOutOfMemoryError, -Dnode.store.allow_mmap=false, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=tar, --module-path=/opt/sonarqube/elasticsearch/lib, --add-modules=jdk.net, -Djdk.module.main=org.elasticsearch.server]
2024.02.21 14:01:14 INFO  es[][o.e.p.PluginsService] loaded module [aggregations]
2024.02.21 14:01:14 INFO  es[][o.e.p.PluginsService] loaded module [analysis-common]
2024.02.21 14:01:14 INFO  es[][o.e.p.PluginsService] loaded module [apm]
2024.02.21 14:01:14 INFO  es[][o.e.p.PluginsService] loaded module [blob-cache]
2024.02.21 14:01:14 INFO  es[][o.e.p.PluginsService] loaded module [lang-painless]
2024.02.21 14:01:14 INFO  es[][o.e.p.PluginsService] loaded module [old-lucene-versions]
2024.02.21 14:01:14 INFO  es[][o.e.p.PluginsService] loaded module [parent-join]
2024.02.21 14:01:14 INFO  es[][o.e.p.PluginsService] loaded module [reindex]
2024.02.21 14:01:14 INFO  es[][o.e.p.PluginsService] loaded module [transport-netty4]
2024.02.21 14:01:14 INFO  es[][o.e.p.PluginsService] loaded module [x-pack-aggregate-metric]
2024.02.21 14:01:14 INFO  es[][o.e.p.PluginsService] loaded module [x-pack-core]
2024.02.21 14:01:14 INFO  es[][o.e.p.PluginsService] loaded module [x-pack-profiling]
2024.02.21 14:01:14 INFO  es[][o.e.p.PluginsService] loaded module [x-pack-security]
2024.02.21 14:01:14 INFO  es[][o.e.p.PluginsService] no plugins loaded
2024.02.21 14:01:16 INFO  es[][o.e.e.NodeEnvironment] using [1] data paths, mounts [[/ (overlay)]], net usable_space [13.6gb], net total_space [19.5gb], types [overlay]
2024.02.21 14:01:16 INFO  es[][o.e.e.NodeEnvironment] heap size [6gb], compressed ordinary object pointers [true]
2024.02.21 14:01:16 INFO  es[][o.e.n.Node] node name [sonarqube], node ID [URgl4r6HTVOvWet_6eaQyA], cluster name [sonarqube], roles [ingest, data_frozen, ml, data_hot, transform, data_content, data_warm, master, remote_cluster_client, data, data_cold]
2024.02.21 14:01:17 INFO  es[][o.e.x.p.ProfilingPlugin] Profiling is enabled
2024.02.21 14:01:17 INFO  es[][o.e.x.s.Security] Security is disabled
2024.02.21 14:01:18 INFO  es[][o.e.t.n.NettyAllocator] creating NettyAllocator with the following configs: [name=elasticsearch_configured, chunk_size=1mb, suggested_max_allocation_size=1mb, factors={es.unsafe.use_netty_default_chunk_and_page_size=false, g1gc_enabled=true, g1gc_region_size=4mb}]
2024.02.21 14:01:18 INFO  es[][o.e.i.r.RecoverySettings] using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b]
2024.02.21 14:01:18 INFO  es[][o.e.d.DiscoveryModule] using discovery type [single-node] and seed hosts providers [settings]
2024.02.21 14:01:18 INFO  es[][o.e.n.Node] initialized
2024.02.21 14:01:18 INFO  es[][o.e.n.Node] starting ...
2024.02.21 14:01:18 INFO  es[][o.e.t.TransportService] publish_address {127.0.0.1:41963}, bound_addresses {127.0.0.1:41963}
2024.02.21 14:01:18 INFO  es[][o.e.b.BootstrapChecks] explicitly enforcing bootstrap checks
2024.02.21 14:01:18 INFO  es[][o.e.c.c.ClusterBootstrapService] this node has not joined a bootstrapped cluster yet; [cluster.initial_master_nodes] is set to [sonarqube]
2024.02.21 14:01:18 INFO  es[][o.e.c.c.Coordinator] setting initial configuration to VotingConfiguration{URgl4r6HTVOvWet_6eaQyA}
2024.02.21 14:01:18 INFO  es[][o.e.c.s.MasterService] elected-as-master ([1] nodes joined)[_FINISH_ELECTION_, {sonarqube}{URgl4r6HTVOvWet_6eaQyA}{--3eC1PsSxGrbuZECyjQ9g}{sonarqube}{127.0.0.1}{127.0.0.1:41963}{cdfhilmrstw}{8.7.0} completing election], term: 1, version: 1, delta: master node changed {previous [], current [{sonarqube}{URgl4r6HTVOvWet_6eaQyA}{--3eC1PsSxGrbuZECyjQ9g}{sonarqube}{127.0.0.1}{127.0.0.1:41963}{cdfhilmrstw}{8.7.0}]}
2024.02.21 14:01:18 INFO  es[][o.e.c.c.CoordinationState] cluster UUID set to [ao0fUCNESA-foKvuTJfSCA]
2024.02.21 14:01:18 INFO  es[][o.e.c.s.ClusterApplierService] master node changed {previous [], current [{sonarqube}{URgl4r6HTVOvWet_6eaQyA}{--3eC1PsSxGrbuZECyjQ9g}{sonarqube}{127.0.0.1}{127.0.0.1:41963}{cdfhilmrstw}{8.7.0}]}, term: 1, version: 1, reason: Publication{term=1, version=1}
2024.02.21 14:01:19 INFO  es[][o.e.r.s.FileSettingsService] starting file settings watcher ...
2024.02.21 14:01:19 INFO  es[][o.e.r.s.FileSettingsService] file settings service up and running [tid=29]
2024.02.21 14:01:19 INFO  es[][o.e.c.c.NodeJoinExecutor] node-join: [{sonarqube}{URgl4r6HTVOvWet_6eaQyA}{--3eC1PsSxGrbuZECyjQ9g}{sonarqube}{127.0.0.1}{127.0.0.1:41963}{cdfhilmrstw}{8.7.0}] with reason [completing election]
2024.02.21 14:01:19 INFO  es[][o.e.h.AbstractHttpServerTransport] publish_address {127.0.0.1:9001}, bound_addresses {127.0.0.1:9001}
2024.02.21 14:01:19 INFO  es[][o.e.n.Node] started {sonarqube}{URgl4r6HTVOvWet_6eaQyA}{--3eC1PsSxGrbuZECyjQ9g}{sonarqube}{127.0.0.1}{127.0.0.1:41963}{cdfhilmrstw}{8.7.0}{rack_id=sonarqube, xpack.installed=true}
2024.02.21 14:01:19 INFO  es[][o.e.g.GatewayService] recovered [0] indices into cluster_state
2024.02.21 14:01:19 INFO  es[][o.e.h.n.s.HealthNodeTaskExecutor] Node [{sonarqube}{URgl4r6HTVOvWet_6eaQyA}] is selected as the current health node.
2024.02.21 14:01:19 INFO  es[][o.e.l.LicenseService] license [c93e38f0-3190-433b-bda2-0c868071e336] mode [basic] - valid
2024.02.21 14:01:28 INFO  es[][o.e.c.m.MetadataCreateIndexService] [metadatas] creating index, cause [api], templates [], shards [1]/[0]
2024.02.21 14:01:28 INFO  es[][o.e.c.r.a.AllocationService] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[metadatas][0]]])." previous.health="YELLOW" reason="shards started [[metadatas][0]]"
2024.02.21 14:01:28 INFO  es[][o.e.c.m.MetadataMappingService] [metadatas/FtYTzjAGRh6n8zy-rF5o6Q] create_mapping
2024.02.21 14:01:28 INFO  es[][o.e.c.m.MetadataCreateIndexService] [components] creating index, cause [api], templates [], shards [5]/[0]
2024.02.21 14:01:28 INFO  es[][o.e.c.r.a.AllocationService] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[components][4]]])." previous.health="YELLOW" reason="shards started [[components][4]]"
2024.02.21 14:01:28 INFO  es[][o.e.c.m.MetadataMappingService] [components/DujBtoZcTcCiZdWt4M_JHA] create_mapping
2024.02.21 14:01:29 INFO  es[][o.e.c.m.MetadataCreateIndexService] [projectmeasures] creating index, cause [api], templates [], shards [5]/[0]
2024.02.21 14:01:29 INFO  es[][o.e.c.r.a.AllocationService] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[projectmeasures][4]]])." previous.health="YELLOW" reason="shards started [[projectmeasures][4]]"
2024.02.21 14:01:29 INFO  es[][o.e.c.m.MetadataMappingService] [projectmeasures/9egyZoYyQBW57rVeFSrZ1g] create_mapping
2024.02.21 14:01:29 INFO  es[][o.e.c.m.MetadataCreateIndexService] [rules] creating index, cause [api], templates [], shards [2]/[0]
2024.02.21 14:01:29 INFO  es[][o.e.c.r.a.AllocationService] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[rules][1]]])." previous.health="YELLOW" reason="shards started [[rules][1]]"
2024.02.21 14:01:29 INFO  es[][o.e.c.m.MetadataMappingService] [rules/0Ph2ILJCSOOC0AoZVIs5_g] create_mapping
2024.02.21 14:01:29 INFO  es[][o.e.c.m.MetadataCreateIndexService] [issues] creating index, cause [api], templates [], shards [5]/[0]
2024.02.21 14:01:30 INFO  es[][o.e.c.r.a.AllocationService] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[issues][4]]])." previous.health="YELLOW" reason="shards started [[issues][4]]"
2024.02.21 14:01:30 INFO  es[][o.e.c.m.MetadataMappingService] [issues/T7uEU6AYSe63QmFy8wtU-w] create_mapping
2024.02.21 14:01:30 INFO  es[][o.e.c.m.MetadataCreateIndexService] [views] creating index, cause [api], templates [], shards [5]/[0]
2024.02.21 14:01:30 INFO  es[][o.e.c.r.a.AllocationService] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[views][4]]])." previous.health="YELLOW" reason="shards started [[views][4]]"
2024.02.21 14:01:30 INFO  es[][o.e.c.m.MetadataMappingService] [views/U-zHGaziQDmQlA5_bL5wdw] create_mapping
2024.02.21 14:01:45 INFO  es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [30s] to [-1]
2024.02.21 14:01:45 INFO  es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [30s] to [-1]
2024.02.21 14:01:45 INFO  es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [-1] to [30s]
2024.02.21 14:01:45 INFO  es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [-1] to [30s]

Would appreciate any help with ideas on how to fix this behavior.

Thanks in advance!

Hi,

Welcome to the community and thanks for sharing your server logs without having to be asked! :sweat_smile:

It looks like you’ve tuned the SONAR_SEARCH_JAVAOPTS value. The one you want to tune for this situation is the SONAR_CE_JAVAOPTS value. That would grant extra memory to the Compute Engine, which is what processes analysis reports, and what is failing.

Would you mind sharing how big a “medium/large” project is for you?

 
Thx,
Ann

Hi,

I read a few topics here before posting my own. Therefore, I decided to skip the “share logs” step in advance. :joy:
It looks like your suggestion has worked, or at least we have a huge step forward in finding a solution! 1 day - so far without restarts. Appreciate your help!
Speaking of the size of the project, I use Sonar measurements: an average project is ~ 40k lines of code and a large one is ~ 300k.

Best regards,
Artem

1 Like