After an upgrade the Sonarqube server does not come back up due to memory issues.
-
which versions are you using: Sonarqube Community Edition 25.1
-
how is SonarQube deployed: zip
-
what are you trying to achieve: Working Sonarqube instance
Upgrade Sonarqube from 10.4 → 25.1 (should be possible going by upgrade path)
Didn’t have any memory issues with version 10.4
After the upgrade Sonarqube shutsdown due to memory issues.
Sonarqube exited with code: 143
The largest project in this instance is 1-2M LoC -
what have you tried so far to achieve this:
validate settings are according to requirements
increased memory settings by 2-3x
clearing es cache
maintenance on database
elevated access on database for sonarqube user -
logs
2025.01.24 10:52:00 INFO web[][o.a.c.h.Http11Processor] The host [_] is not valid\n Note: further occurrences of request parsing errors will be logged at DEBUG level.
java.lang.IllegalArgumentException: null
at org.apache.tomcat.util.http.parser.Host.parse(Host.java:74)
at org.apache.tomcat.util.http.parser.Host.parse(Host.java:43)
at org.apache.coyote.AbstractProcessor.parseHost(AbstractProcessor.java:298)
at org.apache.coyote.http11.Http11Processor.prepareRequest(Http11Processor.java:790)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:374)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:905)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1741)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)
at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1190)
at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)
at java.base/java.lang.Thread.run(Thread.java:833)
2025.01.24 10:52:37 ERROR web[][o.s.s.p.Platform] Background initialization failed. Stopping SonarQube
java.lang.IllegalStateException: Fail to execute request to select measures of project AWDWil5FhqZ8At2Q6wmj
at org.sonar.db.measure.ProjectMeasuresIndexerIterator.selectMeasures(ProjectMeasuresIndexerIterator.java:247)
at org.sonar.db.measure.ProjectMeasuresIndexerIterator.doNext(ProjectMeasuresIndexerIterator.java:229)
at org.sonar.db.measure.ProjectMeasuresIndexerIterator.doNext(ProjectMeasuresIndexerIterator.java:52)
at org.sonar.core.util.CloseableIterator.bufferNext(CloseableIterator.java:96)
at org.sonar.core.util.CloseableIterator.hasNext(CloseableIterator.java:87)
at org.sonar.server.measure.index.ProjectMeasuresIndexer.doIndex(ProjectMeasuresIndexer.java:189)
at org.sonar.server.measure.index.ProjectMeasuresIndexer.indexOnStartup(ProjectMeasuresIndexer.java:81)
at org.sonar.server.es.IndexerStartupTask.synchronousIndexing(IndexerStartupTask.java:83)
at org.sonar.server.es.IndexerStartupTask.indexUninitializedTypes(IndexerStartupTask.java:68)
at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:992)
at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:762)
at org.sonar.server.es.IndexerStartupTask.execute(IndexerStartupTask.java:53)
at java.base/java.util.Optional.ifPresent(Optional.java:178)
at org.sonar.server.platform.platformlevel.PlatformLevelStartup$1.doPrivileged(PlatformLevelStartup.java:135)
at org.sonar.server.user.DoPrivileged.execute(DoPrivileged.java:46)
at org.sonar.server.platform.platformlevel.PlatformLevelStartup.start(PlatformLevelStartup.java:131)
at org.sonar.server.platform.PlatformImpl.executeStartupTasks(PlatformImpl.java:204)
at org.sonar.server.platform.PlatformImpl$AutoStarterRunnable.runIfNotAborted(PlatformImpl.java:365)
at org.sonar.server.platform.PlatformImpl$1.doRun(PlatformImpl.java:119)
at org.sonar.server.platform.PlatformImpl$AutoStarterRunnable.run(PlatformImpl.java:349)
at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: java.lang.IllegalStateException: Fail to execute request to select the project biggest branch
at org.sonar.db.measure.ProjectMeasuresIndexerIterator.selectProjectBranchForNcloc(ProjectMeasuresIndexerIterator.java:315)
at org.sonar.db.measure.ProjectMeasuresIndexerIterator.lambda$selectMeasures$0(ProjectMeasuresIndexerIterator.java:239)
at java.base/java.util.Optional.flatMap(Optional.java:289)
at org.sonar.db.measure.ProjectMeasuresIndexerIterator.selectMeasures(ProjectMeasuresIndexerIterator.java:239)
... 20 common frames omitted
Caused by: org.postgresql.util.PSQLException: Ran out of memory retrieving query results.
at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2391)
at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:372)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:517)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:434)
at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:194)
at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:137)
at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52)
at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java)
at org.sonar.db.measure.ProjectMeasuresIndexerIterator.selectProjectBranchForNcloc(ProjectMeasuresIndexerIterator.java:311)
... 23 common frames omitted
Caused by: java.lang.OutOfMemoryError: Java heap space
at org.postgresql.core.PGStream.receiveTupleV3(PGStream.java:619)
at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2387)
at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:372)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:517)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:434)
at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:194)
at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:137)
at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52)
at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java)
at org.sonar.db.measure.ProjectMeasuresIndexerIterator.selectProjectBranchForNcloc(ProjectMeasuresIndexerIterator.java:311)
at org.sonar.db.measure.ProjectMeasuresIndexerIterator.lambda$selectMeasures$0(ProjectMeasuresIndexerIterator.java:239)
at org.sonar.db.measure.ProjectMeasuresIndexerIterator$$Lambda$1905/0x0000000801d326b0.apply(Unknown Source)
at java.base/java.util.Optional.flatMap(Optional.java:289)
at org.sonar.db.measure.ProjectMeasuresIndexerIterator.selectMeasures(ProjectMeasuresIndexerIterator.java:239)
at org.sonar.db.measure.ProjectMeasuresIndexerIterator.doNext(ProjectMeasuresIndexerIterator.java:229)
at org.sonar.db.measure.ProjectMeasuresIndexerIterator.doNext(ProjectMeasuresIndexerIterator.java:52)
at org.sonar.core.util.CloseableIterator.bufferNext(CloseableIterator.java:96)
at org.sonar.core.util.CloseableIterator.hasNext(CloseableIterator.java:87)
at org.sonar.server.measure.index.ProjectMeasuresIndexer.doIndex(ProjectMeasuresIndexer.java:189)
at org.sonar.server.measure.index.ProjectMeasuresIndexer.indexOnStartup(ProjectMeasuresIndexer.java:81)
at org.sonar.server.es.IndexerStartupTask.synchronousIndexing(IndexerStartupTask.java:83)
at org.sonar.server.es.IndexerStartupTask.indexUninitializedTypes(IndexerStartupTask.java:68)
at org.sonar.server.es.IndexerStartupTask$$Lambda$1822/0x0000000801d10000.accept(Unknown Source)
at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:992)
at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:762)
at org.sonar.server.es.IndexerStartupTask.execute(IndexerStartupTask.java:53)
at org.sonar.server.platform.platformlevel.PlatformLevelStartup$1$$Lambda$1821/0x0000000801d0c400.accept(Unknown Source)
at java.base/java.util.Optional.ifPresent(Optional.java:178)
at org.sonar.server.platform.platformlevel.PlatformLevelStartup$1.doPrivileged(PlatformLevelStartup.java:135)
at org.sonar.server.user.DoPrivileged.execute(DoPrivileged.java:46)
at org.sonar.server.platform.platformlevel.PlatformLevelStartup.start(PlatformLevelStartup.java:131)
at org.sonar.server.platform.PlatformImpl.executeStartupTasks(PlatformImpl.java:204)
2025.01.24 10:52:37 INFO web[][o.s.p.ProcessEntryPoint] Hard stopping process
2025.01.24 10:52:37 INFO web[][o.s.s.n.NotificationDaemon] Notification service stopped
2025.01.24 10:52:37 INFO web[][c.z.h.HikariDataSource] HikariPool-1 - Shutdown initiated...
2025.01.24 10:52:37 INFO web[][c.z.h.HikariDataSource] HikariPool-1 - Shutdown completed.
2025.01.24 10:52:37 WARN web[][o.a.c.l.WebappClassLoaderBase] The web application [ROOT] appears to have started a thread named [Progress[BulkIndexer[projectmeasures]]] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:\n java.base@17.0.7/java.lang.Object.wait(Native Method)\n java.base@17.0.7/java.util.TimerThread.mainLoop(Timer.java:563)\n java.base@17.0.7/java.util.TimerThread.run(Timer.java:516)