Hi,
I’m having problems to analyze a large project with SonarQube 5.6.1. The compute engine stopped during background analysis. A restart does not help, the same background job triggers the crash repeatedly. I’ve took some thread dumps and found a Java deadlock.
I am attaching the screen shot of the problem
Is this a known bug?
Logs
2019.03.22 15:16:08 INFO web[o.s.s.p.MasterServletFilter] Initializing servlet filter org.sonar.server.authentication.InitFilter@293b977e [pattern=org.sonar.api.web.ServletFilter$UrlPattern@5e2d2d61]
2019.03.22 15:16:08 INFO web[o.s.s.p.MasterServletFilter] Initializing servlet filter org.sonar.server.authentication.OAuth2CallbackFilter@5836ea28 [pattern=org.sonar.api.web.ServletFilter$UrlPattern@2d431637]
2019.03.22 15:16:08 INFO web[o.s.s.p.MasterServletFilter] Initializing servlet filter org.sonar.server.authentication.ws.LoginAction@42dba31c [pattern=org.sonar.api.web.ServletFilter$UrlPattern@771cf7de]
2019.03.22 15:16:08 INFO web[o.s.s.p.MasterServletFilter] Initializing servlet filter org.sonar.server.authentication.ws.ValidateAction@481d3be5 [pattern=org.sonar.api.web.ServletFilter$UrlPattern@5741b2b9]
2019.03.22 15:16:08 INFO web[o.a.c.h.Http11NioProtocol] Starting ProtocolHandler [“http-nio-0.0.0.0-9000”]
2019.03.22 15:16:08 INFO web[o.s.s.a.TomcatAccessLog] Web server is started
2019.03.22 15:16:08 INFO web[o.s.s.a.EmbeddedTomcat] HTTP connector enabled on port 9000
2019.03.22 15:16:08 INFO app[o.s.p.m.Monitor] Process[web] is up
2019.03.22 15:16:08 INFO app[o.s.p.m.JavaProcessLauncher] Launch process[ce]: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64/jre/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Xmx512m -Xms128m -XX:+HeapDumpOnOutOfMemoryError -Djava.io.tmpdir=/home/ec2-user/sonar/temp -javaagent:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64/jre/lib/management-agent.jar -cp ./lib/common/:./lib/server/:./lib/ce/*:/home/ec2-user/sonar/lib/jdbc/mysql/mysql-connector-java-5.1.39.jar org.sonar.ce.app.CeServer /home/ec2-user/sonar/temp/sq-process1684033471403259982properties
2019.03.22 15:16:10 INFO ce[o.s.p.ProcessEntryPoint] Starting ce
2019.03.22 15:16:10 INFO ce[o.s.ce.app.CeServer] Compute Engine starting up…
2019.03.22 15:16:11 INFO ce[o.s.s.p.ServerImpl] SonarQube Server / 6.0 / 93442889cd219e78b028c7dcf51a30de74c987fe
2019.03.22 15:16:11 INFO ce[o.sonar.db.Database] Create JDBC data source for jdbc:mysql://127.0.0.0:3306/sonar?useUnicode=true&characterEncoding=utf8&rewriteBatchedStatements=true&useConfigs=maxPerformance
2019.03.22 15:16:13 INFO ce[o.s.s.p.DefaultServerFileSystem] SonarQube home: /home/ec2-user/sonar
2019.03.22 15:16:14 INFO ce[o.e.plugins] [sonar-1553267729298] modules , plugins , sites
2019.03.22 15:16:15 INFO ce[o.s.c.c.CePluginRepository] Load plugins
2019.03.22 15:16:20 INFO ce[o.s.s.c.q.PurgeCeActivities] Delete the Compute Engine tasks created before Sun Sep 23 15:16:20 UTC 2018
2019.03.22 15:16:20 INFO ce[o.s.ce.app.CeServer] Compute Engine is up
2019.03.22 15:16:21 INFO app[o.s.p.m.Monitor] Process[ce] is up
2019.03.22 15:16:22 INFO ce[o.s.s.c.t.CeWorkerCallableImpl] Execute task | project=com.wakaleo.gameoflife:gameoflife | type=REPORT | id=AWml7dAgotOSi0n5DThX | submitter=admin
2019.03.22 15:16:51 INFO app[o.s.p.m.Monitor] Process[ce] is stopping
2019.03.22 15:16:52 INFO ce[o.s.p.StopWatcher] Stopping process
2019.03.22 15:16:52 INFO ce[o.s.ce.app.CeServer] Compute Engine shutting down…
2019.03.22 15:17:02 ERROR ce[o.s.s.c.t.CeProcessingSchedulerExecutorServiceImpl] Pool CeProcessingSchedulerExecutorServiceImpl did not terminate
2019.03.22 15:17:51 INFO app[o.s.p.m.Monitor] Process[ce] failed to stop in a timely fashion. Killing it.
2019.03.22 15:17:52 INFO app[o.s.p.m.Monitor] Process[ce] is stopped
2019.03.22 15:17:52 INFO app[o.s.p.m.Monitor] Process[es] is stopping
2019.03.22 15:17:52 INFO es[o.s.p.StopWatcher] Stopping process
2019.03.22 15:17:52 INFO es[o.elasticsearch.node] [sonar-1553267729298] stopping …
2019.03.22 15:17:52 INFO es[o.elasticsearch.node] [sonar-1553267729298] stopped
2019.03.22 15:17:52 INFO es[o.elasticsearch.node] [sonar-1553267729298] closing …
2019.03.22 15:17:52 INFO es[o.elasticsearch.node] [sonar-1553267729298] closed
2019.03.22 15:17:53 INFO app[o.s.p.m.Monitor] Process[es] is stopped
<-- Wrapper Stopped
Please help