2020.06.18 16:05:42 INFO app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /app/sonarsource/home/sonarqube/temp 2020.06.18 16:05:42 INFO app[][o.s.a.es.EsSettings] Elasticsearch listening on /172.16.73.201:9001 2020.06.18 16:05:42 INFO app[][o.s.a.p.ProcessLauncherImpl] Launch process[[key='es', ipcIndex=1, logFilenamePrefix=es]] from [/app/sonarsource/install/sonarqube-7.5/elasticsearch]: /app/sonarsource/install/sonarqube-7.5/elasticsearch/bin/elasticsearch -Epath.conf=/app/sonarsource/home/sonarqube/temp/conf/es 2020.06.18 16:05:42 INFO app[][o.s.a.SchedulerImpl] Waiting for Elasticsearch to be up and running 2020.06.18 16:05:42 INFO app[][o.e.p.PluginsService] no modules loaded 2020.06.18 16:05:42 INFO app[][o.e.p.PluginsService] loaded plugin [org.elasticsearch.transport.Netty4Plugin] 2020.06.18 16:05:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [force_merge], size [1], queue size [unbounded] 2020.06.18 16:05:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [fetch_shard_started], core [1], max [8], keep alive [5m] 2020.06.18 16:05:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [listener], size [2], queue size [unbounded] 2020.06.18 16:05:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [index], size [4], queue size [200] 2020.06.18 16:05:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [refresh], core [1], max [2], keep alive [5m] 2020.06.18 16:05:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [generic], core [4], max [128], keep alive [30s] 2020.06.18 16:05:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [warmer], core [1], max [2], keep alive [5m] 2020.06.18 16:05:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [search], size [7], queue size [1k] 2020.06.18 16:05:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [flush], core [1], max [2], keep alive [5m] 2020.06.18 16:05:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [fetch_shard_store], core [1], max [8], keep alive [5m] 2020.06.18 16:05:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [management], core [1], max [5], keep alive [5m] 2020.06.18 16:05:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [get], size [4], queue size [1k] 2020.06.18 16:05:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [bulk], size [4], queue size [200] 2020.06.18 16:05:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [snapshot], core [1], max [2], keep alive [5m] 2020.06.18 16:05:42 DEBUG app[][o.e.c.n.IfConfig] configuration: lo inet 127.0.0.1 netmask:255.0.0.0 scope:host inet6 ::1 prefixlen:128 scope:host UP LOOPBACK mtu:65536 index:1 ens3 inet 172.16.73.201 netmask:255.255.248.0 broadcast:172.16.79.255 scope:site inet6 fe80::2e:a5ff:feca:f8fa prefixlen:64 scope:link hardware 02:2E:A5:CA:F8:FA UP MULTICAST mtu:9001 index:2 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Module execution: 123ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] TypeListeners creation: 3ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Scopes creation: 2ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Converters creation: 0ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Binding creation: 7ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Private environment creation: 0ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Injector construction: 0ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Binding initialization: 5ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Binding indexing: 0ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Collecting injection requests: 0ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Binding validation: 0ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Static validation: 0ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Instance member validation: 2ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Provider verification: 1ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Static member injection: 0ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Instance injection: 1ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.i.i.Stopwatch] Preloading singletons: 2ms 2020.06.18 16:05:43 DEBUG app[][o.e.c.t.TransportClientNodesService] node_sampler_interval[5s] 2020.06.18 16:05:43 DEBUG app[][i.n.c.MultithreadEventLoopGroup] -Dio.netty.eventLoopThreads: 8 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent0] -Dio.netty.noUnsafe: false 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent0] Java version: 8 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent0] sun.misc.Unsafe.theUnsafe: available 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent0] sun.misc.Unsafe.copyMemory: available 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent0] java.nio.Buffer.address: available 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent0] direct buffer constructor: available 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent0] java.nio.Bits.unaligned: available, true 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent0] jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable prior to Java9 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent0] java.nio.DirectByteBuffer.(long, int): available 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent] sun.misc.Unsafe: available 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.tmpdir: /tmp (java.io.tmpdir) 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.bitMode: 64 (sun.arch.data.model) 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.noPreferDirect: false 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.maxDirectMemory: 29884416 bytes 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.uninitializedArrayAllocationThreshold: -1 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.CleanerJava6] java.nio.ByteBuffer.cleaner(): available 2020.06.18 16:05:43 DEBUG app[][i.n.c.n.NioEventLoop] -Dio.netty.noKeySetOptimization: false 2020.06.18 16:05:43 DEBUG app[][i.n.c.n.NioEventLoop] -Dio.netty.selectorAutoRebuildThreshold: 512 2020.06.18 16:05:43 DEBUG app[][i.n.u.i.PlatformDependent] org.jctools-core.MpscChunkedArrayQueue: available 2020.06.18 16:05:44 DEBUG app[][o.e.c.t.TransportClientNodesService] adding address [{#transport#-1}{Cx5-_T8cQNOKJSgeNh-i8A}{172.16.73.201}{172.16.73.201:9001}] 2020.06.18 16:05:44 DEBUG app[][i.n.c.DefaultChannelId] -Dio.netty.processId: 21503 (auto-detected) 2020.06.18 16:05:44 DEBUG app[][i.netty.util.NetUtil] -Djava.net.preferIPv4Stack: false 2020.06.18 16:05:44 DEBUG app[][i.netty.util.NetUtil] -Djava.net.preferIPv6Addresses: false 2020.06.18 16:05:44 DEBUG app[][i.netty.util.NetUtil] Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) 2020.06.18 16:05:44 DEBUG app[][i.netty.util.NetUtil] /proc/sys/net/core/somaxconn: 128 2020.06.18 16:05:44 DEBUG app[][i.n.c.DefaultChannelId] -Dio.netty.machineId: 02:2e:a5:ff:fe:ca:f8:fa (auto-detected) 2020.06.18 16:05:44 DEBUG app[][i.n.u.ResourceLeakDetector] -Dio.netty.leakDetection.level: simple 2020.06.18 16:05:44 DEBUG app[][i.n.u.ResourceLeakDetector] -Dio.netty.leakDetection.maxRecords: 4 2020.06.18 16:05:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.numHeapArenas: 0 2020.06.18 16:05:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.numDirectArenas: 0 2020.06.18 16:05:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.pageSize: 8192 2020.06.18 16:05:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.maxOrder: 11 2020.06.18 16:05:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.chunkSize: 16777216 2020.06.18 16:05:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.tinyCacheSize: 512 2020.06.18 16:05:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.smallCacheSize: 256 2020.06.18 16:05:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.normalCacheSize: 64 2020.06.18 16:05:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.maxCachedBufferCapacity: 32768 2020.06.18 16:05:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.cacheTrimInterval: 8192 2020.06.18 16:05:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.useCacheForAllThreads: true 2020.06.18 16:05:44 DEBUG app[][i.n.b.ByteBufUtil] -Dio.netty.allocator.type: pooled 2020.06.18 16:05:44 DEBUG app[][i.n.b.ByteBufUtil] -Dio.netty.threadLocalDirectBufferSize: 65536 2020.06.18 16:05:44 DEBUG app[][i.n.b.ByteBufUtil] -Dio.netty.maxThreadLocalCharBufferSize: 16384 2020.06.18 16:05:44 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{Cx5-_T8cQNOKJSgeNh-i8A}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_timeout[30s] at org.elasticsearch.transport.netty4.Netty4Transport.connectToChannels(Netty4Transport.java:362) at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:570) at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:117) at org.elasticsearch.transport.TransportService.openConnection(TransportService.java:351) at org.elasticsearch.client.transport.TransportClientNodesService$SimpleNodeSampler.doSample(TransportClientNodesService.java:407) at org.elasticsearch.client.transport.TransportClientNodesService$NodeSampler.sample(TransportClientNodesService.java:357) at org.elasticsearch.client.transport.TransportClientNodesService.addTransportAddresses(TransportClientNodesService.java:198) at org.elasticsearch.client.transport.TransportClient.addTransportAddress(TransportClient.java:319) at org.sonar.application.es.EsConnectorImpl$MinimalTransportClient.(EsConnectorImpl.java:109) at org.sonar.application.es.EsConnectorImpl.buildTransportClient(EsConnectorImpl.java:90) at org.sonar.application.es.EsConnectorImpl.getTransportClient(EsConnectorImpl.java:75) at org.sonar.application.es.EsConnectorImpl.getClusterHealthStatus(EsConnectorImpl.java:62) at org.sonar.application.process.EsProcessMonitor.checkStatus(EsProcessMonitor.java:90) at org.sonar.application.process.EsProcessMonitor.checkOperational(EsProcessMonitor.java:75) at org.sonar.application.process.EsProcessMonitor.isOperational(EsProcessMonitor.java:60) at org.sonar.application.process.SQProcess.refreshState(SQProcess.java:161) at org.sonar.application.process.SQProcess$EventWatcher.run(SQProcess.java:220) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:352) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:632) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:579) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:496) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:458) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) at java.lang.Thread.run(Thread.java:748) Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.06.18 16:05:44 DEBUG app[][o.s.a.e.EsConnectorImpl] Connected to Elasticsearch node: [172.16.73.201:9001] Jun 18, 2020 16:05:46 +0000 [21559 1] com.newrelic INFO: New Relic Agent: Loading configuration file "/opt/newrelic/sonarqube/./newrelic.yml" Jun 18, 2020 16:05:46 +0000 [21559 1] com.newrelic INFO: Using default collector host: collector.newrelic.com Jun 18, 2020 16:05:46 +0000 [21559 1] com.newrelic INFO: New Relic Agent: Writing to log file: /opt/newrelic/sonarqube/logs/newrelic_agent.log 2020.06.18 16:05:48 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{Cx5-_T8cQNOKJSgeNh-i8A}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_timeout[30s] at org.elasticsearch.transport.netty4.Netty4Transport.connectToChannels(Netty4Transport.java:362) at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:570) at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:117) at org.elasticsearch.transport.TransportService.openConnection(TransportService.java:351) at org.elasticsearch.client.transport.TransportClientNodesService$SimpleNodeSampler.doSample(TransportClientNodesService.java:407) at org.elasticsearch.client.transport.TransportClientNodesService$NodeSampler.sample(TransportClientNodesService.java:357) at org.elasticsearch.client.transport.TransportClientNodesService$ScheduledNodeSampler.run(TransportClientNodesService.java:390) at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:569) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:352) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:632) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:579) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:496) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:458) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) ... 1 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.06.18 16:05:53 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{Cx5-_T8cQNOKJSgeNh-i8A}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_timeout[30s] at org.elasticsearch.transport.netty4.Netty4Transport.connectToChannels(Netty4Transport.java:362) at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:570) at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:117) at org.elasticsearch.transport.TransportService.openConnection(TransportService.java:351) at org.elasticsearch.client.transport.TransportClientNodesService$SimpleNodeSampler.doSample(TransportClientNodesService.java:407) at org.elasticsearch.client.transport.TransportClientNodesService$NodeSampler.sample(TransportClientNodesService.java:357) at org.elasticsearch.client.transport.TransportClientNodesService$ScheduledNodeSampler.run(TransportClientNodesService.java:390) at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:569) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:352) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:632) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:579) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:496) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:458) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) ... 1 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.06.18 16:05:58 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{Cx5-_T8cQNOKJSgeNh-i8A}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_timeout[30s] at org.elasticsearch.transport.netty4.Netty4Transport.connectToChannels(Netty4Transport.java:362) at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:570) at org.elasticsearch.transport.TcpTransport.openConnection(TcpTransport.java:117) at org.elasticsearch.transport.TransportService.openConnection(TransportService.java:351) at org.elasticsearch.client.transport.TransportClientNodesService$SimpleNodeSampler.doSample(TransportClientNodesService.java:407) at org.elasticsearch.client.transport.TransportClientNodesService$NodeSampler.sample(TransportClientNodesService.java:357) at org.elasticsearch.client.transport.TransportClientNodesService$ScheduledNodeSampler.run(TransportClientNodesService.java:390) at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:569) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:352) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:632) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:579) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:496) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:458) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) ... 1 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.06.18 16:06:04 DEBUG app[][i.n.b.AbstractByteBuf] -Dio.netty.buffer.bytebuf.checkAccessible: true 2020.06.18 16:06:04 DEBUG app[][i.n.u.ResourceLeakDetectorFactory] Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@680576c1 2020.06.18 16:06:04 DEBUG app[][i.n.util.Recycler] -Dio.netty.recycler.maxCapacityPerThread: 32768 2020.06.18 16:06:04 DEBUG app[][i.n.util.Recycler] -Dio.netty.recycler.maxSharedCapacityFactor: 2 2020.06.18 16:06:04 DEBUG app[][i.n.util.Recycler] -Dio.netty.recycler.linkCapacity: 16 2020.06.18 16:06:04 DEBUG app[][i.n.util.Recycler] -Dio.netty.recycler.ratio: 8 2020.06.18 16:06:04 DEBUG app[][o.e.t.n.Netty4Transport] connected to node [{sonarqube}{hha5FiBnS_uiE9htXj5TTw}{44FuTHjqSHWvutUOXidHlg}{172.16.73.201}{172.16.73.201:9001}{rack_id=sonarqube}] 2020.06.18 16:06:05 INFO app[][o.s.a.SchedulerImpl] Process[es] is up 2020.06.18 16:06:05 INFO app[][o.s.a.p.ProcessLauncherImpl] Launch process[[key='web', ipcIndex=2, logFilenamePrefix=web]] from [/app/sonarsource/install/sonarqube-7.5]: /app/jdk/jdk1.8.0_172/jre/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/app/sonarsource/home/sonarqube/temp -Xmx4G -Xms4G -XX:+HeapDumpOnOutOfMemoryError -javaagent:/opt/newrelic/sonarqube/newrelic.jar -Dnewrelic.environment=prod -cp ./lib/common/*:/app/sonarsource/install/sonarqube-7.5/lib/jdbc/postgresql/postgresql-42.2.5.jar org.sonar.server.app.WebServer /app/sonarsource/home/sonarqube/temp/sq-process1497155379482523748properties Jun 18, 2020 16:06:06 +0000 [21930 1] com.newrelic INFO: New Relic Agent: Loading configuration file "/opt/newrelic/sonarqube/./newrelic.yml" Jun 18, 2020 16:06:07 +0000 [21930 1] com.newrelic INFO: Using default collector host: collector.newrelic.com Jun 18, 2020 16:06:07 +0000 [21930 1] com.newrelic INFO: New Relic Agent: Writing to log file: /opt/newrelic/sonarqube/logs/newrelic_agent.log 2020.06.18 16:09:40 INFO app[][o.s.a.SchedulerImpl] Process[web] is up 2020.06.18 16:09:40 INFO app[][o.s.a.p.ProcessLauncherImpl] Launch process[[key='ce', ipcIndex=3, logFilenamePrefix=ce]] from [/app/sonarsource/install/sonarqube-7.5]: /app/jdk/jdk1.8.0_172/jre/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/app/sonarsource/home/sonarqube/temp -Xmx4G -Xms4G -XX:+HeapDumpOnOutOfMemoryError -javaagent:/opt/newrelic/sonarqube/newrelic.jar -Dnewrelic.environment=prod -cp ./lib/common/*:/app/sonarsource/install/sonarqube-7.5/lib/jdbc/postgresql/postgresql-42.2.5.jar org.sonar.ce.app.CeServer /app/sonarsource/home/sonarqube/temp/sq-process9125432572100496511properties Jun 18, 2020 16:09:41 +0000 [31365 1] com.newrelic INFO: New Relic Agent: Loading configuration file "/opt/newrelic/sonarqube/./newrelic.yml" Jun 18, 2020 16:09:42 +0000 [31365 1] com.newrelic INFO: Using default collector host: collector.newrelic.com Jun 18, 2020 16:09:42 +0000 [31365 1] com.newrelic INFO: New Relic Agent: Writing to log file: /opt/newrelic/sonarqube/logs/newrelic_agent.log 2020.06.18 16:10:05 INFO app[][o.s.a.SchedulerImpl] Process[ce] is up 2020.06.18 16:10:05 INFO app[][o.s.a.SchedulerImpl] SonarQube is up TERM trapped. Shutting down. 2020.06.25 16:02:37 WARN app[][o.s.a.p.AbstractProcessMonitor] Process exited with exit value [es]: 143 2020.06.25 16:02:37 INFO app[][o.s.a.SchedulerImpl] Process [es] is stopped 2020.06.25 16:02:39 WARN app[][o.s.a.p.AbstractProcessMonitor] Process exited with exit value [web]: 143 2020.06.25 16:02:39 INFO app[][o.s.a.SchedulerImpl] Process [web] is stopped 2020.06.25 16:02:39 WARN app[][o.s.a.p.AbstractProcessMonitor] Process exited with exit value [ce]: 143 2020.06.25 16:02:39 WARN app[][o.s.a.p.AbstractProcessMonitor] Process exited with exit value [ce]: 143 <-- Wrapper Stopped --> Wrapper Started as Daemon Launching a JVM... Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org Copyright 1999-2006 Tanuki Software, Inc. All Rights Reserved. 2020.06.25 16:02:41 INFO app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /app/sonarsource/home/sonarqube/temp 2020.06.25 16:02:41 INFO app[][o.s.a.es.EsSettings] Elasticsearch listening on /172.16.73.201:9001 2020.06.25 16:02:41 INFO app[][o.s.a.ProcessLauncherImpl] Deleting outdated search index data directory /app/sonarsource/home/sonarqube/data/es5 2020.06.25 16:02:41 INFO app[][o.s.a.ProcessLauncherImpl] Launch process[[key='es', ipcIndex=1, logFilenamePrefix=es]] from [/app/sonarsource/install/sonarqube-7.9.3/elasticsearch]: /app/sonarsource/install/sonarqube-7.9.3/elasticsearch/bin/elasticsearch 2020.06.25 16:02:41 INFO app[][o.s.a.SchedulerImpl] Waiting for Elasticsearch to be up and running OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. 2020.06.25 16:02:42 INFO app[][o.e.p.PluginsService] no modules loaded 2020.06.25 16:02:42 INFO app[][o.e.p.PluginsService] loaded plugin [org.elasticsearch.transport.Netty4Plugin] 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [force_merge], size [1], queue size [unbounded] 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [fetch_shard_started], core [1], max [8], keep alive [5m] 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [listener], size [2], queue size [unbounded] 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [index], size [4], queue size [200] 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [refresh], core [1], max [2], keep alive [5m] 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [generic], core [4], max [128], keep alive [30s] 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [warmer], core [1], max [2], keep alive [5m] 2020.06.25 16:02:42 DEBUG app[][o.e.c.u.c.QueueResizingEsThreadPoolExecutor] thread pool [_client_/search] will adjust queue by [50] when determining automatic queue size 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [search], size [7], queue size [1k] 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [flush], core [1], max [2], keep alive [5m] 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [fetch_shard_store], core [1], max [8], keep alive [5m] 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [management], core [1], max [5], keep alive [5m] 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [get], size [4], queue size [1k] 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [analyze], size [1], queue size [16] 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [write], size [4], queue size [200] 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [snapshot], core [1], max [2], keep alive [5m] 2020.06.25 16:02:42 DEBUG app[][o.e.c.u.c.QueueResizingEsThreadPoolExecutor] thread pool [_client_/search_throttled] will adjust queue by [50] when determining automatic queue size 2020.06.25 16:02:42 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [search_throttled], size [1], queue size [100] 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent0] -Dio.netty.noUnsafe: false 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent0] Java version: 11 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent0] sun.misc.Unsafe.theUnsafe: available 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent0] sun.misc.Unsafe.copyMemory: available 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent0] java.nio.Buffer.address: available 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent0] direct buffer constructor: unavailable java.lang.UnsupportedOperationException: Reflective setAccessible(true) disabled at io.netty.util.internal.ReflectionUtil.trySetAccessible(ReflectionUtil.java:31) at io.netty.util.internal.PlatformDependent0$4.run(PlatformDependent0.java:224) at java.base/java.security.AccessController.doPrivileged(Native Method) at io.netty.util.internal.PlatformDependent0.(PlatformDependent0.java:218) at io.netty.util.internal.PlatformDependent.isAndroid(PlatformDependent.java:212) at io.netty.util.internal.PlatformDependent.(PlatformDependent.java:80) at io.netty.util.ConstantPool.(ConstantPool.java:32) at io.netty.util.AttributeKey$1.(AttributeKey.java:27) at io.netty.util.AttributeKey.(AttributeKey.java:27) at org.elasticsearch.transport.netty4.Netty4Transport.(Netty4Transport.java:219) at org.elasticsearch.transport.Netty4Plugin.getSettings(Netty4Plugin.java:57) at org.elasticsearch.plugins.PluginsService.lambda$getPluginSettings$0(PluginsService.java:89) at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) at org.elasticsearch.plugins.PluginsService.getPluginSettings(PluginsService.java:89) at org.elasticsearch.client.transport.TransportClient.buildTemplate(TransportClient.java:147) at org.elasticsearch.client.transport.TransportClient.(TransportClient.java:277) at org.sonar.application.es.EsConnectorImpl$MinimalTransportClient.(EsConnectorImpl.java:103) at org.sonar.application.es.EsConnectorImpl.buildTransportClient(EsConnectorImpl.java:89) at org.sonar.application.es.EsConnectorImpl.getTransportClient(EsConnectorImpl.java:74) at org.sonar.application.es.EsConnectorImpl.getClusterHealthStatus(EsConnectorImpl.java:61) at org.sonar.application.process.EsManagedProcess.checkStatus(EsManagedProcess.java:88) at org.sonar.application.process.EsManagedProcess.checkOperational(EsManagedProcess.java:73) at org.sonar.application.process.EsManagedProcess.isOperational(EsManagedProcess.java:58) at org.sonar.application.process.ManagedProcessHandler.refreshState(ManagedProcessHandler.java:201) at org.sonar.application.process.ManagedProcessHandler$EventWatcher.run(ManagedProcessHandler.java:258) 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent0] java.nio.Bits.unaligned: available, true 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent0] jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable java.lang.IllegalAccessException: class io.netty.util.internal.PlatformDependent0$6 cannot access class jdk.internal.misc.Unsafe (in module java.base) because module java.base does not export jdk.internal.misc to unnamed module @29ca901e at java.base/jdk.internal.reflect.Reflection.newIllegalAccessException(Reflection.java:361) at java.base/java.lang.reflect.AccessibleObject.checkAccess(AccessibleObject.java:591) at java.base/java.lang.reflect.Method.invoke(Method.java:558) at io.netty.util.internal.PlatformDependent0$6.run(PlatformDependent0.java:334) at java.base/java.security.AccessController.doPrivileged(Native Method) at io.netty.util.internal.PlatformDependent0.(PlatformDependent0.java:325) at io.netty.util.internal.PlatformDependent.isAndroid(PlatformDependent.java:212) at io.netty.util.internal.PlatformDependent.(PlatformDependent.java:80) at io.netty.util.ConstantPool.(ConstantPool.java:32) at io.netty.util.AttributeKey$1.(AttributeKey.java:27) at io.netty.util.AttributeKey.(AttributeKey.java:27) at org.elasticsearch.transport.netty4.Netty4Transport.(Netty4Transport.java:219) at org.elasticsearch.transport.Netty4Plugin.getSettings(Netty4Plugin.java:57) at org.elasticsearch.plugins.PluginsService.lambda$getPluginSettings$0(PluginsService.java:89) at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) at org.elasticsearch.plugins.PluginsService.getPluginSettings(PluginsService.java:89) at org.elasticsearch.client.transport.TransportClient.buildTemplate(TransportClient.java:147) at org.elasticsearch.client.transport.TransportClient.(TransportClient.java:277) at org.sonar.application.es.EsConnectorImpl$MinimalTransportClient.(EsConnectorImpl.java:103) at org.sonar.application.es.EsConnectorImpl.buildTransportClient(EsConnectorImpl.java:89) at org.sonar.application.es.EsConnectorImpl.getTransportClient(EsConnectorImpl.java:74) at org.sonar.application.es.EsConnectorImpl.getClusterHealthStatus(EsConnectorImpl.java:61) at org.sonar.application.process.EsManagedProcess.checkStatus(EsManagedProcess.java:88) at org.sonar.application.process.EsManagedProcess.checkOperational(EsManagedProcess.java:73) at org.sonar.application.process.EsManagedProcess.isOperational(EsManagedProcess.java:58) at org.sonar.application.process.ManagedProcessHandler.refreshState(ManagedProcessHandler.java:201) at org.sonar.application.process.ManagedProcessHandler$EventWatcher.run(ManagedProcessHandler.java:258) 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent0] java.nio.DirectByteBuffer.(long, int): unavailable 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent] sun.misc.Unsafe: available 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent] maxDirectMemory: 33554432 bytes (maybe) 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.tmpdir: /tmp (java.io.tmpdir) 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.bitMode: 64 (sun.arch.data.model) 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.maxDirectMemory: -1 bytes 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.uninitializedArrayAllocationThreshold: -1 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.CleanerJava9] java.nio.ByteBuffer.cleaner(): available 2020.06.25 16:02:42 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.noPreferDirect: false 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Module execution: 139ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] TypeListeners creation: 3ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Scopes creation: 7ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Converters creation: 0ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Binding creation: 4ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Private environment creation: 0ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Injector construction: 0ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Binding initialization: 0ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Binding indexing: 0ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Collecting injection requests: 0ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Binding validation: 0ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Static validation: 0ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Instance member validation: 1ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Provider verification: 0ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Static member injection: 0ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Instance injection: 0ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.i.i.Stopwatch] Preloading singletons: 0ms 2020.06.25 16:02:44 DEBUG app[][o.e.c.t.TransportClientNodesService] node_sampler_interval[5s] 2020.06.25 16:02:44 DEBUG app[][i.n.c.MultithreadEventLoopGroup] -Dio.netty.eventLoopThreads: 8 2020.06.25 16:02:44 DEBUG app[][i.n.c.n.NioEventLoop] -Dio.netty.noKeySetOptimization: false 2020.06.25 16:02:44 DEBUG app[][i.n.c.n.NioEventLoop] -Dio.netty.selectorAutoRebuildThreshold: 512 2020.06.25 16:02:44 DEBUG app[][i.n.u.i.PlatformDependent] org.jctools-core.MpscChunkedArrayQueue: available 2020.06.25 16:02:44 DEBUG app[][o.e.c.t.TransportClientNodesService] adding address [{#transport#-1}{nl-OgQJATMaC0vIGemUTxg}{172.16.73.201}{172.16.73.201:9001}] 2020.06.25 16:02:44 DEBUG app[][i.n.c.DefaultChannelId] -Dio.netty.processId: 17657 (auto-detected) 2020.06.25 16:02:44 DEBUG app[][i.netty.util.NetUtil] -Djava.net.preferIPv4Stack: false 2020.06.25 16:02:44 DEBUG app[][i.netty.util.NetUtil] -Djava.net.preferIPv6Addresses: false 2020.06.25 16:02:44 DEBUG app[][i.netty.util.NetUtil] Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) 2020.06.25 16:02:44 DEBUG app[][i.netty.util.NetUtil] /proc/sys/net/core/somaxconn: 128 2020.06.25 16:02:44 DEBUG app[][i.n.c.DefaultChannelId] -Dio.netty.machineId: 02:2e:a5:ff:fe:ca:f8:fa (auto-detected) 2020.06.25 16:02:44 DEBUG app[][i.n.u.i.InternalThreadLocalMap] -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 2020.06.25 16:02:44 DEBUG app[][i.n.u.i.InternalThreadLocalMap] -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 2020.06.25 16:02:44 DEBUG app[][i.n.u.ResourceLeakDetector] -Dio.netty.leakDetection.level: simple 2020.06.25 16:02:44 DEBUG app[][i.n.u.ResourceLeakDetector] -Dio.netty.leakDetection.targetRecords: 4 2020.06.25 16:02:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.numHeapArenas: 0 2020.06.25 16:02:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.numDirectArenas: 0 2020.06.25 16:02:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.pageSize: 8192 2020.06.25 16:02:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.maxOrder: 11 2020.06.25 16:02:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.chunkSize: 16777216 2020.06.25 16:02:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.tinyCacheSize: 512 2020.06.25 16:02:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.smallCacheSize: 256 2020.06.25 16:02:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.normalCacheSize: 64 2020.06.25 16:02:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.maxCachedBufferCapacity: 32768 2020.06.25 16:02:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.cacheTrimInterval: 8192 2020.06.25 16:02:44 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.useCacheForAllThreads: true 2020.06.25 16:02:44 DEBUG app[][i.n.b.ByteBufUtil] -Dio.netty.allocator.type: pooled 2020.06.25 16:02:44 DEBUG app[][i.n.b.ByteBufUtil] -Dio.netty.threadLocalDirectBufferSize: 0 2020.06.25 16:02:44 DEBUG app[][i.n.b.ByteBufUtil] -Dio.netty.maxThreadLocalCharBufferSize: 16384 2020.06.25 16:02:44 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{nl-OgQJATMaC0vIGemUTxg}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_exception at org.elasticsearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1309) at org.elasticsearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:100) at org.elasticsearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:42) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) at org.elasticsearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:57) at org.elasticsearch.transport.netty4.Netty4TcpChannel.lambda$new$1(Netty4TcpChannel.java:72) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:511) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:504) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:483) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:424) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:121) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:343) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:591) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:508) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:779) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 6 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.06.25 16:02:44 DEBUG app[][o.s.a.e.EsConnectorImpl] Connected to Elasticsearch node: [172.16.73.201:9001] Jun 25, 2020 16:02:45 +0000 [17705 1] com.newrelic INFO: New Relic Agent: Loading configuration file "/opt/newrelic/sonarqube/./newrelic.yml" Jun 25, 2020 16:02:45 +0000 [17705 1] com.newrelic INFO: Using default collector host: collector.newrelic.com Jun 25, 2020 16:02:45 +0000 [17705 1] com.newrelic INFO: New Relic Agent: Writing to log file: /opt/newrelic/sonarqube/logs/newrelic_agent.log WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by com.newrelic.weave.weavepackage.NewClassAppender (file:/opt/newrelic/sonarqube/newrelic.jar) to method java.net.URLClassLoader.addURL(java.net.URL) WARNING: Please consider reporting this to the maintainers of com.newrelic.weave.weavepackage.NewClassAppender WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 2020.06.25 16:02:49 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{nl-OgQJATMaC0vIGemUTxg}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_exception at org.elasticsearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1309) at org.elasticsearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:100) at org.elasticsearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:42) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) at org.elasticsearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:57) at org.elasticsearch.transport.netty4.Netty4TcpChannel.lambda$new$1(Netty4TcpChannel.java:72) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:511) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:504) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:483) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:424) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:121) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:343) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:591) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:508) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:779) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 6 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.06.25 16:02:54 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{nl-OgQJATMaC0vIGemUTxg}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_exception at org.elasticsearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1309) at org.elasticsearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:100) at org.elasticsearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:42) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) at org.elasticsearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:57) at org.elasticsearch.transport.netty4.Netty4TcpChannel.lambda$new$1(Netty4TcpChannel.java:72) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:511) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:504) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:483) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:424) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:121) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:343) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:591) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:508) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:779) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 6 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.06.25 16:02:59 DEBUG app[][i.n.b.AbstractByteBuf] -Dio.netty.buffer.checkAccessible: true 2020.06.25 16:02:59 DEBUG app[][i.n.b.AbstractByteBuf] -Dio.netty.buffer.checkBounds: true 2020.06.25 16:02:59 DEBUG app[][i.n.u.ResourceLeakDetectorFactory] Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@769dd227 2020.06.25 16:02:59 DEBUG app[][i.n.util.Recycler] -Dio.netty.recycler.maxCapacityPerThread: 4096 2020.06.25 16:02:59 DEBUG app[][i.n.util.Recycler] -Dio.netty.recycler.maxSharedCapacityFactor: 2 2020.06.25 16:02:59 DEBUG app[][i.n.util.Recycler] -Dio.netty.recycler.linkCapacity: 16 2020.06.25 16:02:59 DEBUG app[][i.n.util.Recycler] -Dio.netty.recycler.ratio: 8 2020.06.25 16:02:59 DEBUG app[][o.e.t.ConnectionManager] connected to node [{sonarqube}{EE_pHUNiTwyIw1h7MTymhA}{VN10amQvSnqScZ2Upyl3VA}{172.16.73.201}{172.16.73.201:9001}{rack_id=sonarqube}] 2020.06.25 16:03:00 INFO app[][o.s.a.SchedulerImpl] Process[es] is up 2020.06.25 16:03:00 INFO app[][o.s.a.ProcessLauncherImpl] Launch process[[key='web', ipcIndex=2, logFilenamePrefix=web]] from [/app/sonarsource/install/sonarqube-7.9.3]: /app/jdk/jdk-11.0.7+10/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/app/sonarsource/home/sonarqube/temp --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED -Xmx4G -Xms4G -XX:+HeapDumpOnOutOfMemoryError -javaagent:/opt/newrelic/sonarqube/newrelic.jar -Dnewrelic.environment=prod -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/common/*:/app/sonarsource/install/sonarqube-7.9.3/lib/jdbc/postgresql/postgresql-42.2.5.jar org.sonar.server.app.WebServer /app/sonarsource/home/sonarqube/temp/sq-process2000553215067322574properties Jun 25, 2020 16:03:01 +0000 [17894 1] com.newrelic INFO: New Relic Agent: Loading configuration file "/opt/newrelic/sonarqube/./newrelic.yml" Jun 25, 2020 16:03:01 +0000 [17894 1] com.newrelic INFO: Using default collector host: collector.newrelic.com Jun 25, 2020 16:03:02 +0000 [17894 1] com.newrelic INFO: New Relic Agent: Writing to log file: /opt/newrelic/sonarqube/logs/newrelic_agent.log WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by com.newrelic.weave.weavepackage.NewClassAppender (file:/opt/newrelic/sonarqube/newrelic.jar) to method java.net.URLClassLoader.addURL(java.net.URL) WARNING: Please consider reporting this to the maintainers of com.newrelic.weave.weavepackage.NewClassAppender WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 2020.06.25 16:03:13 WARN app[][startup] ################################################################################ The database must be manually upgraded. Please backup the database and browse /setup. For more information: https://docs.sonarqube.org/latest/setup/upgrading ################################################################################ 2020.06.25 16:04:34 DEBUG app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [web]: 0 2020.06.25 16:04:34 INFO app[][o.s.a.SchedulerImpl] Process[web] is stopped 2020.06.25 16:04:34 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{nl-OgQJATMaC0vIGemUTxg}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_exception at org.elasticsearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1309) at org.elasticsearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:100) at org.elasticsearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:42) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) at org.elasticsearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:57) at org.elasticsearch.transport.netty4.Netty4TcpChannel.lambda$new$1(Netty4TcpChannel.java:72) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:511) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:504) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:483) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:424) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:121) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:343) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:591) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:508) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:779) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 6 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.06.25 16:04:35 WARN app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [es]: 143 2020.06.25 16:04:35 INFO app[][o.s.a.SchedulerImpl] Process[es] is stopped 2020.06.25 16:04:35 INFO app[][o.s.a.SchedulerImpl] SonarQube is stopped 2020.06.25 16:04:35 DEBUG app[][o.s.a.SchedulerImpl] Stopping [ce]... 2020.06.25 16:04:35 DEBUG app[][o.s.a.SchedulerImpl] Stopping [web]... 2020.06.25 16:04:35 DEBUG app[][o.s.a.SchedulerImpl] Stopping [es]... <-- Wrapper Stopped --> Wrapper Started as Daemon Launching a JVM... Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org Copyright 1999-2006 Tanuki Software, Inc. All Rights Reserved. 2020.06.25 16:48:42 INFO app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /app/sonarsource/home/sonarqube/temp 2020.06.25 16:48:42 INFO app[][o.s.a.es.EsSettings] Elasticsearch listening on /172.16.73.201:9001 2020.06.25 16:48:42 INFO app[][o.s.a.ProcessLauncherImpl] Launch process[[key='es', ipcIndex=1, logFilenamePrefix=es]] from [/app/sonarsource/install/sonarqube-7.9.3/elasticsearch]: /app/sonarsource/install/sonarqube-7.9.3/elasticsearch/bin/elasticsearch 2020.06.25 16:48:42 INFO app[][o.s.a.SchedulerImpl] Waiting for Elasticsearch to be up and running OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. 2020.06.25 16:48:43 INFO app[][o.e.p.PluginsService] no modules loaded 2020.06.25 16:48:43 INFO app[][o.e.p.PluginsService] loaded plugin [org.elasticsearch.transport.Netty4Plugin] 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [force_merge], size [1], queue size [unbounded] 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [fetch_shard_started], core [1], max [8], keep alive [5m] 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [listener], size [2], queue size [unbounded] 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [index], size [4], queue size [200] 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [refresh], core [1], max [2], keep alive [5m] 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [generic], core [4], max [128], keep alive [30s] 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [warmer], core [1], max [2], keep alive [5m] 2020.06.25 16:48:43 DEBUG app[][o.e.c.u.c.QueueResizingEsThreadPoolExecutor] thread pool [_client_/search] will adjust queue by [50] when determining automatic queue size 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [search], size [7], queue size [1k] 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [flush], core [1], max [2], keep alive [5m] 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [fetch_shard_store], core [1], max [8], keep alive [5m] 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [management], core [1], max [5], keep alive [5m] 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [get], size [4], queue size [1k] 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [analyze], size [1], queue size [16] 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [write], size [4], queue size [200] 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [snapshot], core [1], max [2], keep alive [5m] 2020.06.25 16:48:43 DEBUG app[][o.e.c.u.c.QueueResizingEsThreadPoolExecutor] thread pool [_client_/search_throttled] will adjust queue by [50] when determining automatic queue size 2020.06.25 16:48:43 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [search_throttled], size [1], queue size [100] 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent0] -Dio.netty.noUnsafe: false 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent0] Java version: 11 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent0] sun.misc.Unsafe.theUnsafe: available 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent0] sun.misc.Unsafe.copyMemory: available 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent0] java.nio.Buffer.address: available 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent0] direct buffer constructor: unavailable java.lang.UnsupportedOperationException: Reflective setAccessible(true) disabled at io.netty.util.internal.ReflectionUtil.trySetAccessible(ReflectionUtil.java:31) at io.netty.util.internal.PlatformDependent0$4.run(PlatformDependent0.java:224) at java.base/java.security.AccessController.doPrivileged(Native Method) at io.netty.util.internal.PlatformDependent0.(PlatformDependent0.java:218) at io.netty.util.internal.PlatformDependent.isAndroid(PlatformDependent.java:212) at io.netty.util.internal.PlatformDependent.(PlatformDependent.java:80) at io.netty.util.ConstantPool.(ConstantPool.java:32) at io.netty.util.AttributeKey$1.(AttributeKey.java:27) at io.netty.util.AttributeKey.(AttributeKey.java:27) at org.elasticsearch.transport.netty4.Netty4Transport.(Netty4Transport.java:219) at org.elasticsearch.transport.Netty4Plugin.getSettings(Netty4Plugin.java:57) at org.elasticsearch.plugins.PluginsService.lambda$getPluginSettings$0(PluginsService.java:89) at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) at org.elasticsearch.plugins.PluginsService.getPluginSettings(PluginsService.java:89) at org.elasticsearch.client.transport.TransportClient.buildTemplate(TransportClient.java:147) at org.elasticsearch.client.transport.TransportClient.(TransportClient.java:277) at org.sonar.application.es.EsConnectorImpl$MinimalTransportClient.(EsConnectorImpl.java:103) at org.sonar.application.es.EsConnectorImpl.buildTransportClient(EsConnectorImpl.java:89) at org.sonar.application.es.EsConnectorImpl.getTransportClient(EsConnectorImpl.java:74) at org.sonar.application.es.EsConnectorImpl.getClusterHealthStatus(EsConnectorImpl.java:61) at org.sonar.application.process.EsManagedProcess.checkStatus(EsManagedProcess.java:88) at org.sonar.application.process.EsManagedProcess.checkOperational(EsManagedProcess.java:73) at org.sonar.application.process.EsManagedProcess.isOperational(EsManagedProcess.java:58) at org.sonar.application.process.ManagedProcessHandler.refreshState(ManagedProcessHandler.java:201) at org.sonar.application.process.ManagedProcessHandler$EventWatcher.run(ManagedProcessHandler.java:258) 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent0] java.nio.Bits.unaligned: available, true 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent0] jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable java.lang.IllegalAccessException: class io.netty.util.internal.PlatformDependent0$6 cannot access class jdk.internal.misc.Unsafe (in module java.base) because module java.base does not export jdk.internal.misc to unnamed module @29ca901e at java.base/jdk.internal.reflect.Reflection.newIllegalAccessException(Reflection.java:361) at java.base/java.lang.reflect.AccessibleObject.checkAccess(AccessibleObject.java:591) at java.base/java.lang.reflect.Method.invoke(Method.java:558) at io.netty.util.internal.PlatformDependent0$6.run(PlatformDependent0.java:334) at java.base/java.security.AccessController.doPrivileged(Native Method) at io.netty.util.internal.PlatformDependent0.(PlatformDependent0.java:325) at io.netty.util.internal.PlatformDependent.isAndroid(PlatformDependent.java:212) at io.netty.util.internal.PlatformDependent.(PlatformDependent.java:80) at io.netty.util.ConstantPool.(ConstantPool.java:32) at io.netty.util.AttributeKey$1.(AttributeKey.java:27) at io.netty.util.AttributeKey.(AttributeKey.java:27) at org.elasticsearch.transport.netty4.Netty4Transport.(Netty4Transport.java:219) at org.elasticsearch.transport.Netty4Plugin.getSettings(Netty4Plugin.java:57) at org.elasticsearch.plugins.PluginsService.lambda$getPluginSettings$0(PluginsService.java:89) at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1654) at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) at org.elasticsearch.plugins.PluginsService.getPluginSettings(PluginsService.java:89) at org.elasticsearch.client.transport.TransportClient.buildTemplate(TransportClient.java:147) at org.elasticsearch.client.transport.TransportClient.(TransportClient.java:277) at org.sonar.application.es.EsConnectorImpl$MinimalTransportClient.(EsConnectorImpl.java:103) at org.sonar.application.es.EsConnectorImpl.buildTransportClient(EsConnectorImpl.java:89) at org.sonar.application.es.EsConnectorImpl.getTransportClient(EsConnectorImpl.java:74) at org.sonar.application.es.EsConnectorImpl.getClusterHealthStatus(EsConnectorImpl.java:61) at org.sonar.application.process.EsManagedProcess.checkStatus(EsManagedProcess.java:88) at org.sonar.application.process.EsManagedProcess.checkOperational(EsManagedProcess.java:73) at org.sonar.application.process.EsManagedProcess.isOperational(EsManagedProcess.java:58) at org.sonar.application.process.ManagedProcessHandler.refreshState(ManagedProcessHandler.java:201) at org.sonar.application.process.ManagedProcessHandler$EventWatcher.run(ManagedProcessHandler.java:258) 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent0] java.nio.DirectByteBuffer.(long, int): unavailable 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent] sun.misc.Unsafe: available 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent] maxDirectMemory: 33554432 bytes (maybe) 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.tmpdir: /tmp (java.io.tmpdir) 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.bitMode: 64 (sun.arch.data.model) 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.maxDirectMemory: -1 bytes 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.uninitializedArrayAllocationThreshold: -1 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.CleanerJava9] java.nio.ByteBuffer.cleaner(): available 2020.06.25 16:48:43 DEBUG app[][i.n.u.i.PlatformDependent] -Dio.netty.noPreferDirect: false 2020.06.25 16:48:44 DEBUG app[][o.e.c.i.i.Stopwatch] Module execution: 95ms 2020.06.25 16:48:44 DEBUG app[][o.e.c.i.i.Stopwatch] TypeListeners creation: 3ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Scopes creation: 6ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Converters creation: 0ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Binding creation: 4ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Private environment creation: 0ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Injector construction: 0ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Binding initialization: 0ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Binding indexing: 0ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Collecting injection requests: 0ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Binding validation: 0ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Static validation: 0ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Instance member validation: 0ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Provider verification: 0ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Static member injection: 0ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Instance injection: 0ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.i.i.Stopwatch] Preloading singletons: 0ms 2020.06.25 16:48:45 DEBUG app[][o.e.c.t.TransportClientNodesService] node_sampler_interval[5s] 2020.06.25 16:48:45 DEBUG app[][i.n.c.MultithreadEventLoopGroup] -Dio.netty.eventLoopThreads: 8 2020.06.25 16:48:45 DEBUG app[][i.n.c.n.NioEventLoop] -Dio.netty.noKeySetOptimization: false 2020.06.25 16:48:45 DEBUG app[][i.n.c.n.NioEventLoop] -Dio.netty.selectorAutoRebuildThreshold: 512 2020.06.25 16:48:45 DEBUG app[][i.n.u.i.PlatformDependent] org.jctools-core.MpscChunkedArrayQueue: available 2020.06.25 16:48:45 DEBUG app[][o.e.c.t.TransportClientNodesService] adding address [{#transport#-1}{d5ts0W89R4irM_X9UZVfrw}{172.16.73.201}{172.16.73.201:9001}] 2020.06.25 16:48:45 DEBUG app[][i.n.c.DefaultChannelId] -Dio.netty.processId: 25449 (auto-detected) 2020.06.25 16:48:45 DEBUG app[][i.netty.util.NetUtil] -Djava.net.preferIPv4Stack: false 2020.06.25 16:48:45 DEBUG app[][i.netty.util.NetUtil] -Djava.net.preferIPv6Addresses: false 2020.06.25 16:48:45 DEBUG app[][i.netty.util.NetUtil] Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) 2020.06.25 16:48:45 DEBUG app[][i.netty.util.NetUtil] /proc/sys/net/core/somaxconn: 128 2020.06.25 16:48:45 DEBUG app[][i.n.c.DefaultChannelId] -Dio.netty.machineId: 02:2e:a5:ff:fe:ca:f8:fa (auto-detected) 2020.06.25 16:48:45 DEBUG app[][i.n.u.i.InternalThreadLocalMap] -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 2020.06.25 16:48:45 DEBUG app[][i.n.u.i.InternalThreadLocalMap] -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 2020.06.25 16:48:45 DEBUG app[][i.n.u.ResourceLeakDetector] -Dio.netty.leakDetection.level: simple 2020.06.25 16:48:45 DEBUG app[][i.n.u.ResourceLeakDetector] -Dio.netty.leakDetection.targetRecords: 4 2020.06.25 16:48:45 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.numHeapArenas: 0 2020.06.25 16:48:45 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.numDirectArenas: 0 2020.06.25 16:48:45 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.pageSize: 8192 2020.06.25 16:48:45 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.maxOrder: 11 2020.06.25 16:48:45 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.chunkSize: 16777216 2020.06.25 16:48:45 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.tinyCacheSize: 512 2020.06.25 16:48:45 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.smallCacheSize: 256 2020.06.25 16:48:45 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.normalCacheSize: 64 2020.06.25 16:48:45 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.maxCachedBufferCapacity: 32768 2020.06.25 16:48:45 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.cacheTrimInterval: 8192 2020.06.25 16:48:45 DEBUG app[][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.useCacheForAllThreads: true 2020.06.25 16:48:45 DEBUG app[][i.n.b.ByteBufUtil] -Dio.netty.allocator.type: pooled 2020.06.25 16:48:45 DEBUG app[][i.n.b.ByteBufUtil] -Dio.netty.threadLocalDirectBufferSize: 0 2020.06.25 16:48:45 DEBUG app[][i.n.b.ByteBufUtil] -Dio.netty.maxThreadLocalCharBufferSize: 16384 2020.06.25 16:48:45 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{d5ts0W89R4irM_X9UZVfrw}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_exception at org.elasticsearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1309) at org.elasticsearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:100) at org.elasticsearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:42) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) at org.elasticsearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:57) at org.elasticsearch.transport.netty4.Netty4TcpChannel.lambda$new$1(Netty4TcpChannel.java:72) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:511) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:504) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:483) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:424) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:121) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:343) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:591) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:508) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:779) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 6 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.06.25 16:48:45 DEBUG app[][o.s.a.e.EsConnectorImpl] Connected to Elasticsearch node: [172.16.73.201:9001] Jun 25, 2020 16:48:46 +0000 [25491 1] com.newrelic INFO: New Relic Agent: Loading configuration file "/opt/newrelic/sonarqube/./newrelic.yml" Jun 25, 2020 16:48:46 +0000 [25491 1] com.newrelic INFO: Using default collector host: collector.newrelic.com Jun 25, 2020 16:48:46 +0000 [25491 1] com.newrelic INFO: New Relic Agent: Writing to log file: /opt/newrelic/sonarqube/logs/newrelic_agent.log WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by com.newrelic.weave.weavepackage.NewClassAppender (file:/opt/newrelic/sonarqube/newrelic.jar) to method java.net.URLClassLoader.addURL(java.net.URL) WARNING: Please consider reporting this to the maintainers of com.newrelic.weave.weavepackage.NewClassAppender WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 2020.06.25 16:48:50 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{d5ts0W89R4irM_X9UZVfrw}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_exception at org.elasticsearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1309) at org.elasticsearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:100) at org.elasticsearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:42) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) at org.elasticsearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:57) at org.elasticsearch.transport.netty4.Netty4TcpChannel.lambda$new$1(Netty4TcpChannel.java:72) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:511) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:504) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:483) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:424) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:121) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:343) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:591) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:508) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:779) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 6 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.06.25 16:48:55 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{d5ts0W89R4irM_X9UZVfrw}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_exception at org.elasticsearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1309) at org.elasticsearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:100) at org.elasticsearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:42) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) at org.elasticsearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:57) at org.elasticsearch.transport.netty4.Netty4TcpChannel.lambda$new$1(Netty4TcpChannel.java:72) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:511) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:504) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:483) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:424) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:121) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:343) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:591) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:508) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:779) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 6 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.06.25 16:49:00 DEBUG app[][i.n.b.AbstractByteBuf] -Dio.netty.buffer.checkAccessible: true 2020.06.25 16:49:00 DEBUG app[][i.n.b.AbstractByteBuf] -Dio.netty.buffer.checkBounds: true 2020.06.25 16:49:00 DEBUG app[][i.n.u.ResourceLeakDetectorFactory] Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@26023fc8 2020.06.25 16:49:00 DEBUG app[][i.n.util.Recycler] -Dio.netty.recycler.maxCapacityPerThread: 4096 2020.06.25 16:49:00 DEBUG app[][i.n.util.Recycler] -Dio.netty.recycler.maxSharedCapacityFactor: 2 2020.06.25 16:49:00 DEBUG app[][i.n.util.Recycler] -Dio.netty.recycler.linkCapacity: 16 2020.06.25 16:49:00 DEBUG app[][i.n.util.Recycler] -Dio.netty.recycler.ratio: 8 2020.06.25 16:49:00 DEBUG app[][o.e.t.ConnectionManager] connected to node [{sonarqube}{EE_pHUNiTwyIw1h7MTymhA}{cIsJJs0eQVCvqyGUA28huw}{172.16.73.201}{172.16.73.201:9001}{rack_id=sonarqube}] 2020.06.25 16:49:02 INFO app[][o.s.a.SchedulerImpl] Process[es] is up 2020.06.25 16:49:02 INFO app[][o.s.a.ProcessLauncherImpl] Launch process[[key='web', ipcIndex=2, logFilenamePrefix=web]] from [/app/sonarsource/install/sonarqube-7.9.3]: /app/jdk/jdk-11.0.7+10/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/app/sonarsource/home/sonarqube/temp --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED -Xmx4G -Xms4G -XX:+HeapDumpOnOutOfMemoryError -javaagent:/opt/newrelic/sonarqube/newrelic.jar -Dnewrelic.environment=prod -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/common/*:/app/sonarsource/install/sonarqube-7.9.3/lib/jdbc/postgresql/postgresql-42.2.5.jar org.sonar.server.app.WebServer /app/sonarsource/home/sonarqube/temp/sq-process9614391889550028913properties Jun 25, 2020 16:49:03 +0000 [25972 1] com.newrelic INFO: New Relic Agent: Loading configuration file "/opt/newrelic/sonarqube/./newrelic.yml" Jun 25, 2020 16:49:03 +0000 [25972 1] com.newrelic INFO: Using default collector host: collector.newrelic.com Jun 25, 2020 16:49:03 +0000 [25972 1] com.newrelic INFO: New Relic Agent: Writing to log file: /opt/newrelic/sonarqube/logs/newrelic_agent.log WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by com.newrelic.weave.weavepackage.NewClassAppender (file:/opt/newrelic/sonarqube/newrelic.jar) to method java.net.URLClassLoader.addURL(java.net.URL) WARNING: Please consider reporting this to the maintainers of com.newrelic.weave.weavepackage.NewClassAppender WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 2020.06.25 16:52:25 INFO app[][o.s.a.SchedulerImpl] Process[web] is up 2020.06.25 16:52:25 INFO app[][o.s.a.ProcessLauncherImpl] Launch process[[key='ce', ipcIndex=3, logFilenamePrefix=ce]] from [/app/sonarsource/install/sonarqube-7.9.3]: /app/jdk/jdk-11.0.7+10/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/app/sonarsource/home/sonarqube/temp --add-opens=java.base/java.util=ALL-UNNAMED -Xmx4G -Xms4G -XX:+HeapDumpOnOutOfMemoryError -javaagent:/opt/newrelic/sonarqube/newrelic.jar -Dnewrelic.environment=prod -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/common/*:/app/sonarsource/install/sonarqube-7.9.3/lib/jdbc/postgresql/postgresql-42.2.5.jar org.sonar.ce.app.CeServer /app/sonarsource/home/sonarqube/temp/sq-process3446335161213840082properties Jun 25, 2020 16:52:26 +0000 [3244 1] com.newrelic INFO: New Relic Agent: Loading configuration file "/opt/newrelic/sonarqube/./newrelic.yml" Jun 25, 2020 16:52:26 +0000 [3244 1] com.newrelic INFO: Using default collector host: collector.newrelic.com Jun 25, 2020 16:52:26 +0000 [3244 1] com.newrelic INFO: New Relic Agent: Writing to log file: /opt/newrelic/sonarqube/logs/newrelic_agent.log WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by com.newrelic.weave.weavepackage.NewClassAppender (file:/opt/newrelic/sonarqube/newrelic.jar) to method java.net.URLClassLoader.addURL(java.net.URL) WARNING: Please consider reporting this to the maintainers of com.newrelic.weave.weavepackage.NewClassAppender WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 2020.06.25 16:52:41 INFO app[][o.s.a.SchedulerImpl] Process[ce] is up 2020.06.25 16:52:41 INFO app[][o.s.a.SchedulerImpl] SonarQube is up 2020.07.09 16:01:01 INFO app[][o.s.a.SchedulerImpl] SQ restart requested by Process[web] 2020.07.09 16:01:01 DEBUG app[][o.s.a.SchedulerImpl] Stopping [ce]... 2020.07.09 16:01:02 DEBUG app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [ce]: 0 2020.07.09 16:01:02 INFO app[][o.s.a.SchedulerImpl] Process[ce] is stopped 2020.07.09 16:01:02 DEBUG app[][o.s.a.SchedulerImpl] Stopping [web]... 2020.07.09 16:01:03 DEBUG app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [web]: 0 2020.07.09 16:01:03 INFO app[][o.s.a.SchedulerImpl] Process[web] is stopped 2020.07.09 16:01:03 DEBUG app[][o.s.a.SchedulerImpl] Stopping [es]... 2020.07.09 16:01:03 INFO app[][o.s.a.SchedulerImpl] Process[es] is stopped 2020.07.09 16:01:03 WARN app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [es]: 143 2020.07.09 16:01:03 INFO app[][o.s.a.SchedulerImpl] SonarQube is restarting 2020.07.09 16:01:03 INFO app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /app/sonarsource/home/sonarqube/temp 2020.07.09 16:01:03 INFO app[][o.s.a.es.EsSettings] Elasticsearch listening on /172.16.73.201:9001 2020.07.09 16:01:03 INFO app[][o.s.a.ProcessLauncherImpl] Launch process[[key='es', ipcIndex=1, logFilenamePrefix=es]] from [/app/sonarsource/install/sonarqube-7.9.3/elasticsearch]: /app/sonarsource/install/sonarqube-7.9.3/elasticsearch/bin/elasticsearch 2020.07.09 16:01:03 INFO app[][o.e.p.PluginsService] no modules loaded 2020.07.09 16:01:03 INFO app[][o.e.p.PluginsService] loaded plugin [org.elasticsearch.transport.Netty4Plugin] 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [force_merge], size [1], queue size [unbounded] 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [fetch_shard_started], core [1], max [8], keep alive [5m] 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [listener], size [2], queue size [unbounded] 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [index], size [4], queue size [200] 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [refresh], core [1], max [2], keep alive [5m] 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [generic], core [4], max [128], keep alive [30s] 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [warmer], core [1], max [2], keep alive [5m] 2020.07.09 16:01:03 DEBUG app[][o.e.c.u.c.QueueResizingEsThreadPoolExecutor] thread pool [_client_/search] will adjust queue by [50] when determining automatic queue size 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [search], size [7], queue size [1k] 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [flush], core [1], max [2], keep alive [5m] 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [fetch_shard_store], core [1], max [8], keep alive [5m] 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [management], core [1], max [5], keep alive [5m] 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [get], size [4], queue size [1k] 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [analyze], size [1], queue size [16] 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [write], size [4], queue size [200] 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [snapshot], core [1], max [2], keep alive [5m] 2020.07.09 16:01:03 DEBUG app[][o.e.c.u.c.QueueResizingEsThreadPoolExecutor] thread pool [_client_/search_throttled] will adjust queue by [50] when determining automatic queue size 2020.07.09 16:01:03 DEBUG app[][o.e.t.ThreadPool] created thread pool: name [search_throttled], size [1], queue size [100] 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Module execution: 7ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] TypeListeners creation: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Scopes creation: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Converters creation: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Binding creation: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Private environment creation: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Injector construction: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Binding initialization: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Binding indexing: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Collecting injection requests: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Binding validation: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Static validation: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Instance member validation: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Provider verification: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Static member injection: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Instance injection: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.i.i.Stopwatch] Preloading singletons: 0ms 2020.07.09 16:01:03 DEBUG app[][o.e.c.t.TransportClientNodesService] node_sampler_interval[5s] 2020.07.09 16:01:03 DEBUG app[][o.e.c.t.TransportClientNodesService] adding address [{#transport#-1}{ax1ywObiRFSUjK3wexDZGg}{172.16.73.201}{172.16.73.201:9001}] 2020.07.09 16:01:03 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{ax1ywObiRFSUjK3wexDZGg}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_exception at org.elasticsearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1309) at org.elasticsearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:100) at org.elasticsearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:42) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) at org.elasticsearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:57) at org.elasticsearch.transport.netty4.Netty4TcpChannel.lambda$new$1(Netty4TcpChannel.java:72) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:511) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:504) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:483) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:424) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:121) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:343) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:591) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:508) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:779) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 6 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.07.09 16:01:03 DEBUG app[][o.s.a.e.EsConnectorImpl] Connected to Elasticsearch node: [172.16.73.201:9001] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. Jul 9, 2020 16:01:06 +0000 [13512 1] com.newrelic INFO: New Relic Agent: Loading configuration file "/opt/newrelic/sonarqube/./newrelic.yml" Jul 9, 2020 16:01:06 +0000 [13512 1] com.newrelic INFO: Using default collector host: collector.newrelic.com Jul 9, 2020 16:01:07 +0000 [13512 1] com.newrelic INFO: New Relic Agent: Writing to log file: /opt/newrelic/sonarqube/logs/newrelic_agent.log 2020.07.09 16:01:08 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{d5ts0W89R4irM_X9UZVfrw}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_exception at org.elasticsearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1309) at org.elasticsearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:100) at org.elasticsearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:42) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) at org.elasticsearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:57) at org.elasticsearch.transport.netty4.Netty4TcpChannel.lambda$new$1(Netty4TcpChannel.java:72) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:511) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:504) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:483) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:424) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:121) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:343) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:591) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:508) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:779) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 6 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.07.09 16:01:08 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{ax1ywObiRFSUjK3wexDZGg}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_exception at org.elasticsearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1309) at org.elasticsearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:100) at org.elasticsearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:42) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) at org.elasticsearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:57) at org.elasticsearch.transport.netty4.Netty4TcpChannel.lambda$new$1(Netty4TcpChannel.java:72) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:511) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:504) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:483) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:424) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:121) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:343) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:591) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:508) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:779) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 6 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by com.newrelic.weave.weavepackage.NewClassAppender (file:/opt/newrelic/sonarqube/newrelic.jar) to method java.net.URLClassLoader.addURL(java.net.URL) WARNING: Please consider reporting this to the maintainers of com.newrelic.weave.weavepackage.NewClassAppender WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 2020.07.09 16:01:13 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{d5ts0W89R4irM_X9UZVfrw}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_exception at org.elasticsearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1309) at org.elasticsearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:100) at org.elasticsearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:42) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) at org.elasticsearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:57) at org.elasticsearch.transport.netty4.Netty4TcpChannel.lambda$new$1(Netty4TcpChannel.java:72) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:511) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:504) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:483) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:424) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:121) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:343) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:591) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:508) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:779) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 6 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.07.09 16:01:13 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{ax1ywObiRFSUjK3wexDZGg}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_exception at org.elasticsearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1309) at org.elasticsearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:100) at org.elasticsearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:42) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) at org.elasticsearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:57) at org.elasticsearch.transport.netty4.Netty4TcpChannel.lambda$new$1(Netty4TcpChannel.java:72) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:511) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:504) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:483) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:424) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:121) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:343) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:591) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:508) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:779) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 6 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.07.09 16:01:18 DEBUG app[][o.e.c.t.TransportClientNodesService] failed to connect to node [{#transport#-1}{d5ts0W89R4irM_X9UZVfrw}{172.16.73.201}{172.16.73.201:9001}], ignoring... org.elasticsearch.transport.ConnectTransportException: [][172.16.73.201:9001] connect_exception at org.elasticsearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1309) at org.elasticsearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:100) at org.elasticsearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:42) at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) at org.elasticsearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:57) at org.elasticsearch.transport.netty4.Netty4TcpChannel.lambda$new$1(Netty4TcpChannel.java:72) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:511) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:504) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:483) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:424) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:121) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:343) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:644) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:591) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:508) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /172.16.73.201:9001 at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:779) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:327) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340) ... 6 common frames omitted Caused by: java.net.ConnectException: Connection refused ... 10 common frames omitted 2020.07.09 16:01:18 DEBUG app[][o.e.t.ConnectionManager] connected to node [{sonarqube}{EE_pHUNiTwyIw1h7MTymhA}{XLMqn2jaQpic8E82egBxyw}{172.16.73.201}{172.16.73.201:9001}{rack_id=sonarqube}] 2020.07.09 16:01:23 DEBUG app[][o.e.t.ConnectionManager] connected to node [{sonarqube}{EE_pHUNiTwyIw1h7MTymhA}{XLMqn2jaQpic8E82egBxyw}{172.16.73.201}{172.16.73.201:9001}{rack_id=sonarqube}] 2020.07.09 16:01:24 INFO app[][o.s.a.SchedulerImpl] Process[es] is up 2020.07.09 16:01:24 INFO app[][o.s.a.ProcessLauncherImpl] Launch process[[key='web', ipcIndex=2, logFilenamePrefix=web]] from [/app/sonarsource/install/sonarqube-7.9.3]: /app/jdk/jdk-11.0.7+10/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/app/sonarsource/home/sonarqube/temp --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED -Xmx4G -Xms4G -XX:+HeapDumpOnOutOfMemoryError -javaagent:/opt/newrelic/sonarqube/newrelic.jar -Dnewrelic.environment=prod -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/common/*:/app/sonarsource/install/sonarqube-7.9.3/lib/jdbc/postgresql/postgresql-42.2.5.jar org.sonar.server.app.WebServer /app/sonarsource/home/sonarqube/temp/sq-process17147530078445621681properties Jul 9, 2020 16:01:25 +0000 [14003 1] com.newrelic INFO: New Relic Agent: Loading configuration file "/opt/newrelic/sonarqube/./newrelic.yml" Jul 9, 2020 16:01:25 +0000 [14003 1] com.newrelic INFO: Using default collector host: collector.newrelic.com Jul 9, 2020 16:01:25 +0000 [14003 1] com.newrelic INFO: New Relic Agent: Writing to log file: /opt/newrelic/sonarqube/logs/newrelic_agent.log WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by com.newrelic.weave.weavepackage.NewClassAppender (file:/opt/newrelic/sonarqube/newrelic.jar) to method java.net.URLClassLoader.addURL(java.net.URL) WARNING: Please consider reporting this to the maintainers of com.newrelic.weave.weavepackage.NewClassAppender WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 2020.07.09 16:02:09 INFO app[][o.s.a.SchedulerImpl] Process[web] is up 2020.07.09 16:02:09 INFO app[][o.s.a.ProcessLauncherImpl] Launch process[[key='ce', ipcIndex=3, logFilenamePrefix=ce]] from [/app/sonarsource/install/sonarqube-7.9.3]: /app/jdk/jdk-11.0.7+10/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/app/sonarsource/home/sonarqube/temp --add-opens=java.base/java.util=ALL-UNNAMED -Xmx4G -Xms4G -XX:+HeapDumpOnOutOfMemoryError -javaagent:/opt/newrelic/sonarqube/newrelic.jar -Dnewrelic.environment=prod -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/common/*:/app/sonarsource/install/sonarqube-7.9.3/lib/jdbc/postgresql/postgresql-42.2.5.jar org.sonar.ce.app.CeServer /app/sonarsource/home/sonarqube/temp/sq-process4957403818646695811properties Jul 9, 2020 16:02:10 +0000 [15414 1] com.newrelic INFO: New Relic Agent: Loading configuration file "/opt/newrelic/sonarqube/./newrelic.yml" Jul 9, 2020 16:02:10 +0000 [15414 1] com.newrelic INFO: Using default collector host: collector.newrelic.com Jul 9, 2020 16:02:10 +0000 [15414 1] com.newrelic INFO: New Relic Agent: Writing to log file: /opt/newrelic/sonarqube/logs/newrelic_agent.log WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by com.newrelic.weave.weavepackage.NewClassAppender (file:/opt/newrelic/sonarqube/newrelic.jar) to method java.net.URLClassLoader.addURL(java.net.URL) WARNING: Please consider reporting this to the maintainers of com.newrelic.weave.weavepackage.NewClassAppender WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 2020.07.09 16:02:28 INFO app[][o.s.a.SchedulerImpl] Process[ce] is up 2020.07.09 16:02:28 INFO app[][o.s.a.SchedulerImpl] SonarQube is up