Unable to access SonarQube service after upgrade to (sonarqube-10.1.0.73491)

SonarQube 9.9 LTS Upgrade
1

Make sure to tell us:

  • What version are you upgrading from?
  • System information (Operating system, Java version, Database provider/version)
  • What’s the issue you’re facing?

from 9.8 to 10.1
Linux .java 17, Postgress
Unable to access SonarQube service after upgrade
FYI

Aug 11 11:01:27 xxxxxxxxxxxxxxxx nohup[8813]: WARNING: A terminally deprecated method in java.lang.System has been called
Aug 11 11:01:27 xxxxxxxxxxxxxxxx nohup[8813]: WARNING: System::setSecurityManager has been called by org.sonar.process.PluginSecurityManager (file:/opt/sonarqube-10.1.0.73491/lib/sonar-application-10.1.0.73491.jar)
Aug 11 11:01:27 xxxxxxxxxxxxxxxx nohup[8813]: WARNING: Please consider reporting this to the maintainers of org.sonar.process.PluginSecurityManager
Aug 11 11:01:27 xxxxxxxxxxxxxxxx nohup[8813]: WARNING: System::setSecurityManager will be removed in a future release
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=SYSCALL msg=audit(1691769679.039:4860): arch=c000003e syscall=59 success=yes exit=0 a0=7fa12615d350 a1=7fa12b2ad0e0 a2=7ffe15a74170 a3=8 items=2 ppid=8927 pid=8968 auid=4294967295 uid=994 gid=991 euid=994 suid=994 fsuid=994 egid=991 sgid=991 fsgid=991 tty=(none) ses=4294967295 comm="jspawnhelper" exe="/usr/lib/jvm/java-17-openjdk-17.0.8.0.7-2.el8.x86_64/lib/jspawnhelper" subj=system_u:system_r:unconfined_service_t:s0 key="execve"ARCH=x86_64 SYSCALL=execve AUID="unset" UID="sonarqube" GID="sonarqube" EUID="sonarqube" SUID="sonarqube" FSUID="sonarqube" EGID="sonarqube" SGID="sonarqube" FSGID="sonarqube"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=EXECVE msg=audit(1691769679.039:4860): argc=1 a0="66:69"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=CWD msg=audit(1691769679.039:4860): cwd="/opt/sonarqube-10.1.0.73491/elasticsearch"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=PATH msg=audit(1691769679.039:4860): item=0 name="/usr/lib/jvm/java-17-openjdk-17.0.8.0.7-2.el8.x86_64/lib/jspawnhelper" inode=3292097 dev=fd:00 mode=0100755 ouid=0 ogid=0 rdev=00:00 obj=system_u:object_r:lib_t:s0 nametype=NORMAL cap_fp=0 cap_fi=0 cap_fe=0 cap_fver=0 cap_frootid=0OUID="root" OGID="root"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=PATH msg=audit(1691769679.039:4860): item=1 name="/lib64/ld-linux-x86-64.so.2" inode=3282912 dev=fd:00 mode=0100755 ouid=0 ogid=0 rdev=00:00 obj=system_u:object_r:ld_so_t:s0 nametype=NORMAL cap_fp=0 cap_fi=0 cap_fe=0 cap_fver=0 cap_frootid=0OUID="root" OGID="root"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=PROCTITLE msg=audit(1691769679.039:4860): proctitle="66:69"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=SYSCALL msg=audit(1691769679.040:4861): arch=c000003e syscall=59 success=yes exit=0 a0=5623558142a0 a1=5623558142f0 a2=7ffcad323fb8 a3=7ffcad323cd0 items=1 ppid=8927 pid=8968 auid=4294967295 uid=994 gid=991 euid=994 suid=994 fsuid=994 egid=991 sgid=991 fsgid=991 tty=(none) ses=4294967295 comm="ldconfig" exe="/usr/sbin/ldconfig" subj=system_u:system_r:unconfined_service_t:s0 key="execve"ARCH=x86_64 SYSCALL=execve AUID="unset" UID="sonarqube" GID="sonarqube" EUID="sonarqube" SUID="sonarqube" FSUID="sonarqube" EGID="sonarqube" SGID="sonarqube" FSGID="sonarqube"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=EXECVE msg=audit(1691769679.040:4861): argc=2 a0="/sbin/ldconfig" a1="-p"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=CWD msg=audit(1691769679.040:4861): cwd="/opt/sonarqube-10.1.0.73491/elasticsearch"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=PATH msg=audit(1691769679.040:4861): item=0 name="/sbin/ldconfig" inode=3289329 dev=fd:00 mode=0100755 ouid=0 ogid=0 rdev=00:00 obj=system_u:object_r:ldconfig_exec_t:s0 nametype=NORMAL cap_fp=0 cap_fi=0 cap_fe=0 cap_fver=0 cap_frootid=0OUID="root" OGID="root"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=PROCTITLE msg=audit(1691769679.040:4861): proctitle="66:69"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=SYSCALL msg=audit(1691769684.292:4862): arch=c000003e syscall=59 success=yes exit=0 a0=7fb9781fb6d0 a1=7fb9c8826b80 a2=7ffdbfc4c9c0 a3=8 items=2 ppid=8813 pid=8991 auid=4294967295 uid=994 gid=991 euid=994 suid=994 fsuid=994 egid=991 sgid=991 fsgid=991 tty=(none) ses=4294967295 comm="jspawnhelper" exe="/usr/lib/jvm/java-17-openjdk-17.0.8.0.7-2.el8.x86_64/lib/jspawnhelper" subj=system_u:system_r:unconfined_service_t:s0 key="execve"ARCH=x86_64 SYSCALL=execve AUID="unset" UID="sonarqube" GID="sonarqube" EUID="sonarqube" SUID="sonarqube" FSUID="sonarqube" EGID="sonarqube" SGID="sonarqube" FSGID="sonarqube"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=EXECVE msg=audit(1691769684.292:4862): argc=1 a0="37:40"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=CWD msg=audit(1691769684.292:4862): cwd="/"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=PATH msg=audit(1691769684.292:4862): item=0 name="/usr/lib/jvm/java-17-openjdk-17.0.8.0.7-2.el8.x86_64/lib/jspawnhelper" inode=3292097 dev=fd:00 mode=0100755 ouid=0 ogid=0 rdev=00:00 obj=system_u:object_r:lib_t:s0 nametype=NORMAL cap_fp=0 cap_fi=0 cap_fe=0 cap_fver=0 cap_frootid=0OUID="root" OGID="root"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=PATH msg=audit(1691769684.292:4862): item=1 name="/lib64/ld-linux-x86-64.so.2" inode=3282912 dev=fd:00 mode=0100755 ouid=0 ogid=0 rdev=00:00 obj=system_u:object_r:ld_so_t:s0 nametype=NORMAL cap_fp=0 cap_fi=0 cap_fe=0 cap_fver=0 cap_frootid=0OUID="root" OGID="root"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=PROCTITLE msg=audit(1691769684.292:4862): proctitle="37:40"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=SYSCALL msg=audit(1691769684.293:4863): arch=c000003e syscall=59 success=yes exit=0 a0=55895c8632a0 a1=55895c8637b0 a2=55895c863880 a3=7ffc2f6665c0 items=2 ppid=8813 pid=8991 auid=4294967295 uid=994 gid=991 euid=994 suid=994 fsuid=994 egid=991 sgid=991 fsgid=991 tty=(none) ses=4294967295 comm="java" exe="/usr/lib/jvm/java-17-openjdk-17.0.8.0.7-2.el8.x86_64/bin/java" subj=system_u:system_r:unconfined_service_t:s0 key="execve"ARCH=x86_64 SYSCALL=execve AUID="unset" UID="sonarqube" GID="sonarqube" EUID="sonarqube" SUID="sonarqube" FSUID="sonarqube" EGID="sonarqube" SGID="sonarqube" FSGID="sonarqube"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=EXECVE msg=audit(1691769684.293:4863): argc=23 a0="/usr/lib/jvm/java-17-openjdk-17.0.8.0.7-2.el8.x86_64/bin/java" a1="-Djava.awt.headless=true" a2="-Dfile.encoding=UTF-8" a3="-Djava.io.tmpdir=/var/sonarqube/temp" a4="-XX:-OmitStackTraceInFastThrow" a5="--add-opens=java.base/java.util=ALL-UNNAMED" a6="--add-opens=java.base/java.lang=ALL-UNNAMED" a7="--add-opens=java.base/java.io=ALL-UNNAMED" a8="--add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED" a9="--add-exports=java.base/jdk.internal.ref=ALL-UNNAMED" a10="--add-opens=java.base/java.nio=ALL-UNNAMED" a11="--add-opens=java.base/sun.nio.ch=ALL-UNNAMED" a12="--add-opens=java.management/sun.management=ALL-UNNAMED" a13="--add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED" a14="-Dcom.redhat.fips=false" a15="-Xmx512m" a16="-Xms128m" a17="-XX:+HeapDumpOnOutOfMemoryError" a18="-Dhttp.nonProxyHosts=localhost|127.*|[::1]" a19="-cp" a20="./lib/sonar-application-10.1.0.73491.jar:/opt/sonarqube-10.1.0.73491/lib/jdbc/postgresql/postgresql-42.6.0.jar" a21="org.sonar.server.app.WebServer" a22="/var/sonarqube/temp/sq-process7735349266589498665properties"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=CWD msg=audit(1691769684.293:4863): cwd="/opt/sonarqube-10.1.0.73491"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=PATH msg=audit(1691769684.293:4863): item=0 name="/usr/lib/jvm/java-17-openjdk-17.0.8.0.7-2.el8.x86_64/bin/java" inode=3291845 dev=fd:00 mode=0100755 ouid=0 ogid=0 rdev=00:00 obj=system_u:object_r:bin_t:s0 nametype=NORMAL cap_fp=0 cap_fi=0 cap_fe=0 cap_fver=0 cap_frootid=0OUID="root" OGID="root"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=PATH msg=audit(1691769684.293:4863): item=1 name="/lib64/ld-linux-x86-64.so.2" inode=3282912 dev=fd:00 mode=0100755 ouid=0 ogid=0 rdev=00:00 obj=system_u:object_r:ld_so_t:s0 nametype=NORMAL cap_fp=0 cap_fi=0 cap_fe=0 cap_fver=0 cap_frootid=0OUID="root" OGID="root"
Aug 11 11:01:27 xxxxxxxxxxxxxxxx tag_audit_log: type=PROCTITLE msg=audit(1691769684.293:4863): proctitle="37:40"
Aug 11 11:01:29 xxxxxxxxxxxxxxxx nohup[8813]: 2023.08.11 11:01:29 INFO  app[][o.s.a.SchedulerImpl] Process[Web Server] is stopped
Aug 11 11:01:29 xxxxxxxxxxxxxxxx nohup[8813]: 2023.08.11 11:01:29 INFO  app[][o.s.a.SchedulerImpl] Process[ElasticSearch] is stopped
Aug 11 11:01:29 xxxxxxxxxxxxxxxx nohup[8813]: 2023.08.11 11:01:29 WARN  app[][o.s.a.p.AbstractManagedProcess] Process exited with exit value [ElasticSearch]: 143
Aug 11 11:01:29 xxxxxxxxxxxxxxxx nohup[8813]: 2023.08.11 11:01:29 INFO  app[][o.s.a.SchedulerImpl] SonarQube is stopped
Aug 11 11:01:29 xxxxxxxxxxxxxxxx systemd[1]: sonarqube.service: Succeeded.
2

What do the various log files say?

3 
Still getting below error in es.log file 
0-477.21.1.el8_8.x86_64/amd64], JVM[Red Hat, Inc./OpenJDK 64-Bit Server VM/17.0.8/17.0.8+7-LTS]
2023.08.17 10:27:27 INFO  es[][o.e.n.Node] JVM home [/usr/lib/jvm/java-17-openjdk-17.0.8.0.7-2.el8.x86_64], using bundled JDK [false]
2023.08.17 10:27:27 INFO  es[][o.e.n.Node] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/var/sonarqube/temp, -XX:ErrorFile=/opt/sonarqube-10.1.0.73491/logs/es_hs_err_pid%p.log, -Xlog:disable, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -Djna.tmpdir=/var/sonarqube/temp, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=COMPAT, -Dcom.redhat.fips=false, -Des.enforce.bootstrap.checks=true, -Xmx512m, -Xms512m, -XX:MaxDirectMemorySize=256m, -XX:+HeapDumpOnOutOfMemoryError, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=tar, --module-path=/opt/sonarqube-10.1.0.73491/elasticsearch/lib, --add-modules=jdk.net, -Djdk.module.main=org.elasticsearch.server, -agentpath:/opt/dynatrace/oneagent/agent/bin/1.259.304.20230210-081346/linux-x86-64/liboneagentloader.so=loglevelcon=none,datastorage=/var/lib/dynatrace/oneagent/datastorage,logdir=/var/log/dynatrace/oneagent]
2023.08.17 10:27:28 INFO  es[][o.e.p.PluginsService] loaded module [aggregations]
2023.08.17 10:27:28 INFO  es[][o.e.p.PluginsService] loaded module [analysis-common]
2023.08.17 10:27:28 INFO  es[][o.e.p.PluginsService] loaded module [apm]
2023.08.17 10:27:28 INFO  es[][o.e.p.PluginsService] loaded module [blob-cache]
2023.08.17 10:27:28 INFO  es[][o.e.p.PluginsService] loaded module [lang-painless]
2023.08.17 10:27:28 INFO  es[][o.e.p.PluginsService] loaded module [old-lucene-versions]
2023.08.17 10:27:28 INFO  es[][o.e.p.PluginsService] loaded module [parent-join]
2023.08.17 10:27:28 INFO  es[][o.e.p.PluginsService] loaded module [reindex]
2023.08.17 10:27:28 INFO  es[][o.e.p.PluginsService] loaded module [transport-netty4]
2023.08.17 10:27:28 INFO  es[][o.e.p.PluginsService] loaded module [x-pack-aggregate-metric]
2023.08.17 10:27:28 INFO  es[][o.e.p.PluginsService] loaded module [x-pack-core]
2023.08.17 10:27:28 INFO  es[][o.e.p.PluginsService] loaded module [x-pack-profiling]
2023.08.17 10:27:28 INFO  es[][o.e.p.PluginsService] loaded module [x-pack-security]
2023.08.17 10:27:28 INFO  es[][o.e.p.PluginsService] no plugins loaded
2023.08.17 10:27:30 INFO  es[][o.e.e.NodeEnvironment] using [1] data paths, mounts [[/ (/dev/mapper/rhel-root)]], net usable_space [12.6gb], net total_space [89.6gb], types [ext4]
2023.08.17 10:27:30 INFO  es[][o.e.e.NodeEnvironment] heap size [512mb], compressed ordinary object pointers [true]
2023.08.17 10:27:30 INFO  es[][o.e.n.Node] node name [sonarqube], node ID [v7OIJOHwTH-83R1BDL7uKA], cluster name [sonarqube], roles [ingest, data_frozen, ml, data_hot, transform, data_content, data_warm, master, remote_cluster_client, data, data_cold]
2023.08.17 10:27:31 INFO  es[][o.e.x.p.ProfilingPlugin] Profiling is enabled
2023.08.17 10:27:31 INFO  es[][o.e.x.s.Security] Security is disabled
2023.08.17 10:27:31 INFO  es[][o.e.t.n.NettyAllocator] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=1mb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=4mb, heap_size=512mb}]
2023.08.17 10:27:31 INFO  es[][o.e.i.r.RecoverySettings] using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b]
2023.08.17 10:27:31 INFO  es[][o.e.d.DiscoveryModule] using discovery type [single-node] and seed hosts providers [settings]
2023.08.17 10:27:32 INFO  es[][o.e.n.Node] initialized
2023.08.17 10:27:32 INFO  es[][o.e.n.Node] starting ...
2023.08.17 10:27:32 INFO  es[][o.e.t.TransportService] publish_address {127.0.0.1:36769}, bound_addresses {127.0.0.1:36769}
2023.08.17 10:27:32 INFO  es[][o.e.b.BootstrapChecks] explicitly enforcing bootstrap checks
2023.08.17 10:27:32 WARN  es[][o.e.c.c.ClusterBootstrapService] this node is locked into cluster UUID [CMQkYxThTsKHr2Ty5PAfIw] but [cluster.initial_master_nodes] is set to [sonarqube]; remove this setting to avoid possible data loss caused by subsequent cluster bootstrap attempts; for further information see https://www.elastic.co/guide/en/elasticsearch/reference/8.7/important-settings.html#initial_master_nodes
2023.08.17 10:27:32 INFO  es[][o.e.c.s.MasterService] elected-as-master ([1] nodes joined)[_FINISH_ELECTION_, {sonarqube}{v7OIJOHwTH-83R1BDL7uKA}{lduBl09vTIe9D8eOUuLnoA}{sonarqube}{127.0.0.1}{127.0.0.1:36769}{cdfhilmrstw}{8.7.0} completing election], term: 3, version: 10, delta: master node changed {previous [], current [{sonarqube}{v7OIJOHwTH-83R1BDL7uKA}{lduBl09vTIe9D8eOUuLnoA}{sonarqube}{127.0.0.1}{127.0.0.1:36769}{cdfhilmrstw}{8.7.0}]}
2023.08.17 10:27:32 INFO  es[][o.e.c.s.ClusterApplierService] master node changed {previous [], current [{sonarqube}{v7OIJOHwTH-83R1BDL7uKA}{lduBl09vTIe9D8eOUuLnoA}{sonarqube}{127.0.0.1}{127.0.0.1:36769}{cdfhilmrstw}{8.7.0}]}, term: 3, version: 10, reason: Publication{term=3, version=10}
2023.08.17 10:27:32 INFO  es[][o.e.r.s.FileSettingsService] starting file settings watcher ...
2023.08.17 10:27:32 INFO  es[][o.e.r.s.FileSettingsService] file settings service up and running [tid=35]
2023.08.17 10:27:32 INFO  es[][o.e.c.c.NodeJoinExecutor] node-join: [{sonarqube}{v7OIJOHwTH-83R1BDL7uKA}{lduBl09vTIe9D8eOUuLnoA}{sonarqube}{127.0.0.1}{127.0.0.1:36769}{cdfhilmrstw}{8.7.0}] with reason [completing election]
2023.08.17 10:27:32 INFO  es[][o.e.h.AbstractHttpServerTransport] publish_address {127.0.0.1:9001}, bound_addresses {127.0.0.1:9001}
2023.08.17 10:27:32 INFO  es[][o.e.n.Node] started {sonarqube}{v7OIJOHwTH-83R1BDL7uKA}{lduBl09vTIe9D8eOUuLnoA}{sonarqube}{127.0.0.1}{127.0.0.1:36769}{cdfhilmrstw}{8.7.0}{rack_id=sonarqube, xpack.installed=true}
2023.08.17 10:27:32 INFO  es[][o.e.l.LicenseService] license [e68436d9-0e70-4883-9dc7-4c30d8979f07] mode [basic] - valid
2023.08.17 10:27:32 INFO  es[][o.e.g.GatewayService] recovered [0] indices into cluster_state
2023.08.17 10:27:32 INFO  es[][o.e.h.n.s.HealthNodeTaskExecutor] Node [{sonarqube}{v7OIJOHwTH-83R1BDL7uKA}] is selected as the current health node.
2023.08.17 10:27:37 INFO  es[][o.e.n.Node] stopping ...
2023.08.17 10:27:37 INFO  es[][o.e.r.s.FileSettingsService] shutting down watcher thread
2023.08.17 10:27:37 INFO  es[][o.e.r.s.FileSettingsService] watcher service stopped
2023.08.17 10:27:37 INFO  es[][o.e.n.Node] stopped
2023.08.17 10:27:37 INFO  es[][o.e.n.Node] closing ...
2023.08.17 10:27:37 INFO  es[][o.e.n.Node] closed
4

I don’t see any ERROR in that file, just that the service eventually stops.

What about the other log files?