LTS deployed via helm; Stuck on "Loading..."

SonarQube Server / Community Build
, ,
1

Versions:

  • helm v3.5.1
  • kubernetes v1.26.5
  • sonarqube 9.9.2 (LTS)
  • postgres 15.3

How is SonarQube deployed:

  • Helm chart --version ~8 (8.0.2+754)

What am I trying to achieve?

I am trying to deploy a SonarQube server to a Kubernetes cluster running on AWS EC2 Instances (managed by kOps) attached to a dedicated external postgres AWS RDS database instance and reachable at a custom url.

What have I tried so far to achieve this?

  1. I have deployed a customized 1 node AWS autoscaling group (via kOps) dedicated to exclusively hosting the sonarqube server (with taints and tolerations)
  2. I created a sonarqube kubernetes namespace.
  3. I have deployed an external RDS postgres database dedicated to hosting the sonarqube database (and a security group which allows 5432 port traffic from the sonarqube autoscaling group private subnets) and I believe the sonarqube pod is connecting to the External Database without any issue.
  4. I created two generic k8s secrets in the sonarqube namespace:
    - One called sonarqube-db-creds which contains values for connecting to the external RDS database.
    - One called sonarqube-temp-admin-password which contains keys password and currentPassword (both containing the same values) for a temporary admin password. Ultimately, once up and running I would like to configure Google SAML authentication but we’re not up to that yet.
  5. The kubernetes cluster has an AWS Load Balancer Controller v2.6.1 deployed which manages AWS Application Load Balancers to satisfy kubernetes ingresses. It looks like this configuration is all working properly.
  6. I configured a Route 53 A record pointing my desired url hostname to the application load balancer that was configured by the Kubernetes ingress.
  7. I have a customized helm chart values.yaml which I will attach below and I installed the helm chart with the following command:
helm repo add sonarqube https://SonarSource.github.io/helm-chart-sonarqube
helm repo update
helm upgrade --install sonarqube \
  sonarqube/sonarqube \
  -n sonarqube \
  --version "~8" \
  -f values.yaml

What is the issue? What have I observed?

  • My sonarqube kubernetes pod is running, my ingress is reconciled, but the url of my server is stuck on “Loading…” forever.
  • I have noticed in Chrome developer tools Network Tab shows a 200 code for “Type”:“Document” and then two 404 codes for types: “stylesheet” and “script”; and in the Console tab the following errors:
GET https://sonarqube.infra.mycompany.com/js/outDLYDOPRS.css net::ERR_ABORTED 404 (Not Found)
GET https://sonarqube.infra.mycompany.com/js/outUEEFMTWC.js net::ERR_ABORTED 404 (Not Found)
  • I don’t see any major errors in the pod logs (attached below)
  • When execed into the sonarqube pod and looking at /opt/sonarqube/conf/sonar.properties I have noticed that everything is completely commented out.
  • I suspect that there may be some initialization process that is not happening at startup for some reason.

Thanks in advance for any help

  • helm chart values.yaml:
# There is an init container which modifies the underlying node and therefore it is recommended to deploy the sonarqube server on its own dedicated node. A dedicated Autoscaling was created in kops specifcally with `sonarqube=true:NoSchedule` taint and the label below. The following statement will tolerate the taint and thereby reserve that node exclusively for sonarqube.
tolerations:
  - key: "sonarqube"
    operator: "Equal"
    value: "true"
    effect: "NoSchedule"
nodeSelector:
  kops.k8s.io/instancegroup: "sonarqube"


# Temporary admin password stored in k8s secret until Google SAML is setup
account:
  adminPasswordSecretName: "sonarqube-temp-admin-password"


# External postgres database hosted in RDS (managed by terraform)
postgresql:
  enabled: false
jdbcOverwrite:
  enable: true
  jdbcUrl: "jdbc:postgresql://sonarqube.XXXXXXXXXXX.us-east-2.rds.amazonaws.com:5432/sonarqube"  # Refers to RDS db endpoint
  jdbcUsername: "sonarqube"
  ## Reference to a pre-existing k8s secret containing the DB password
  jdbcSecretName: "sonarqube-db"
  ## and the secretValueKey of the password found within that secret
  jdbcSecretPasswordKey: "password"


service:
  type: NodePort


# Ingress to configure aws-load-balancer-controller
ingress:
  enabled: true
  hosts:
  - name: sonarqube.infra.mycompany.com
    path: /
  ingressClassName: alb
  annotations:
    alb.ingress.kubernetes.io/scheme: internet-facing
    alb.ingress.kubernetes.io/target-node-labels: kops.k8s.io/instancegroup=sonarqube
    alb.ingress.kubernetes.io/listen-ports: '[{"HTTP": 80}, {"HTTPS":443}]'
    alb.ingress.kubernetes.io/certificate-arn: 'arn:aws:acm:us-east-2:XXXXXXXXXXXX:certificate/423abf0d-122c-4c55-8f3a-80eb43b56068'
    alb.ingress.kubernetes.io/ssl-policy: 'ELBSecurityPolicy-TLS-1-1-2017-01'
    alb.ingress.kubernetes.io/ssl-redirect: '443'
    alb.ingress.kubernetes.io/healthcheck-port: traffic-port
    alb.ingress.kubernetes.io/tags: customer=mycompany,environment=sonarqube,environment-group=admin


# List of plugins to install.
plugins:
 install:
   - "https://github.com/checkstyle/sonar-checkstyle/releases/download/10.12.3/checkstyle-sonar-plugin-10.12.3.jar"
   - "https://github.com/dependency-check/dependency-check-sonar-plugin/releases/download/4.0.0/sonar-dependency-check-plugin-4.0.0.jar"
   - "https://repo.maven.apache.org/maven2/com/github/spotbugs/sonar-findbugs-plugin/4.2.4/sonar-findbugs-plugin-4.2.4.jar"
   - "https://marketplace.bitegarden.com/download/productArtifact?productName=bitegarden-sonarqube-security&productVersion=2.18&productFileExt=jar&customerEmail=sonarplugins@gmail.com&customerName=sonarqube&customerSurnames=marketplace&customerCompany=bitegarden"
2

sonarqube kubernetes pod logs:

2023.10.24 14:38:08 INFO app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /opt/sonarqube/temp
2023.10.24 14:38:08 INFO app[][o.s.a.es.EsSettings] Elasticsearch listening on [HTTP: 127.0.0.1:9001, TCP: 127.0.0.1:43361]
2023.10.24 14:38:08 INFO app[][o.s.a.ProcessLauncherImpl] Launch process[ELASTICSEARCH] from [/opt/sonarqube/elasticsearch]: /opt/sonarqube/elasticsearch/bin/elasticsearch
2023.10.24 14:38:08 INFO app[][o.s.a.SchedulerImpl] Waiting for Elasticsearch to be up and running
2023.10.24 14:38:15 INFO es[][o.e.n.Node] version[7.17.8], pid[20], build[default/tar/120eabe1c8a0cb2ae87cffc109a5b65d213e9df1/2022-12-02T17:33:09.727072865Z], OS[Linux/5.15.0-1045-aws/amd64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.8.1/17.0.8.1+1]
2023.10.24 14:38:15 INFO es[][o.e.n.Node] JVM home [/opt/java/openjdk]
2023.10.24 14:38:15 INFO es[][o.e.n.Node] JVM arguments [-XX:+UseG1GC, -Djava.io.tmpdir=/opt/sonarqube/temp, -XX:ErrorFile=/opt/sonarqube/logs/es_hs_err_pid%p.log, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -Djna.tmpdir=/opt/sonarqube/temp, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=COMPAT, -Dcom.redhat.fips=false, -Des.enforce.bootstrap.checks=true, -Xmx512m, -Xms512m, -XX:MaxDirectMemorySize=256m, -XX:+HeapDumpOnOutOfMemoryError, -Des.path.home=/opt/sonarqube/elasticsearch, -Des.path.conf=/opt/sonarqube/temp/conf/es, -Des.distribution.flavor=default, -Des.distribution.type=tar, -Des.bundled_jdk=false]
2023.10.24 14:38:16 INFO es[][o.e.p.PluginsService] loaded module [analysis-common]
2023.10.24 14:38:16 INFO es[][o.e.p.PluginsService] loaded module [lang-painless]
2023.10.24 14:38:16 INFO es[][o.e.p.PluginsService] loaded module [parent-join]
2023.10.24 14:38:16 INFO es[][o.e.p.PluginsService] loaded module [reindex]
2023.10.24 14:38:16 INFO es[][o.e.p.PluginsService] loaded module [transport-netty4]
2023.10.24 14:38:16 INFO es[][o.e.p.PluginsService] no plugins loaded
2023.10.24 14:38:16 INFO es[][o.e.e.NodeEnvironment] using [1] data paths, mounts [[/opt/sonarqube/data (/dev/nvme1n1)]], net usable_space [4.7gb], net total_space [4.7gb], types [ext4]
2023.10.24 14:38:16 INFO es[][o.e.e.NodeEnvironment] heap size [512mb], compressed ordinary object pointers [true]
2023.10.24 14:38:16 INFO es[][o.e.n.Node] node name [sonarqube], node ID [QyB1et30RQmdST2SYxcMpQ], cluster name [sonarqube], roles [data_frozen, master, remote_cluster_client, data, data_content, data_hot, data_warm, data_cold, ingest]
2023.10.24 14:38:28 INFO es[][o.e.t.NettyAllocator] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=256kb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=1mb, heap_size=512mb}]
2023.10.24 14:38:28 INFO es[][o.e.i.r.RecoverySettings] using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b]
2023.10.24 14:38:28 INFO es[][o.e.d.DiscoveryModule] using discovery type [zen] and seed hosts providers [settings]
2023.10.24 14:38:29 INFO es[][o.e.g.DanglingIndicesState] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
2023.10.24 14:38:29 INFO es[][o.e.n.Node] initialized
2023.10.24 14:38:29 INFO es[][o.e.n.Node] starting ...
2023.10.24 14:38:30 INFO es[][o.e.t.TransportService] publish_address {127.0.0.1:43361}, bound_addresses {127.0.0.1:43361}
2023.10.24 14:38:30 INFO es[][o.e.b.BootstrapChecks] explicitly enforcing bootstrap checks
2023.10.24 14:38:30 INFO es[][o.e.c.c.Coordinator] setting initial configuration to VotingConfiguration{QyB1et30RQmdST2SYxcMpQ}
2023.10.24 14:38:30 INFO es[][o.e.c.s.MasterService] elected-as-master ([1] nodes joined)[{sonarqube}{QyB1et30RQmdST2SYxcMpQ}{481ko-CdSB6Gsqu4PZVSjg}{127.0.0.1}{127.0.0.1:43361}{cdfhimrsw} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 1, version: 1, delta: master node changed {previous [], current [{sonarqube}{QyB1et30RQmdST2SYxcMpQ}{481ko-CdSB6Gsqu4PZVSjg}{127.0.0.1}{127.0.0.1:43361}{cdfhimrsw}]}
2023.10.24 14:38:31 INFO es[][o.e.c.c.CoordinationState] cluster UUID set to [L79wEteeSrOgSo3OTqbzcw]
2023.10.24 14:38:31 INFO es[][o.e.c.s.ClusterApplierService] master node changed {previous [], current [{sonarqube}{QyB1et30RQmdST2SYxcMpQ}{481ko-CdSB6Gsqu4PZVSjg}{127.0.0.1}{127.0.0.1:43361}{cdfhimrsw}]}, term: 1, version: 1, reason: Publication{term=1, version=1}
2023.10.24 14:38:31 INFO es[][o.e.h.AbstractHttpServerTransport] publish_address {127.0.0.1:9001}, bound_addresses {127.0.0.1:9001}
2023.10.24 14:38:31 INFO es[][o.e.n.Node] started
2023.10.24 14:38:31 INFO es[][o.e.g.GatewayService] recovered [0] indices into cluster_state
2023.10.24 14:38:31 INFO app[][o.s.a.SchedulerImpl] Process[es] is up
2023.10.24 14:38:31 INFO app[][o.s.a.ProcessLauncherImpl] Launch process[WEB_SERVER] from [/opt/sonarqube]: /opt/java/openjdk/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/opt/sonarqube/temp -XX:-OmitStackTraceInFastThrow --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED --add-exports=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.management/sun.management=ALL-UNNAMED --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED -Dcom.redhat.fips=false -javaagent:/opt/sonarqube/data/jmx_prometheus_javaagent.jar=8000:/opt/sonarqube/conf/prometheus-config.yaml -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/sonar-application-9.9.2.77730.jar:/opt/sonarqube/lib/jdbc/postgresql/postgresql-42.5.1.jar org.sonar.server.app.WebServer /opt/sonarqube/temp/sq-process9875854778312082346properties
WARNING: A terminally deprecated method in java.lang.System has been called
WARNING: System::setSecurityManager has been called by org.sonar.process.PluginSecurityManager (file:/opt/sonarqube/lib/sonar-application-9.9.2.77730.jar)
WARNING: Please consider reporting this to the maintainers of org.sonar.process.PluginSecurityManager
WARNING: System::setSecurityManager will be removed in a future release
2023.10.24 14:38:33 INFO web[][o.s.p.ProcessEntryPoint] Starting Web Server
2023.10.24 14:38:36 INFO web[][o.s.s.p.LogServerVersion] SonarQube Server / 9.9.2.77730 / dd63ff5d0db91f039afd5d40319122666c9961ef
2023.10.24 14:38:36 INFO web[][o.sonar.db.Database] Create JDBC data source for jdbc:postgresql://sonarqube.XXXXXXXXXXX.us-east-2.rds.amazonaws.com:5432/sonarqube
2023.10.24 14:38:37 INFO web[][c.z.h.HikariDataSource] HikariPool-1 - Starting...
2023.10.24 14:38:38 INFO web[][c.z.h.p.HikariPool] HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@ffaaaf0
2023.10.24 14:38:38 INFO web[][c.z.h.HikariDataSource] HikariPool-1 - Start completed.
2023.10.24 14:38:42 INFO web[][o.s.s.p.ServerFileSystemImpl] SonarQube home: /opt/sonarqube
2023.10.24 14:38:42 INFO web[][o.s.s.u.SystemPasscodeImpl] System authentication by passcode is enabled
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy C# Code Quality and Security / 8.51.0.59060 / e14c642f118958f22fd08841dc42f9aae480366a
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy Checkstyle / 10.12.3 /
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy Configuration detection fot Code Quality and Security / 1.2.0.267 / 4f37ba9ffb37a96d5883e52ad392ed32c5c6eaab
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy Dependency-Check / 4.0.0 / 8dca808199ab412bb91e315768366b67b31b5a81
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy Findbugs / 4.2.4 /
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy Flex Code Quality and Security / 2.8.0.3166 / 01f66bdddc678966c81a9064ed139156a6a89c97
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy Go Code Quality and Security / 1.11.0.3905 / e1f28bc000e04ca01881e84218d01d464a17a36f
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy HTML Code Quality and Security / 3.7.1.3306 / d720acc6860c6d8b69ec4d17570a398a1e216da1
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy IaC Code Quality and Security / 1.11.0.2847 / 6892bd3a7320b3c110717acfdb18c4c7451069fd
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy JaCoCo / 1.3.0.1538 / 74a7798c7cea687c72ed9df40c93eb7ea2a58c49
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy Java Code Quality and Security / 7.16.0.30901 / 4b1436558dfd5fc00c8d9aae8bb0364ba122c73e
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy JavaScript/TypeScript/CSS Code Quality and Security / 9.13.0.20537 / 68ff7657415044b86033814795ed95fc1f1558f1
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy Kotlin Code Quality and Security / 2.12.0.1956 / a6df1ae252bd62d63f8673c28f87ad14258a7904
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy PHP Code Quality and Security / 3.27.1.9352 / 3ddc5a03e1a7e3729d41e7c1a30a37d5715958c7
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy Python Code Quality and Security / 3.24.1.11916 / cc8f4fa745eb33d31c3869bdfdfd45514e67c1fe
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy Ruby Code Quality and Security / 1.11.0.3905 / e1f28bc000e04ca01881e84218d01d464a17a36f
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy Scala Code Quality and Security / 1.11.0.3905 / e1f28bc000e04ca01881e84218d01d464a17a36f
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy Text Code Quality and Security / 2.0.2.1090 / 7eb026363b98f5f98b43c603772b5177869c2c6a
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy VB.NET Code Quality and Security / 8.51.0.59060 / e14c642f118958f22fd08841dc42f9aae480366a
2023.10.24 14:38:43 INFO web[][o.s.s.p.ServerPluginManager] Deploy XML Code Quality and Security / 2.7.0.3820 / 656bccc1910d50c8984536bd2dfd917066b858e6
2023.10.24 14:38:45 INFO web[][o.s.s.p.d.m.c.PostgresCharsetHandler] Verify that database charset supports UTF8
2023.10.24 14:38:46 INFO web[][o.s.s.e.EsClientProvider] Connected to local Elasticsearch: [http://localhost:9001]
2023.10.24 14:38:47 WARN web[][o.s.a.s.w.WebService$Action] Description is not set on action api/monitoring/metrics
2023.10.24 14:38:47 WARN web[][o.s.a.s.w.WebService$Action] Since is not set on action api/monitoring/metrics
2023.10.24 14:38:47 WARN web[][o.s.a.s.w.WebService$Action] The response example is not set on action api/monitoring/metrics
2023.10.24 14:38:47 WARN web[][o.s.a.s.w.WebService$Action] The response example is not set on action api/system/liveness
2023.10.24 14:38:47 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.platform.web.WebServiceFilter@629b780f [pattern=UrlPattern{inclusions=[/api/system/migrate_db.*, ...], exclusions=[/api/components/update_key, ...]}]
2023.10.24 14:38:47 INFO web[][o.s.s.p.DetectPluginChange] Detect plugin changes
2023.10.24 14:38:47 INFO web[][o.s.s.p.DetectPluginChange] No plugin change detected
2023.10.24 14:38:47 INFO web[][o.s.s.a.EmbeddedTomcat] HTTP connector enabled on port 9000
2023.10.24 14:38:51 INFO web[][o.s.s.e.IndexCreator] Create index [metadatas]
2023.10.24 14:38:52 INFO es[][o.e.c.m.MetadataCreateIndexService] [metadatas] creating index, cause [api], templates [], shards [1]/[0]
2023.10.24 14:38:53 INFO es[][o.e.c.r.a.AllocationService] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[metadatas][0]]]).
2023.10.24 14:38:53 INFO web[][o.s.s.e.IndexCreator] Create type metadatas/metadata
2023.10.24 14:38:53 INFO es[][o.e.c.m.MetadataMappingService] [metadatas/tL5fFx13Rpqcm5Gn-uKLYw] create_mapping [metadata]
2023.10.24 14:38:55 INFO web[][o.s.s.e.IndexCreator] Create index [components]
2023.10.24 14:38:55 INFO es[][o.e.c.m.MetadataCreateIndexService] [components] creating index, cause [api], templates [], shards [5]/[0]
2023.10.24 14:38:56 INFO es[][o.e.c.r.a.AllocationService] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[components][4]]]).
2023.10.24 14:38:56 INFO web[][o.s.s.e.IndexCreator] Create type components/auth
2023.10.24 14:38:56 INFO es[][o.e.c.m.MetadataMappingService] [components/CdB4t60NS_uLA1yk_U9jBw] create_mapping [auth]
2023.10.24 14:38:56 INFO web[][o.s.s.e.IndexCreator] Create index [projectmeasures]
2023.10.24 14:38:56 INFO es[][o.e.c.m.MetadataCreateIndexService] [projectmeasures] creating index, cause [api], templates [], shards [5]/[0]
2023.10.24 14:38:57 INFO es[][o.e.c.r.a.AllocationService] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[projectmeasures][4]]]).
2023.10.24 14:38:57 INFO web[][o.s.s.e.IndexCreator] Create type projectmeasures/auth
2023.10.24 14:38:57 INFO es[][o.e.c.m.MetadataMappingService] [projectmeasures/NZ_bWujiSAiatnT5ISs_pQ] create_mapping [auth]
2023.10.24 14:38:57 INFO web[][o.s.s.e.IndexCreator] Create index [rules]
2023.10.24 14:38:57 INFO es[][o.e.c.m.MetadataCreateIndexService] [rules] creating index, cause [api], templates [], shards [2]/[0]
2023.10.24 14:38:58 INFO es[][o.e.c.r.a.AllocationService] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[rules][0]]]).
2023.10.24 14:38:58 INFO web[][o.s.s.e.IndexCreator] Create type rules/rule
2023.10.24 14:38:58 INFO es[][o.e.c.m.MetadataMappingService] [rules/IPS8npUMQDqRXt0kjQug2g] create_mapping [rule]
2023.10.24 14:38:58 INFO web[][o.s.s.e.IndexCreator] Create index [issues]
2023.10.24 14:38:58 INFO es[][o.e.c.m.MetadataCreateIndexService] [issues] creating index, cause [api], templates [], shards [5]/[0]
2023.10.24 14:38:59 INFO es[][o.e.c.r.a.AllocationService] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[issues][4]]]).
2023.10.24 14:38:59 INFO web[][o.s.s.e.IndexCreator] Create type issues/auth
2023.10.24 14:38:59 INFO es[][o.e.c.m.MetadataMappingService] [issues/GPf9vk0SQ6WAR8RdFKhkgQ] create_mapping [auth]
2023.10.24 14:38:59 INFO web[][o.s.s.e.IndexCreator] Create index [users]
2023.10.24 14:38:59 INFO es[][o.e.c.m.MetadataCreateIndexService] [users] creating index, cause [api], templates [], shards [1]/[0]
2023.10.24 14:39:00 INFO es[][o.e.c.r.a.AllocationService] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[users][0]]]).
2023.10.24 14:39:00 INFO web[][o.s.s.e.IndexCreator] Create type users/user
2023.10.24 14:39:00 INFO es[][o.e.c.m.MetadataMappingService] [users/njXqUUfXRFu6rlSA6yBjkg] create_mapping [user]
2023.10.24 14:39:00 INFO web[][o.s.s.e.IndexCreator] Create index [views]
2023.10.24 14:39:00 INFO es[][o.e.c.m.MetadataCreateIndexService] [views] creating index, cause [api], templates [], shards [5]/[0]
2023.10.24 14:39:00 INFO es[][o.e.c.r.a.AllocationService] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[views][4]]]).
2023.10.24 14:39:00 INFO web[][o.s.s.e.IndexCreator] Create type views/view
2023.10.24 14:39:01 INFO es[][o.e.c.m.MetadataMappingService] [views/Xk6j9zUtTP6hNXXkW--thw] create_mapping [view]
2023.10.24 14:39:01 INFO web[][o.s.s.s.LogServerId] Server ID: CEC30E75-AYtM-XcLRo0xgnr31MQy
2023.10.24 14:39:01 WARN web[][o.s.s.a.LogOAuthWarning] For security reasons, OAuth authentication should use HTTPS. You should set the property 'Administration > Configuration > Server base URL' to a HTTPS URL.
2023.10.24 14:39:01 INFO web[][o.s.s.p.UpdateCenterClient] Update center: https://update.sonarsource.org/update-center.properties
2023.10.24 14:39:05 WARN web[][o.s.a.s.w.WebService$Action] The response example is not set on action saml/validation_init
2023.10.24 14:39:05 WARN web[][o.s.a.s.w.WebService$Action] The response example is not set on action api/system/liveness
2023.10.24 14:39:05 WARN web[][o.s.a.s.w.WebService$Action] The response example is not set on action api/plugins/download
2023.10.24 14:39:05 WARN web[][o.s.a.s.w.WebService$Action] The response example is not set on action api/analysis_cache/get
2023.10.24 14:39:05 WARN web[][o.s.a.s.w.WebService$Action] The response example is not set on action api/alm_integrations/check_pat
2023.10.24 14:39:05 WARN web[][o.s.a.s.w.WebService$Action] The response example is not set on action api/push/sonarlint_events
2023.10.24 14:39:05 INFO web[][o.s.s.a.p.ExpiredSessionsCleaner] Purge of expired session tokens has removed 0 elements
2023.10.24 14:39:05 INFO web[][o.s.s.a.p.ExpiredSessionsCleaner] Purge of expired SAML message ids has removed 0 elements
2023.10.24 14:39:05 INFO web[][o.s.s.n.NotificationDaemon] Notification service started (delay 60 sec.)
2023.10.24 14:39:05 INFO web[][o.s.s.t.TelemetryDaemon] Sharing of SonarQube statistics is enabled.
2023.10.24 14:39:06 INFO web[][o.s.s.s.GeneratePluginIndex] Generate scanner plugin index
2023.10.24 14:39:06 INFO web[][o.s.s.s.RegisterPermissionTemplates] Register permission templates
2023.10.24 14:39:06 INFO web[][o.s.s.s.RenameDeprecatedPropertyKeys] Rename deprecated property keys
2023.10.24 14:39:06 INFO web[][o.s.s.s.RegisterPlugins] Register plugins
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.platform.web.SonarLintConnectionFilter@555edfd6 [pattern=UrlPattern{inclusions=[/api/*], exclusions=[]}]
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.platform.web.WebServiceFilter@42b74680 [pattern=UrlPattern{inclusions=[/api/issues/delete_comment.*, ...], exclusions=[/api/authentication/login.*, ...]}]
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.platform.web.WebServiceReroutingFilter@7909c516 [pattern=UrlPattern{inclusions=[/api/components/bulk_update_key, ...], exclusions=[]}]
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.authentication.DefaultAdminCredentialsVerifierFilter@6fa823da [pattern=UrlPattern{inclusions=[/*], exclusions=[*.css, ...]}]
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.authentication.InitFilter@4c2be196 [pattern=UrlPattern{inclusions=[/sessions/init/*], exclusions=[]}]
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.authentication.SamlValidationRedirectionFilter@34502dd5 [pattern=UrlPattern{inclusions=[/oauth2/callback/saml], exclusions=[]}]
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.authentication.OAuth2CallbackFilter@3466f3c [pattern=UrlPattern{inclusions=[/oauth2/callback/*], exclusions=[]}]
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.authentication.ResetPasswordFilter@2dde3a7d [pattern=UrlPattern{inclusions=[/*], exclusions=[*.css, ...]}]
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.authentication.ws.LoginAction@e706d84 [pattern=UrlPattern{inclusions=[/api/authentication/login], exclusions=[]}]
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.authentication.ws.LogoutAction@fcf9a81 [pattern=UrlPattern{inclusions=[/api/authentication/logout], exclusions=[]}]
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.authentication.ws.ValidateAction@6f2e35d3 [pattern=UrlPattern{inclusions=[/api/authentication/validate], exclusions=[]}]
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.saml.ws.ValidationInitAction@46197f92 [pattern=UrlPattern{inclusions=[/saml/validation_init], exclusions=[]}]
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.saml.ws.ValidationAction@52c53e6e [pattern=UrlPattern{inclusions=[/saml/validation], exclusions=[]}]
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.user.ws.ChangePasswordAction@3eea5901 [pattern=UrlPattern{inclusions=[/api/users/change_password], exclusions=[]}]
2023.10.24 14:39:06 INFO web[][o.s.s.p.w.MasterServletFilter] Initializing servlet filter org.sonar.server.plugins.PluginsRiskConsentFilter@be1f58c [pattern=UrlPattern{inclusions=[/*], exclusions=[*.css, ...]}]
2023.10.24 14:39:06 INFO web[][o.s.s.e.IndexerStartupTask] Indexing of type [rules/rule/activeRule]...
2023.10.24 14:39:12 INFO web[][o.s.s.e.IndexerStartupTask] Indexing of type [rules/rule/activeRule] done | time=6472ms
2023.10.24 14:39:12 INFO web[][o.s.s.e.IndexerStartupTask] Indexing of type [rules/rule]...
2023.10.24 14:39:29 ERROR web[][o.s.s.w.WebServiceEngine] Fail to process request http://100.96.60.75:9000/api/system/liveness
1 Like
3

sonarqube kubernetes pod logs (…continued):

java.lang.IllegalStateException: Liveness check failed
at org.sonar.server.platform.ws.LivenessActionSupport.checkliveness(LivenessActionSupport.java:55)
at org.sonar.server.platform.ws.LivenessAction.handle(LivenessAction.java:51)
at org.sonar.server.ws.WebServiceEngine.execute(WebServiceEngine.java:111)
at org.sonar.server.platform.web.WebServiceFilter.doFilter(WebServiceFilter.java:84)
at org.sonar.server.platform.web.MasterServletFilter$GodFilterChain.doFilter(MasterServletFilter.java:153)
at org.sonar.server.platform.web.SonarLintConnectionFilter.doFilter(SonarLintConnectionFilter.java:66)
at org.sonar.server.platform.web.MasterServletFilter$GodFilterChain.doFilter(MasterServletFilter.java:153)
at org.sonar.server.platform.web.MasterServletFilter.doFilter(MasterServletFilter.java:116)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.sonar.server.platform.web.UserSessionFilter.doFilter(UserSessionFilter.java:81)
at org.sonar.server.platform.web.UserSessionFilter.doFilter(UserSessionFilter.java:68)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.sonar.server.platform.web.CspFilter.doFilter(CspFilter.java:63)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.sonar.server.platform.web.CacheControlFilter.doFilter(CacheControlFilter.java:76)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.sonar.server.platform.web.SecurityServletFilter.doHttpFilter(SecurityServletFilter.java:60)
at org.sonar.server.platform.web.SecurityServletFilter.doFilter(SecurityServletFilter.java:47)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.sonar.server.platform.web.RedirectFilter.doFilter(RedirectFilter.java:57)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.sonar.server.platform.web.RequestIdFilter.doFilter(RequestIdFilter.java:61)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.sonar.server.platform.web.RootFilter.doFilter(RootFilter.java:64)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.apache.catalina.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:115)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:481)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93)
at ch.qos.logback.access.tomcat.LogbackValve.invoke(LogbackValve.java:256)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93)
at org.sonar.server.app.SecureErrorReportValve.invoke(SecureErrorReportValve.java:37)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)
at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)
at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.base/java.lang.Thread.run(Unknown Source)
2023.10.24 14:39:46 INFO web[][o.s.s.e.IndexerStartupTask] Indexing of type [rules/rule] done | time=33726ms
2023.10.24 14:39:46 INFO web[][o.s.s.e.IndexerStartupTask] Indexing of type [users/user]...
2023.10.24 14:39:46 INFO es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [30s] to [-1]
2023.10.24 14:39:46 INFO es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [30s] to [-1]
2023.10.24 14:39:46 INFO es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [-1] to [30s]
2023.10.24 14:39:47 INFO es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [-1] to [30s]
2023.10.24 14:39:47 INFO web[][o.s.s.e.IndexerStartupTask] Indexing of type [users/user] done | time=436ms
2023.10.24 14:39:47 INFO web[][o.s.s.e.IndexerStartupTask] Indexing of type [projectmeasures/auth/projectmeasure]...
2023.10.24 14:39:47 INFO web[][o.s.s.e.IndexerStartupTask] Indexing of type [projectmeasures/auth/projectmeasure] done | time=198ms
2023.10.24 14:39:47 INFO web[][o.s.s.e.IndexerStartupTask] Indexing of type [components/auth/component]...
2023.10.24 14:39:47 INFO web[][o.s.s.e.IndexerStartupTask] Indexing of type [components/auth/component] done | time=131ms
2023.10.24 14:39:47 INFO web[][o.s.s.e.IndexerStartupTask] Indexing of type [views/view]...
2023.10.24 14:39:47 INFO es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [30s] to [-1]
2023.10.24 14:39:47 INFO es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [30s] to [-1]
2023.10.24 14:39:47 INFO es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [-1] to [30s]
2023.10.24 14:39:47 INFO es[][o.e.c.s.IndexScopedSettings] updating [index.refresh_interval] from [-1] to [30s]
2023.10.24 14:39:47 INFO web[][o.s.s.e.IndexerStartupTask] Indexing of type [views/view] done | time=398ms
2023.10.24 14:39:47 INFO web[][o.s.s.e.IndexerStartupTask] Trigger asynchronous indexing of type [issues/auth/issue]...
2023.10.24 14:39:47 INFO web[][o.s.s.i.i.AsyncIssueIndexingImpl] 0 pending indexation task found to be deleted...
2023.10.24 14:39:47 INFO web[][o.s.s.i.i.AsyncIssueIndexingImpl] 0 completed indexation task found to be deleted...
2023.10.24 14:39:47 INFO web[][o.s.s.i.i.AsyncIssueIndexingImpl] Indexation task deletion complete.
2023.10.24 14:39:47 INFO web[][o.s.s.i.i.AsyncIssueIndexingImpl] Deleting tasks characteristics...
2023.10.24 14:39:48 INFO web[][o.s.s.i.i.AsyncIssueIndexingImpl] Tasks characteristics deletion complete.
2023.10.24 14:39:48 INFO web[][o.s.s.i.i.AsyncIssueIndexingImpl] 0 branch found in need of issue sync.
2023.10.24 14:39:48 INFO web[][o.s.s.e.IndexerStartupTask] Trigger asynchronous indexing of type [issues/auth/issue] done | time=192ms
2023.10.24 14:39:48 INFO web[][o.s.s.e.IndexerStartupTask] Indexing of types [components/auth],[projectmeasures/auth],[issues/auth]...
2023.10.24 14:39:48 INFO web[][o.s.s.e.IndexerStartupTask] Indexing of types [components/auth],[projectmeasures/auth],[issues/auth] done | time=301ms
2023.10.24 14:39:48 INFO web[][o.s.s.q.ProjectsInWarningDaemon] Counting number of projects in warning is not started as there are no projects in this situation.
2023.10.24 14:39:48 INFO web[][o.s.s.p.p.PlatformLevelStartup] Running Community Edition
2023.10.24 14:39:48 INFO app[][o.s.a.SchedulerImpl] Process[web] is up
2023.10.24 14:39:48 INFO app[][o.s.a.ProcessLauncherImpl] Launch process[COMPUTE_ENGINE] from [/opt/sonarqube]: /opt/java/openjdk/bin/java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/opt/sonarqube/temp -XX:-OmitStackTraceInFastThrow --add-opens=java.base/java.util=ALL-UNNAMED --add-exports=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.management/sun.management=ALL-UNNAMED --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED -Dcom.redhat.fips=false -javaagent:/opt/sonarqube/data/jmx_prometheus_javaagent.jar=8001:/opt/sonarqube/conf/prometheus-ce-config.yaml -Dhttp.nonProxyHosts=localhost|127.*|[::1] -cp ./lib/sonar-application-9.9.2.77730.jar:/opt/sonarqube/lib/jdbc/postgresql/postgresql-42.5.1.jar org.sonar.ce.app.CeServer /opt/sonarqube/temp/sq-process15444347752878534463properties
2023.10.24 14:39:50 WARN app[][startup] ####################################################################################################################
2023.10.24 14:39:50 WARN app[][startup] Default Administrator credentials are still being used. Make sure to change the password or deactivate the account.
2023.10.24 14:39:50 WARN app[][startup] ####################################################################################################################
2023.10.24 14:39:50 INFO web[][o.s.s.p.Platform] Web Server is operational
WARNING: A terminally deprecated method in java.lang.System has been called
WARNING: System::setSecurityManager has been called by org.sonar.process.PluginSecurityManager (file:/opt/sonarqube/lib/sonar-application-9.9.2.77730.jar)
WARNING: Please consider reporting this to the maintainers of org.sonar.process.PluginSecurityManager
WARNING: System::setSecurityManager will be removed in a future release
2023.10.24 14:39:51 INFO ce[][o.s.p.ProcessEntryPoint] Starting Compute Engine
2023.10.24 14:39:51 INFO ce[][o.s.ce.app.CeServer] Compute Engine starting up...
2023.10.24 14:39:52 INFO ce[][o.sonar.db.Database] Create JDBC data source for jdbc:postgresql://sonarqube.XXXXXXXXXXX.us-east-2.rds.amazonaws.com:5432/sonarqube
2023.10.24 14:39:52 INFO ce[][c.z.h.HikariDataSource] HikariPool-1 - Starting...
2023.10.24 14:39:53 INFO ce[][c.z.h.p.HikariPool] HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@3d68077d
2023.10.24 14:39:53 INFO ce[][c.z.h.HikariDataSource] HikariPool-1 - Start completed.
2023.10.24 14:39:58 INFO ce[][o.s.s.p.ServerFileSystemImpl] SonarQube home: /opt/sonarqube
2023.10.24 14:39:59 INFO ce[][o.s.c.c.CePluginRepository] Load plugins
2023.10.24 14:39:59 ERROR web[AYtiINFJfk69flNZAAAA][o.s.s.w.WebServiceEngine] Fail to process request http://100.96.60.75:9000/api/system/liveness
java.lang.IllegalStateException: Liveness check failed
at org.sonar.server.platform.ws.LivenessActionSupport.checkliveness(LivenessActionSupport.java:55)
at org.sonar.server.platform.ws.LivenessAction.handle(LivenessAction.java:51)
at org.sonar.server.ws.WebServiceEngine.execute(WebServiceEngine.java:111)
at org.sonar.server.platform.web.WebServiceFilter.doFilter(WebServiceFilter.java:84)
at org.sonar.server.platform.web.MasterServletFilter$GodFilterChain.doFilter(MasterServletFilter.java:153)
at org.sonar.server.platform.web.SonarLintConnectionFilter.doFilter(SonarLintConnectionFilter.java:66)
at org.sonar.server.platform.web.MasterServletFilter$GodFilterChain.doFilter(MasterServletFilter.java:153)
at org.sonar.server.platform.web.MasterServletFilter.doFilter(MasterServletFilter.java:116)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.sonar.server.platform.web.UserSessionFilter.doFilter(UserSessionFilter.java:81)
at org.sonar.server.platform.web.UserSessionFilter.doFilter(UserSessionFilter.java:68)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.sonar.server.platform.web.CspFilter.doFilter(CspFilter.java:63)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.sonar.server.platform.web.CacheControlFilter.doFilter(CacheControlFilter.java:76)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.sonar.server.platform.web.SecurityServletFilter.doHttpFilter(SecurityServletFilter.java:60)
at org.sonar.server.platform.web.SecurityServletFilter.doFilter(SecurityServletFilter.java:47)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.sonar.server.platform.web.RedirectFilter.doFilter(RedirectFilter.java:57)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.sonar.server.platform.web.RequestIdFilter.doFilter(RequestIdFilter.java:66)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.sonar.server.platform.web.RootFilter.doFilter(RootFilter.java:64)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.apache.catalina.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:115)
at jdk.internal.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.catalina.security.SecurityUtil.lambda$execute$0(SecurityUtil.java:280)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/javax.security.auth.Subject.doAsPrivileged(Unknown Source)
at org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:311)
at org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:253)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:176)
at org.apache.catalina.core.ApplicationFilterChain.lambda$doFilter$0(ApplicationFilterChain.java:137)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:136)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:481)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93)
at ch.qos.logback.access.tomcat.LogbackValve.invoke(LogbackValve.java:256)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93)
at org.sonar.server.app.SecureErrorReportValve.invoke(SecureErrorReportValve.java:37)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)
at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)
at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.base/java.lang.Thread.run(Unknown Source)
2023.10.24 14:40:03 INFO ce[][o.s.c.c.ComputeEngineContainerImpl] Running Community edition
2023.10.24 14:40:03 INFO ce[][o.s.ce.app.CeServer] Compute Engine is started
2023.10.24 14:40:03 INFO app[][o.s.a.SchedulerImpl] Process[ce] is up
2023.10.24 14:40:03 INFO app[][o.s.a.SchedulerImpl] SonarQube is operational
7

hello @David_Beauchamp, first I would like to give you a heartfelt thank you for providing such a detailed explanation regarding your setup and issue, it helps us tremendously.

First let me answer some of your questions.

This is expected, by default this file serves as an example, and everything else is configured as env_var.

From the logs everything seems to be booting up properly, the app is operational on the logs. Could you just confirm that readiness and liveness succeed after this SonarQube is operational line ?

Based on that my assumption matches your test about the frontend file not being properly loaded with the 404 so we should look over there.

To debug this, could you try:

  • commenting out the plugin session to remove unexpected behavior.
  • running a kubectl port-forward command to bypass the ingress-controller/lb
    • kubectl port-forward -n sonarqube statefulsets/sonarqube-sonarqube 9000:9000
    • accesing localhost:9000 looking if the setup works properly

Waiting forward for your answer to troubleshooting it furthermore.

Cheers,
Jeremy.

1 Like
8

Hi @Jeremy_Cotineau

Thanks so much for your response. I reinstalled the helm chart with plugins removed and (and with persistence disabled for now) and I can confirm that reached sonarqube via kubectl port-forwarding and was able to log in. I guess I was way too confident in my ingress set up. Still at the https://sonarqube.mycompany.com/ url, I see the 404 errors about .css stylesheet and javascript .js files failing to load but index.html loads. And yes, the liveness and readiness probes succeed and the pod remains running for hours after startup.

9

For anyone in the future… I managed to fix my problem by changing my ingress host from / to /*. Thanks

4 Likes
11

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.