Hello, Webserver is not running after server restart. While checking logs I found few errors in web.log
Web server startup failed: Database was upgraded to a more recent version of SonarQube. A backup must probably be restored or the DB settings are incorrect.
And, Failed to clear soft references from ObjectStreamClass$Caches for web application [sonar#deploy]
While checking Sonar.log it shows:
Fail to launch process [es] and,
Could not delete Elasticsearch temporary conf directory
Sonar.Log
I’m using aws rds as db. and sonarqube-developer-9.9.6.92038
Request advise on how to proceed to resolve this. I haven’t upgrade sonarqube or db so far, it just start throwing error after restart.
Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
Copyright 1999-2006 Tanuki Software, Inc. All Rights Reserved.
2025.03.03 11:09:43 INFO app[][o.s.a.AppFileSystem] Cleaning or creating temp directory /var/sonarqube/temp
2025.03.03 11:09:43 INFO app[][o.s.a.es.EsSettings] Elasticsearch listening on [HTTP: 127.0.0.1:9001, TCP: 127.0.0.1:42559]
2025.03.03 11:09:43 ERROR app[][o.s.a.p.ManagedProcessHandler] Fail to launch process [es]
java.lang.IllegalStateException: Could not delete Elasticsearch temporary conf directory
at org.sonar.application.ProcessLauncherImpl.pruneElasticsearchConfDirectory(ProcessLauncherImpl.java:168)
at org.sonar.application.ProcessLauncherImpl.writeConfFiles(ProcessLauncherImpl.java:155)
at org.sonar.application.ProcessLauncherImpl.launch(ProcessLauncherImpl.java:92)
at org.sonar.application.SchedulerImpl.lambda$tryToStartProcess$2(SchedulerImpl.java:196)
at org.sonar.application.process.ManagedProcessHandler.start(ManagedProcessHandler.java:73)
at org.sonar.application.SchedulerImpl.tryToStartProcess(SchedulerImpl.java:194)
at org.sonar.application.SchedulerImpl.tryToStartEs(SchedulerImpl.java:146)
at org.sonar.application.SchedulerImpl.tryToStartAll(SchedulerImpl.java:138)
at org.sonar.application.SchedulerImpl.schedule(SchedulerImpl.java:112)
at org.sonar.application.App.start(App.java:59)
at org.sonar.application.App.main(App.java:81)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.tanukisoftware.wrapper.WrapperSimpleApp.run(WrapperSimpleApp.java:240)
at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.nio.file.AccessDeniedException: /var/sonarqube/temp/conf/es
at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90)
at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106)
at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)
at java.base/sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:248)
at java.base/sun.nio.fs.AbstractFileSystemProvider.deleteIfExists(AbstractFileSystemProvider.java:110)
at java.base/java.nio.file.Files.deleteIfExists(Files.java:1191)
at org.sonar.application.ProcessLauncherImpl.pruneElasticsearchConfDirectory(ProcessLauncherImpl.java:166)
... 16 common frames omitted
2025.03.03 11:09:43 INFO app[][o.s.a.SchedulerImpl] Process[es] is stopped
2025.03.03 11:09:43 INFO app[][o.s.a.SchedulerImpl] SonarQube is stopped
web.log
2025.02.28 11:00:02 INFO web[][o.s.s.a.EmbeddedTomcat] HTTP connector enabled on port 9000
2025.02.28 11:00:02 INFO web[][o.s.p.ProcessEntryPoint] Hard stopping process
2025.02.28 11:00:02 WARN web[][o.a.c.l.WebappClassLoaderBase] Failed to clear soft references from ObjectStreamClass$Caches for web application [sonar#deploy]
java.lang.ClassCastException: class java.io.ObjectStreamClass$Caches$1 cannot be cast to class java.util.Map (java.io.ObjectStreamClass$Caches$1 and java.util.Map are in module java.base of loader 'bootstrap')
at org.apache.catalina.loader.WebappClassLoaderBase.clearCache(WebappClassLoaderBase.java:2331)
at org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesObjectStreamClassCaches(WebappClassLoaderBase.java:2306)
at org.apache.catalina.loader.WebappClassLoaderBase.clearReferences(WebappClassLoaderBase.java:1675)
at org.apache.catalina.loader.WebappClassLoaderBase.stop(WebappClassLoaderBase.java:1605)
at org.apache.catalina.loader.WebappLoader.stopInternal(WebappLoader.java:455)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5505)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1443)
at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1432)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)
2025.02.28 11:00:13 INFO web[][o.s.p.ProcessEntryPoint] Starting web
2025.02.28 11:00:13 INFO web[][o.a.t.u.n.NioSelectorPool] Using a shared selector for servlet write/read
2025.02.28 11:00:14 INFO web[][o.s.c.e.CoreExtensionsLoader] Loaded core extensions: developer-edition, developer-scanner, developer-server, license
2025.02.28 11:00:14 INFO web[][o.s.s.e.EsClientProvider] Connected to local Elasticsearch: [http://localhost:9001]
2025.02.28 11:00:14 INFO web[][o.s.s.p.LogServerVersion] SonarQube Server / 9.2.4.50792 / 78f7113cee15b2bd37a958455271e68f1244cb7b
2025.02.28 11:00:14 INFO web[][o.sonar.db.Database] Create JDBC data source for jdbc:postgresql://sonarqube-db-1.qwertyu.us-east-1.rds.amazonaws.com:5432/asddf
2025.02.28 11:00:15 INFO web[][o.s.s.p.ServerFileSystemImpl] SonarQube home: /opt/sonarqube
2025.02.28 11:00:15 INFO web[][o.s.s.u.SystemPasscodeImpl] System authentication by passcode is disabled
2025.02.28 11:00:15 ERROR web[][o.s.s.p.PlatformImpl] Web server startup failed: Database was upgraded to a more recent version of SonarQube. A backup must probably be restored or the DB settings are incorrect.
2025.02.28 11:00:15 WARN web[][o.a.c.l.WebappClassLoaderBase] Failed to clear soft references from ObjectStreamClass$Caches for web application [sonar]
java.lang.ClassCastException: class java.io.ObjectStreamClass$Caches$1 cannot be cast to class java.util.Map (java.io.ObjectStreamClass$Caches$1 and java.util.Map are in module java.base of loader 'bootstrap')
I haven’t downgraded sonrqube, it’s just i restart the server and start getting this issue.
Thanks Again!! Apreciate your help.
Please find web.log below:
2025.02.28 10:51:08 INFO web[][o.s.p.ProcessEntryPoint] Starting web
2025.02.28 10:51:08 INFO web[][o.a.t.u.n.NioSelectorPool] Using a shared selector for servlet write/read
2025.02.28 10:51:09 INFO web[][o.s.c.e.CoreExtensionsLoader] Loaded core extensions: developer-edition, developer-scanner, developer-server, license
2025.02.28 10:51:09 INFO web[][o.s.s.e.EsClientProvider] Connected to local Elasticsearch: [http://localhost:9001]
2025.02.28 10:51:09 INFO web[][o.s.s.p.LogServerVersion] SonarQube Server / 9.2.4.50792 / 78f7113cee15b2bd37a958455271e68f1244cb7b
2025.02.28 10:51:09 INFO web[][o.sonar.db.Database] Create JDBC data source for jdbc:postgresql://sonarqube-database-1.adcfffdfdss.sa-east-1.rds.amazonaws.com:5432/sonarqube
2025.02.28 10:51:10 INFO web[][o.s.s.p.ServerFileSystemImpl] SonarQube home: /opt/sonarqube
2025.02.28 10:51:10 INFO web[][o.s.s.u.SystemPasscodeImpl] System authentication by passcode is disabled
2025.02.28 10:51:10 ERROR web[][o.s.s.p.PlatformImpl] Web server startup failed: Database was upgraded to a more recent version of SonarQube. A backup must probably be restored or the DB settings are incorrect.
2025.02.28 10:51:10 WARN web[][o.a.c.l.WebappClassLoaderBase] Failed to clear soft references from ObjectStreamClass$Caches for web application [sonar]
java.lang.ClassCastException: class java.io.ObjectStreamClass$Caches$1 cannot be cast to class java.util.Map (java.io.ObjectStreamClass$Caches$1 and java.util.Map are in module java.base of loader 'bootstrap')
at org.apache.catalina.loader.WebappClassLoaderBase.clearCache(WebappClassLoaderBase.java:2331)
at org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesObjectStreamClassCaches(WebappClassLoaderBase.java:2306)
at org.apache.catalina.loader.WebappClassLoaderBase.clearReferences(WebappClassLoaderBase.java:1675)
at org.apache.catalina.loader.WebappClassLoaderBase.stop(WebappClassLoaderBase.java:1605)
at org.apache.catalina.loader.WebappLoader.stopInternal(WebappLoader.java:455)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5505)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:187)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1427)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1417)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)
2025.02.28 10:51:10 INFO web[][o.s.s.a.EmbeddedTomcat] HTTP connector enabled on port 9000
2025.02.28 10:51:10 INFO web[][o.s.p.ProcessEntryPoint] Hard stopping process
2025.02.28 10:51:10 WARN web[][o.a.c.l.WebappClassLoaderBase] Failed to clear soft references from ObjectStreamClass$Caches for web application [sonar#deploy]
java.lang.ClassCastException: class java.io.ObjectStreamClass$Caches$1 cannot be cast to class java.util.Map (java.io.ObjectStreamClass$Caches$1 and java.util.Map are in module java.base of loader 'bootstrap')
at org.apache.catalina.loader.WebappClassLoaderBase.clearCache(WebappClassLoaderBase.java:2331)
at org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesObjectStreamClassCaches(WebappClassLoaderBase.java:2306)
at org.apache.catalina.loader.WebappClassLoaderBase.clearReferences(WebappClassLoaderBase.java:1675)
at org.apache.catalina.loader.WebappClassLoaderBase.stop(WebappClassLoaderBase.java:1605)
at org.apache.catalina.loader.WebappLoader.stopInternal(WebappLoader.java:455)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5505)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1443)
at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1432)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)
2025.02.28 10:51:21 INFO web[][o.s.p.ProcessEntryPoint] Starting web
2025.02.28 10:51:21 INFO web[][o.a.t.u.n.NioSelectorPool] Using a shared selector for servlet write/read
2025.02.28 10:51:22 INFO web[][o.s.c.e.CoreExtensionsLoader] Loaded core extensions: developer-edition, developer-scanner, developer-server, license
2025.02.28 10:51:22 INFO web[][o.s.s.e.EsClientProvider] Connected to local Elasticsearch: [http://localhost:9001]
2025.02.28 10:51:22 INFO web[][o.s.s.p.LogServerVersion] SonarQube Server / 9.2.4.50792 / 78f7113cee15b2bd37a958455271e68f1244cb7b
2025.02.28 10:51:22 INFO web[][o.sonar.db.Database] Create JDBC data source for jdbc:postgresql://sonarqube-database-1.adcfffdfdss.sa-east-1.rds.amazonaws.com:5432/sonarqube
2025.02.28 10:51:23 INFO web[][o.s.s.p.ServerFileSystemImpl] SonarQube home: /opt/sonarqube
2025.02.28 10:51:23 INFO web[][o.s.s.u.SystemPasscodeImpl] System authentication by passcode is disabled
2025.02.28 10:51:23 ERROR web[][o.s.s.p.PlatformImpl] Web server startup failed: Database was upgraded to a more recent version of SonarQube. A backup must probably be restored or the DB settings are incorrect.
2025.02.28 10:51:23 WARN web[][o.a.c.l.WebappClassLoaderBase] Failed to clear soft references from ObjectStreamClass$Caches for web application [sonar]
java.lang.ClassCastException: class java.io.ObjectStreamClass$Caches$1 cannot be cast to class java.util.Map (java.io.ObjectStreamClass$Caches$1 and java.util.Map are in module java.base of loader 'bootstrap')
at org.apache.catalina.loader.WebappClassLoaderBase.clearCache(WebappClassLoaderBase.java:2331)
at org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesObjectStreamClassCaches(WebappClassLoaderBase.java:2306)
at org.apache.catalina.loader.WebappClassLoaderBase.clearReferences(WebappClassLoaderBase.java:1675)
at org.apache.catalina.loader.WebappClassLoaderBase.stop(WebappClassLoaderBase.java:1605)
at org.apache.catalina.loader.WebappLoader.stopInternal(WebappLoader.java:455)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5505)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:187)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1427)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1417)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)
2025.02.28 10:51:23 INFO web[][o.s.s.a.EmbeddedTomcat] HTTP connector enabled on port 9000
2025.02.28 10:51:23 INFO web[][o.s.p.ProcessEntryPoint] Hard stopping process
2025.02.28 10:51:23 WARN web[][o.a.c.l.WebappClassLoaderBase] Failed to clear soft references from ObjectStreamClass$Caches for web application [sonar#deploy]
java.lang.ClassCastException: class java.io.ObjectStreamClass$Caches$1 cannot be cast to class java.util.Map (java.io.ObjectStreamClass$Caches$1 and java.util.Map are in module java.base of loader 'bootstrap')
at org.apache.catalina.loader.WebappClassLoaderBase.clearCache(WebappClassLoaderBase.java:2331)
at org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesObjectStreamClassCaches(WebappClassLoaderBase.java:2306)
at org.apache.catalina.loader.WebappClassLoaderBase.clearReferences(WebappClassLoaderBase.java:1675)
at org.apache.catalina.loader.WebappClassLoaderBase.stop(WebappClassLoaderBase.java:1605)
at org.apache.catalina.loader.WebappLoader.stopInternal(WebappLoader.java:455)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5505)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1443)
at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1432)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)
2025.02.28 10:51:34 INFO web[][o.s.p.ProcessEntryPoint] Starting web
2025.02.28 10:51:34 INFO web[][o.a.t.u.n.NioSelectorPool] Using a shared selector for servlet write/read
2025.02.28 10:51:34 INFO web[][o.s.c.e.CoreExtensionsLoader] Loaded core extensions: developer-edition, developer-scanner, developer-server, license
2025.02.28 10:51:34 INFO web[][o.s.s.e.EsClientProvider] Connected to local Elasticsearch: [http://localhost:9001]
2025.02.28 10:51:35 INFO web[][o.s.s.p.LogServerVersion] SonarQube Server / 9.2.4.50792 / 78f7113cee15b2bd37a958455271e68f1244cb7b
2025.02.28 10:51:35 INFO web[][o.sonar.db.Database] Create JDBC data source for jdbc:postgresql://sonarqube-database-1.adcfffdfdss.sa-east-1.rds.amazonaws.com:5432/sonarqube
2025.02.28 10:51:36 INFO web[][o.s.s.p.ServerFileSystemImpl] SonarQube home: /opt/sonarqube
2025.02.28 10:51:36 INFO web[][o.s.s.u.SystemPasscodeImpl] System authentication by passcode is disabled
2025.02.28 10:51:36 ERROR web[][o.s.s.p.PlatformImpl] Web server startup failed: Database was upgraded to a more recent version of SonarQube. A backup must probably be restored or the DB settings are incorrect.
2025.02.28 10:51:36 WARN web[][o.a.c.l.WebappClassLoaderBase] Failed to clear soft references from ObjectStreamClass$Caches for web application [sonar]
java.lang.ClassCastException: class java.io.ObjectStreamClass$Caches$1 cannot be cast to class java.util.Map (java.io.ObjectStreamClass$Caches$1 and java.util.Map are in module java.base of loader 'bootstrap')
at org.apache.catalina.loader.WebappClassLoaderBase.clearCache(WebappClassLoaderBase.java:2331)
at org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesObjectStreamClassCaches(WebappClassLoaderBase.java:2306)
at org.apache.catalina.loader.WebappClassLoaderBase.clearReferences(WebappClassLoaderBase.java:1675)
at org.apache.catalina.loader.WebappClassLoaderBase.stop(WebappClassLoaderBase.java:1605)
at org.apache.catalina.loader.WebappLoader.stopInternal(WebappLoader.java:455)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5505)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:187)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1427)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1417)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)
2025.02.28 10:51:36 INFO web[][o.s.s.a.EmbeddedTomcat] HTTP connector enabled on port 9000
2025.02.28 10:51:36 INFO web[][o.s.p.ProcessEntryPoint] Hard stopping process
2025.02.28 10:51:36 WARN web[][o.a.c.l.WebappClassLoaderBase] Failed to clear soft references from ObjectStreamClass$Caches for web application [sonar#deploy]
java.lang.ClassCastException: class java.io.ObjectStreamClass$Caches$1 cannot be cast to class java.util.Map (java.io.ObjectStreamClass$Caches$1 and java.util.Map are in module java.base of loader 'bootstrap')
at org.apache.catalina.loader.WebappClassLoaderBase.clearCache(WebappClassLoaderBase.java:2331)
at org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesObjectStreamClassCaches(WebappClassLoaderBase.java:2306)
at org.apache.catalina.loader.WebappClassLoaderBase.clearReferences(WebappClassLoaderBase.java:1675)
at org.apache.catalina.loader.WebappClassLoaderBase.stop(WebappClassLoaderBase.java:1605)
at org.apache.catalina.loader.WebappLoader.stopInternal(WebappLoader.java:455)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5505)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1443)
at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1432)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)
At some point, you ran the database upgrade for a newer version of SonarQube, and then you tried to use an older version with that database. That simply won’t work. You need to either restore your DB backup (as it says in the error), or just adopt the latest SonarQube version.