Server won't start after upgrade from 9.3.0 to 9.5.0

Standard upgrade from 9.3.0 to 9.5.0 running on Windows 2019 Server, SQL Server 2017, Microsoft JDBC driver.

Looking in the logs I don’t get a lot of help. I see this in the es log:

2022.06.23 16:47:30 ERROR es[][o.e.b.ElasticsearchUncaughtExceptionHandler] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: org.elasticsearch.common.ssl.SslConfigException: failed to find a X509ExtendedTrustManager in the trust manager factory for [PKIX] and truststore [null]`Preformatted text`

SQ is running behind an IIS reverse proxy for TLS, so I’m confused about why SQ would be having an issue with SSL.

I see this in the web log which might be a clue


2022.06.23 16:09:39 WARN  web[][o.a.c.l.WebappClassLoaderBase] The web application [ROOT] appears to have started a thread named [OkHttp TaskRunner] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:\n java.base@11.0.15/java.lang.Object.wait(Native Method)\n java.base@11.0.15/java.lang.Object.wait(Object.java:462)\n app//okhttp3.internal.concurrent.TaskRunner$RealBackend.coordinatorWait(TaskRunner.kt:294)\n app//okhttp3.internal.concurrent.TaskRunner.awaitTaskToRun(TaskRunner.kt:218)\n app//okhttp3.internal.concurrent.TaskRunner$runnable$1.run(TaskRunner.kt:59)\n java.base@11.0.15/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n java.base@11.0.15/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n java.base@11.0.15/java.lang.Thread.run(Thread.java:829)
2022.06.23 16:09:39 WARN  web[][o.a.c.l.WebappClassLoaderBase] The web application [ROOT] appears to have started a thread named [OkHttp katahdin.edge.noblis.org] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:\n java.base@11.0.15/java.net.SocketInputStream.socketRead0(Native Method)\n java.base@11.0.15/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)\n java.base@11.0.15/java.net.SocketInputStream.read(SocketInputStream.java:168)\n java.base@11.0.15/java.net.SocketInputStream.read(SocketInputStream.java:140)\n java.base@11.0.15/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:478)\n java.base@11.0.15/sun.security.ssl.SSLSocketInputRecord.readHeader(SSLSocketInputRecord.java:472)\n java.base@11.0.15/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:70)\n java.base@11.0.15/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1454)\n java.base@11.0.15/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1065)\n app//okio.InputStreamSource.read(JvmOkio.kt:90)\n app//okio.AsyncTimeout$source$1.read(AsyncTimeout.kt:129)\n app//okio.RealBufferedSource.request(RealBufferedSource.kt:206)\n app//okio.RealBufferedSource.require(RealBufferedSource.kt:199)\n app//okhttp3.internal.http2.Http2Reader.nextFrame(Http2Reader.kt:89)\n app//okhttp3.internal.http2.Http2Connection$ReaderRunnable.invoke(Http2Connection.kt:618)\n app//okhttp3.internal.http2.Http2Connection$ReaderRunnable.invoke(Http2Connection.kt:609)\n app//okhttp3.internal.concurrent.TaskQueue$execute$1.runOnce(TaskQueue.kt:98)\n app//okhttp3.internal.concurrent.TaskRunner.runTask(TaskRunner.kt:116)\n app//okhttp3.internal.concurrent.TaskRunner.access$runTask(TaskRunner.kt:42)\n app//okhttp3.internal.concurrent.TaskRunner$runnable$1.run(TaskRunner.kt:65)\n java.base@11.0.15/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n java.base@11.0.15/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n java.base@11.0.15/java.lang.Thread.run(Thread.java:829)
2022.06.23 16:09:39 WARN  web[][o.a.c.l.WebappClassLoaderBase] The web application [ROOT] appears to have started a thread named [Okio Watchdog] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:\n java.base@11.0.15/java.lang.Object.wait(Native Method)\n app//okio.AsyncTimeout$Companion.awaitTimeout$okio(AsyncTimeout.kt:300)\n app//okio.AsyncTimeout$Watchdog.run(AsyncTimeout.kt:187)
2022.06.23 16:09:39 WARN  web[][o.a.c.l.WebappClassLoaderBase] The web application [ROOT] appears to have started a thread named [OkHttp TaskRunner] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:\n java.base@11.0.15/jdk.internal.misc.Unsafe.park(Native Method)\n java.base@11.0.15/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)\n java.base@11.0.15/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)\n java.base@11.0.15/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)\n java.base@11.0.15/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)\n java.base@11.0.15/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)\n java.base@11.0.15/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)\n java.base@11.0.15/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n java.base@11.0.15/java.lang.Thread.run(Thread.java:829)
2022.06.23 16:09:39 WARN  web[][o.a.c.l.WebappClassLoaderBase] The web application [ROOT] appears to have started a thread named [OkHttp TaskRunner] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:\n java.base@11.0.15/jdk.internal.misc.Unsafe.park(Native Method)\n java.base@11.0.15/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)\n java.base@11.0.15/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)\n java.base@11.0.15/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)\n java.base@11.0.15/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)\n java.base@11.0.15/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)\n java.base@11.0.15/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)\n java.base@11.0.15/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n java.base@11.0.15/java.lang.Thread.run(Thread.java:829)
2022.06.23 16:09:39 WARN  web[][o.a.c.l.WebappClassLoaderBase] The web application [ROOT] appears to have started a thread named [OkHttp TaskRunner] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread:\n java.base@11.0.15/jdk.internal.misc.Unsafe.park(Native Method)\n java.base@11.0.15/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)\n java.base@11.0.15/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)\n java.base@11.0.15/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)\n java.base@11.0.15/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)\n java.base@11.0.15/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)\n java.base@11.0.15/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)\n java.base@11.0.15/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n java.base@11.0.15/java.lang.Thread.run(Thread.java:829)
2022.06.23 16:09:39 INFO  web[][o.s.s.app.WebServer] WebServer stopped

Any assistance is appreciated as I’m not sure where to look. I’ll work on rolling back now.

B

Is there any more information I can add to get some feedback from the community?