I’m running SonarQube Developer Edition Version 9.9 (build 65466)
, deployed from zip, running in a highly available Virtual Machine.
What’s happening:
Currently I’m facing recurring unresponsive Web UI and backend which only can get back to work by restarting the SonarQube Service manually.
This happens sporadically few times a day (~3-6 times).
-
The Web UI is not loading any content (pages keep empty with a load indicator) but it’s still possible to switch the tab pages.
-
CI jobs interacting with SonarQube are failing to connect to SonarQube for scan publications.
Failed to request and parse 'https://vistrpmcsonar2.vi.vector.int/api/server/version': A task was canceled.
-
SonarQube keeps unresponsive (Because their are workflows depending on the analysis I have to restart the service asap. Therfor I can’t tell if it ever will return to life by itself, max. time i can confirm was 3 hours.
What I’ve tried so far:
- Extended RAM of the Virtual Machine to 16GB (Memory usage ~30%)
- sonar.properties
- Extended default to:
sonar.web.javaOpts=-Xmx1G -Xms128m -XX:+HeapDumpOnOutOfMemoryError
- Extended default to:
sonar.ce.javaOpts=-Xmx2G -Xms128m -XX:+HeapDumpOnOutOfMemoryError
- Elastic search is still on default.
- Extended default to:
- Searched in the logs (attached) for any abnormality
- Increased the log level after the latest occurrence - waiting for the next unresponsive phase.
- As long as this happens I roll back new projects one by one - but this can’t be the solution.
Suspect things:
- Lately we increased our licensed LoC and migrated multiple projects, each >250k LoC.
- Many occurrences of SonarLint in access.log
"GET /api/developers/search_events?projects=VCS&from=2023-04-24T04%3A51%3A05%2B0200&projects=VCS&from=2023-04-24T04%3A51%3A05%2B0200 HTTP/1.1" 200 - "-" "SonarLint IntelliJ 7.2.0.56810" "AYezWHdLU5J0f15dAA4P"
Any suggestions to narrow down the problem?
logs.zip (284.8 KB)