Performance Degradation on upgrade from 7.9 LTS to 8.9 LTS

Had been running 7.9 LTS and analyze times for one project were ~ 2 minutes now after upgrading to 8.9 LTS the analyze times have jumped to ~ 19 minutes. Other projects don’t appear to have been as badly impacted.

Running Sonarqube on a t3.large, had been t3.medium previously with gp2 volume. Postgresql db 9.6 has remained constant.

Following Very slow analysis after 8.1 -> 8.8 upgrade - #6 by Martin_Foot
the following has been carried out -
2G is allocated to each of the sonar.{web,ce,search}.javaAdditional arguments
VACUUM FULL ANALYZE has been executed as the database administrator
postgres settings
shared_buffers = 128MB
work_mem has been increased to 32MB from 4MB previously
Both services restarted.

INFO: Load metrics repository
INFO: Load metrics repository (done) | time=23ms
INFO: Sensor CSS Metrics [cssfamily]
INFO: Sensor CSS Metrics [cssfamily] (done) | time=1489ms
INFO: Sensor CSS Rules [cssfamily]
INFO: 1683 source files to be analyzed
INFO: 1288/1683 files analyzed, current file: REDACTED
INFO: 1683/1683 source files have been analyzed
INFO: Sensor CSS Rules [cssfamily] (done) | time=13463ms
INFO: Sensor JaCoCo XML Report Importer [jacoco]
INFO: 'sonar.coverage.jacoco.xmlReportPaths' is not defined. Using default locations: target/site/jacoco/jacoco.xml,target/site/jacoco-it/jacoco.xml,build/reports/jacoco/test/jacocoTestReport.xml
INFO: No report imported, no coverage information will be imported by JaCoCo XML Report Importer
INFO: Sensor JaCoCo XML Report Importer [jacoco] (done) | time=15ms
INFO: Sensor JavaScript analysis [javascript]
INFO: 2522 source files to be analyzed
INFO: 0/2522 files analyzed, current file: REDACTED
INFO: 7/2522 files analyzed, current file: REDACTED
INFO: 29/2522 files analyzed, current file: REDACTED
INFO: 50/2522 files analyzed, current file: REDACTED
INFO: 75/2522 files analyzed, current file: REDACTED
INFO: 96/2522 files analyzed, current file: REDACTED
INFO: 130/2522 files analyzed, current file: REDACTED
INFO: 158/2522 files analyzed, current file: REDACTED
INFO: 176/2522 files analyzed, current file: REDACTED
INFO: 200/2522 files analyzed, current file: REDACTED
INFO: 226/2522 files analyzed, current file: REDACTED
INFO: 247/2522 files analyzed, current file: REDACTED
INFO: 265/2522 files analyzed, current file: REDACTED
INFO: 283/2522 files analyzed, current file: REDACTED
INFO: 317/2522 files analyzed, current file: REDACTED
INFO: 345/2522 files analyzed, current file: REDACTED
INFO: 361/2522 files analyzed, current file: REDACTED
INFO: 379/2522 files analyzed, current file: REDACTED
INFO: 393/2522 files analyzed, current file: REDACTED
INFO: 419/2522 files analyzed, current file: REDACTED
INFO: 441/2522 files analyzed, current file: REDACTED
INFO: 470/2522 files analyzed, current file: REDACTED
INFO: 490/2522 files analyzed, current file: REDACTED
INFO: 525/2522 files analyzed, current file: REDACTED
INFO: 545/2522 files analyzed, current file: REDACTED
INFO: 575/2522 files analyzed, current file: REDACTED
INFO: 596/2522 files analyzed, current file: REDACTED
INFO: 625/2522 files analyzed, current file: REDACTED
INFO: 640/2522 files analyzed, current file: REDACTED
INFO: 668/2522 files analyzed, current file: REDACTED
INFO: 688/2522 files analyzed, current file: REDACTED
INFO: 709/2522 files analyzed, current file: REDACTED
INFO: 722/2522 files analyzed, current file: REDACTED
INFO: 739/2522 files analyzed, current file: REDACTED
INFO: 762/2522 files analyzed, current file: REDACTED
INFO: 778/2522 files analyzed, current file: REDACTED
INFO: 796/2522 files analyzed, current file: REDACTED
INFO: 824/2522 files analyzed, current file: REDACTED
INFO: 844/2522 files analyzed, current file: REDACTED
INFO: 863/2522 files analyzed, current file: REDACTED
INFO: 887/2522 files analyzed, current file: REDACTED
INFO: 905/2522 files analyzed, current file: REDACTED
INFO: 923/2522 files analyzed, current file: REDACTED
INFO: 950/2522 files analyzed, current file: REDACTED
INFO: 966/2522 files analyzed, current file: REDACTED
INFO: 998/2522 files analyzed, current file: REDACTED
INFO: 1030/2522 files analyzed, current file: REDACTED
INFO: 1053/2522 files analyzed, current file: REDACTED
INFO: 1071/2522 files analyzed, current file: REDACTED
INFO: 1101/2522 files analyzed, current file: REDACTED
INFO: 1126/2522 files analyzed, current file: REDACTED
INFO: 1149/2522 files analyzed, current file: REDACTED
INFO: 1155/2522 files analyzed, current file: REDACTED
INFO: 1176/2522 files analyzed, current file: REDACTED
INFO: 1204/2522 files analyzed, current file: REDACTED
INFO: 1223/2522 files analyzed, current file: REDACTED
INFO: 1253/2522 files analyzed, current file: REDACTED
INFO: 1277/2522 files analyzed, current file: REDACTED
INFO: 1303/2522 files analyzed, current file: REDACTED
INFO: 1318/2522 files analyzed, current file: REDACTED
INFO: 1339/2522 files analyzed, current file: REDACTED
INFO: 1369/2522 files analyzed, current file: REDACTED
INFO: 1391/2522 files analyzed, current file: REDACTED
INFO: 1428/2522 files analyzed, current file: REDACTED
INFO: 1460/2522 files analyzed, current file: REDACTED
INFO: 1474/2522 files analyzed, current file: REDACTED
INFO: 1493/2522 files analyzed, current file: REDACTED
INFO: 1507/2522 files analyzed, current file: REDACTED
INFO: 1523/2522 files analyzed, current file: REDACTED
INFO: 1542/2522 files analyzed, current file: REDACTED
INFO: 1562/2522 files analyzed, current file: REDACTED
INFO: 1587/2522 files analyzed, current file: REDACTED
INFO: 1599/2522 files analyzed, current file: REDACTED
INFO: 1618/2522 files analyzed, current file: REDACTED
INFO: 1631/2522 files analyzed, current file: REDACTED
INFO: 1647/2522 files analyzed, current file: REDACTED
INFO: 1663/2522 files analyzed, current file: REDACTED
INFO: 1682/2522 files analyzed, current file: REDACTED
INFO: 1710/2522 files analyzed, current file: REDACTED
INFO: 1735/2522 files analyzed, current file: REDACTEDe
INFO: 1754/2522 files analyzed, current file: REDACTED
INFO: 1773/2522 files analyzed, current file: REDACTED
INFO: 1807/2522 files analyzed, current file: REDACTED
INFO: 1823/2522 files analyzed, current file: REDACTED
INFO: 1846/2522 files analyzed, current file: REDACTED
INFO: 1867/2522 files analyzed, current file: REDACTED
INFO: 1882/2522 files analyzed, current file: REDACTED
INFO: 1907/2522 files analyzed, current file: REDACTED
INFO: 1922/2522 files analyzed, current file: REDACTED
INFO: 1943/2522 files analyzed, current file: REDACTED
INFO: 1966/2522 files analyzed, current file: REDACTED
INFO: 1976/2522 files analyzed, current file: REDACTED
INFO: 1993/2522 files analyzed, current file: REDACTED
INFO: 2010/2522 files analyzed, current file: REDACTED
INFO: 2028/2522 files analyzed, current file: REDACTED
INFO: 2044/2522 files analyzed, current file: REDACTED
INFO: 2057/2522 files analyzed, current file: REDACTED
INFO: 2084/2522 files analyzed, current file: REDACTED
INFO: 2108/2522 files analyzed, current file: REDACTED
INFO: 2126/2522 files analyzed, current file: REDACTED
INFO: 2150/2522 files analyzed, current file: REDACTED
INFO: 2183/2522 files analyzed, current file: REDACTED
INFO: 2212/2522 files analyzed, current file: REDACTED
INFO: 2224/2522 files analyzed, current file: REDACTED
INFO: 2241/2522 files analyzed, current file: REDACTED
INFO: 2255/2522 files analyzed, current file: REDACTED
INFO: 2276/2522 files analyzed, current file: REDACTED
INFO: 2298/2522 files analyzed, current file: REDACTED
INFO: 2319/2522 files analyzed, current file: REDACTED
INFO: 2328/2522 files analyzed, current file: REDACTED
INFO: 2343/2522 files analyzed, current file: REDACTED
INFO: 2365/2522 files analyzed, current file: REDACTED
INFO: 2384/2522 files analyzed, current file: REDACTED
INFO: 2406/2522 files analyzed, current file: REDACTED
INFO: 2423/2522 files analyzed, current file: REDACTED
INFO: 2454/2522 files analyzed, current file: REDACTED
INFO: 2466/2522 files analyzed, current file: REDACTED
INFO: 2476/2522 files analyzed, current file: REDACTED
INFO: 2491/2522 files analyzed, current file: REDACTED
INFO: 2513/2522 files analyzed, current file: REDACTED
INFO: 2522/2522 source files have been analyzed
INFO: Sensor JavaScript analysis [javascript] (done) | time=1205212ms
INFO: Sensor TypeScript analysis [javascript]
INFO: No input files found for analysis
INFO: Sensor TypeScript analysis [javascript] (done) | time=47ms
INFO: Sensor JavaScript/TypeScript Coverage [javascript]
INFO: Analysing [READACTED]
WARN: Could not resolve 120 file paths in [REDACTED]
WARN: First unresolved path: REDACTED (Run in DEBUG mode to get full list of unresolved paths)
INFO: Sensor JavaScript/TypeScript Coverage [javascript] (done) | time=326ms
INFO: Sensor C# Project Type Information [csharp]
INFO: Sensor C# Project Type Information [csharp] (done) | time=3ms
INFO: Sensor C# Properties [csharp]
INFO: Sensor C# Properties [csharp] (done) | time=1ms
INFO: Sensor JavaXmlSensor [java]
INFO: 2 source files to be analyzed
INFO: 2/2 source files have been analyzed
INFO: Sensor JavaXmlSensor [java] (done) | time=221ms
INFO: Sensor HTML [web]
INFO: Sensor HTML [web] (done) | time=952ms
INFO: Sensor XML Sensor [xml]
INFO: 2 source files to be analyzed
INFO: 2/2 source files have been analyzed
INFO: Sensor XML Sensor [xml] (done) | time=154ms
INFO: Sensor VB.NET Project Type Information [vbnet]
INFO: Sensor VB.NET Project Type Information [vbnet] (done) | time=2ms
INFO: Sensor VB.NET Properties [vbnet]
INFO: Sensor VB.NET Properties [vbnet] (done) | time=1ms
INFO: Sensor com.github.mc1arke.sonarqube.plugin.scanner.ScannerPullRequestPropertySensor
INFO: Sensor com.github.mc1arke.sonarqube.plugin.scanner.ScannerPullRequestPropertySensor (done) | time=5ms
INFO: ------------- Run sensors on project
INFO: Sensor Zero Coverage Sensor
INFO: Sensor Zero Coverage Sensor (done) | time=16ms
INFO: CPD Executor 367 files had no CPD blocks
INFO: CPD Executor Calculating CPD for 2156 files
INFO: CPD Executor CPD calculation finished (done) | time=609ms
INFO: Load New Code definition
INFO: Load New Code definition (done) | time=132ms
INFO: Analysis report generated in 632ms, dir size=19 MB
INFO: Analysis report compressed in 5229ms, zip size=9 MB
INFO: Analysis report uploaded in 752ms
INFO: ANALYSIS SUCCESSFUL, you can browse REDACTED
INFO: Note that you will be able to access the updated dashboard once the server has processed the submitted analysis report
INFO: More about the report processing at REDACTED
INFO: Analysis total time: 21:01.987 s

Any suggestions on how to progress at resolving this?

thanks

Hi,

Welcome to the community!

You don’t mention edition. Are you on a commercial edition & using the taint analysis rules for JavaScript?

We have seen a performance drag in JavaScript analysis, and particularly in the taint analysis rules in some cases. We’re actively working on it, but that’s likely what you’re experiencing.

It might help to enable debug logging on your analysis (sonar.log.level) so we can see exactly where the time is going.

 
Ann

Hi Ann,

We use Community Edition . I’ve had to trim the logs to be visible at yarn sonar-scanner '-Dsonar.log.level=D' '-Dsonar.branch.name=master' '-Dsonar.projectVers - 48ccfe6f

Hi,

Thanks for the logs. I see that about 15 minutes goes into analyzing 2522 JavaScript files. Beyond that, nothing jumps out at me.

Unfortunately, I’ve hit my depth limit here, so we’ll have to wait until the language specialists show up to go further.

 
Ann