[ERROR] GC overhead limit exceeded

drod · November 8, 2018, 5:55am

Have project running SonarQube 6.7.3 consistently getting error:GC overhead limit exceeded on the same java file. The only way to get SonarQube to complete the analysis is to exclude it. Need help troubleshooting why SonarQube thrashes on the file for about 20min and then fails with the error “GC overhead limit”

OS: Ubuntu 14.04.5
JDK: 1.8.0_102
RAM: 32GB
MAVEN_OPTS -Xmx8g -Xmx8g -XX:MaxDirectMemorySize=4096m

146 files ignored because of inclusion/exclusion patterns
[INFO] Quality profile for java: Sonar way
[INFO] Excluded sources for coverage:
[INFO] **/utils/TimeCalculator.java
[INFO] **/activity/AnalysisActivity.java
[INFO] **/activity/FullScreenActivity.java
[INFO] **/activity/StackModelStateSynchronizer.java
[INFO] Sensor JavaSquidSensor [java]
[INFO] Configured Java source version (sonar.java.source): 8
[INFO] JavaClasspath initialization
[INFO] JavaClasspath initialization (done) | time=5ms
[INFO] JavaTestClasspath initialization
[INFO] JavaTestClasspath initialization (done) | time=5ms
[INFO] Java Main Files AST scan
.
.
.
[ERROR] GC overhead limit exceeded -> [Help 1]
java.lang.OutOfMemoryError: GC overhead limit exceeded
at com.google.common.collect.ImmutableList.of(ImmutableList.java:76)
at org.sonar.java.se.symbolicvalues.SymbolicValue.setConstraint(SymbolicValue.java:125)
at org.sonar.java.se.ExplodedGraphWalker.lambda$startingStates$2(ExplodedGraphWalker.java:336)
at org.sonar.java.se.ExplodedGraphWalker$$Lambda$281/1293405828.apply(Unknown Source)
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743)
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:270)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743)
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:270)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:742)
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:270)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743)
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:270)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)

dbolkensteyn · November 9, 2018, 10:32am

Thank you for sharing the source code on which the analysis is failing @drod.

Which version of sonar-java do you have installed on your SonarQube 6.7.3? Could you retry with the latest available version?

The reason I am asking is because I see that your code has methods with many @CheckForNull parameters, such as:

public TroubleDto(
  @JsonProperty("id") @CheckForNull String id,
  @JsonProperty("name") @CheckForNull String name,
  @JsonProperty("description") @CheckForNull String description,
  @JsonProperty("severity") @CheckForNull Severity severity,
  @JsonProperty("type") @CheckForNull Type type,
   // ...
)

While I cannot find the exact ticket back right now, I vaguely remember a similar bug reported a long time ago where the conclusion was that in such cases the analyzer required an exponential amount of resources and which has since been solved.

Please keep us posted.

drod · November 9, 2018, 4:50pm

Hi Dinesh,

The plugin version being used is sonar-maven-plugin:3.5.0.1254. Looks like the latest version. Below is a clip out of maven build logfile.

[INFO] — sonar-maven-plugin:3.5.0.1254:sonar (default-cli) @ trouble-ticket —

Downloading: https://repositories.mycom-osi.com/repository/mycomosi/org/apache/maven/plugins/maven-compiler-plugin/maven-metadata.xml
Downloaded: https://repositories.mycom-osi.com/repository/mycomosi/org/apache/maven/plugins/maven-compiler-plugin/maven-metadata.xml (2 KB at 8.3 KB/sec)
[INFO] User cache: /usr/share/tomcat7/.sonar/cache
[INFO] SonarQube version: 6.7.3
[INFO] Default locale: “en”, source code encoding: “UTF-8” (analysis is platform dependent)
[INFO] Publish mode
[INFO] Load global settings
[INFO] Load global settings (done) | time=601ms

Regards,

David

This electronic message contains information from MYCOM OSI which may be privileged or confidential. The information is intended to be for the use of the individual(s) or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution or any other use of the contents of this information is prohibited. If you have received this electronic message in error, please notify us by post or telephone (to the numbers or correspondence address above) or by email (at the email address above) immediately.

dbolkensteyn · November 12, 2018, 7:54am

Hello David,

The version of SonarScanner for Maven is what you reported, and it is different from the SonarJava version.

The easiest way to find out what the version of SonarJava is is through SonarQube’s UI:

Login as admin
Go to Administration > Marketplace

The latest available version is 5.9.1, and the screenshot below shows that version 5.8 is installed:

Could you try to update to the latest 5.9.1 version and see if this solves the issue?

Thank you

drod · November 13, 2018, 3:10am

Hi Dinesh,

Updated SonarJava to 5.9.1 and re-ran the Sonar. Still thrashing on a file. Had to exit. Below is the command and output.

Command: --> mvn -f /data1/jenkins/workspace/nova-6.1.0/pom.xml -e -B -U sonar:sonar -Dsonar.jdbc.url=jdbc:mysql://my-ci.sonar-internal.com:3306/sonar5?autoReconnect=true&useUnicode=true&characterEncoding=utf8 -Dsonar.host.url=http://mysonar-ci.mysonar-internal.com:9000

Output:

[INFO]

[INFO] — sonar-maven-plugin:3.5.0.1254:sonar (default-cli) @ trouble-ticket —

[INFO] Downloading: https://repositories.sonar-osi.com/repository/sonarosi/org/apache/maven/plugins/maven-compiler-plugin/maven-metadata.xml

[INFO] Downloaded: https://repositories.sonar-osi.com/repository/sonarosi/org/apache/maven/plugins/maven-compiler-plugin/maven-metadata.xml (2 KB at 92.3 KB/sec)

[INFO] User cache: /usr/share/tomcat7/.sonar/cache

[INFO] SonarQube version: 6.7.3

[INFO] Default locale: “en”, source code encoding: “UTF-8” (analysis is platform dependent)

[INFO] Publish mode

[INFO] Load global settings

[INFO] Load global settings (done) | time=102ms

[INFO] Server id: AWOPsLT7ZtqXXTCU8mgy

[WARNING] Property ‘sonar.jdbc.url’ is not supported any more. It will be ignored. There is no longer any DB connection to the SQ database.

[INFO] User cache: /usr/share/tomcat7/.sonar/cache

[INFO] Load plugins index

[INFO] Load plugins index (done) | time=82ms

[INFO] Process project properties

[INFO] Load project repositories

[INFO] Load project repositories (done) | time=280ms

[INFO] Load quality profiles

[INFO] Load quality profiles (done) | time=58ms

[INFO] Load active rules

[INFO] Load active rules (done) | time=499ms

[INFO] Load metrics repository

[INFO] Load metrics repository (done) | time=33ms

[INFO] Project key: com.sonarosi.eaa:trouble-ticket

[INFO] Branch key: 2.0

[WARNING] The use of “sonar.branch” is deprecated and replaced by “sonar.branch.name”. See https://redirect.sonarsource.com/doc/branches.html.

[INFO] ------------- Scan tt-query

[INFO] Load server rules

[INFO] Load server rules (done) | time=98ms

[INFO] Base dir: /data1/jenkins/workspace/trouble-ticket-2.3.0-drod/service/tt-query

[INFO] Working dir: /data1/jenkins/workspace/trouble-ticket-2.3.0-drod/service/tt-query/target/sonar

[INFO] Source paths: src/main/webapp, pom.xml, src/main/java

[INFO] Test paths: src/test/java

[INFO] Source encoding: UTF-8, default locale: en

[INFO] Index files

[INFO] Excluded sources:

[INFO] **/utils/TimeCalculator.java

[INFO] **/domain/troubleticket/TroubleTicketEntity.java

[INFO]

[INFO] Excluded tests:

[INFO] **/utils/TimeCalculator.java

[INFO] 78 files indexed

[INFO] 0 files ignored because of inclusion/exclusion patterns

[INFO] Quality profile for java: Sonar way

[INFO] Quality profile for xml: Sonar way

[INFO] Excluded sources for coverage:

[INFO] **/utils/TimeCalculator.java

[INFO] Sensor JavaSquidSensor [java]

[INFO] Configured Java source version (sonar.java.source): 8

[INFO] JavaClasspath initialization

[INFO] JavaClasspath initialization (done) | time=18ms

[INFO] JavaTestClasspath initialization

[INFO] JavaTestClasspath initialization (done) | time=6ms

[INFO] Java Main Files AST scan

[INFO] 59 source files to be analyzed

[INFO] 59/59 source files have been analyzed

[WARNING] Classes not found during the analysis : [javax.servlet.DispatcherType, javax.servlet.SessionTrackingMode, org.openid4java.consumer.ConsumerException, org.openid4java.consumer.ConsumerManager, org.springframework.security.openid.AxFetchListFactory, org.springframework.security.openid.OpenIDAuthenticationFilter, org.springframework.security.openid.OpenIDAuthenticationToken, org.springframework.security.openid.OpenIDConsumer]

[INFO] Java Main Files AST scan (done) | time=7745ms

[INFO] Java Test Files AST scan

[INFO] 17 source files to be analyzed

[INFO] 17/17 source files have been analyzed

[INFO] Java Test Files AST scan (done) | time=1996ms

[INFO] Sensor JavaSquidSensor [java] (done) | time=10501ms

[INFO] Sensor SurefireSensor [java]

[INFO] parsing [/data1/jenkins/workspace/trouble-ticket-2.3.0-drod/service/tt-query/target/surefire-reports]

[INFO] Sensor SurefireSensor [java] (done) | time=143ms

[INFO] Sensor JaCoCoSensor [java]

[WARNING] Property ‘sonar.jacoco.reportPath’ is deprecated. Please use ‘sonar.jacoco.reportPaths’ instead.

[WARNING] Property ‘sonar.jacoco.itReportPath’ is deprecated. Please use ‘sonar.jacoco.reportPaths’ instead.

[INFO] JaCoCo IT report not found: ‘/data1/jenkins/workspace/trouble-ticket-2.3.0-drod/service/tt-query/target/jacoco-it.exec’

[INFO] Analysing /data1/jenkins/workspace/trouble-ticket-2.3.0-drod/service/tt-query/target/jacoco.exec

[INFO] No information about coverage per test.

[INFO] Sensor JaCoCoSensor [java] (done) | time=155ms

[INFO] Sensor SonarJavaXmlFileSensor [java]

[INFO] 2 source files to be analyzed

[INFO] Sensor SonarJavaXmlFileSensor [java] (done) | time=582ms

[INFO] 2/2 source files have been analyzed

[INFO] Sensor XML Sensor [xml]

[INFO] Sensor XML Sensor [xml] (done) | time=159ms

[INFO] Sensor Analyzer for “php.ini” files [php]

[INFO] Sensor Analyzer for “php.ini” files [php] (done) | time=4ms

[INFO] ------------- Scan tt-ingestion

[INFO] Base dir: /data1/jenkins/workspace/trouble-ticket-2.3.0-drod/service/tt-ingestion

[INFO] Working dir: /data1/jenkins/workspace/trouble-ticket-2.3.0-drod/service/tt-ingestion/target/sonar

[INFO] Source paths: src/main/webapp, pom.xml, src/main/java

[INFO] Test paths: src/test/java

[INFO] Source encoding: UTF-8, default locale: en

[INFO] Index files

[INFO] Excluded sources:

[INFO] **/utils/TimeCalculator.java

[INFO] **/domain/troubleticket/TroubleTicketEntity.java

[INFO]

[INFO] Excluded tests:

[INFO] **/utils/TimeCalculator.java

[INFO] 73 files indexed

[INFO] 0 files ignored because of inclusion/exclusion patterns

[INFO] Quality profile for java: Sonar way

[INFO] Quality profile for xml: Sonar way

[INFO] Excluded sources for coverage:

[INFO] **/utils/TimeCalculator.java

[INFO] Sensor JavaSquidSensor [java]

[INFO] Configured Java source version (sonar.java.source): 8

[INFO] JavaClasspath initialization

[INFO] JavaClasspath initialization (done) | time=3ms

[INFO] JavaTestClasspath initialization

[INFO] JavaTestClasspath initialization (done) | time=3ms

[INFO] Java Main Files AST scan

[INFO] 53 source files to be analyzed

[INFO] 16/53 files analyzed, current file: /data1/jenkins/workspace/trouble-ticket-2.3.0-drod/service/tt-ingestion/src/main/java/com/sonarosi/eaa/tt/ingestion/application/historylog/parameters/TroubleTicketHistoryLog.java

[WARNING] [JOURNAL_FLUSHER] WARNING Journal flush operation took 4,452ms last 8 cycles average is 556ms

[INFO] 16/53 files analyzed, current file: /data1/jenkins/workspace/trouble-ticket-2.3.0-drod/service/tt-ingestion/src/main/java/com/sonarosi/eaa/tt/ingestion/application/historylog/parameters/TroubleTicketHistoryLog.java

This electronic message contains information from MYCOM OSI which may be privileged or confidential. The information is intended to be for the use of the individual(s) or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution or any other use of the contents of this information is prohibited. If you have received this electronic message in error, please notify us by post or telephone (to the numbers or correspondence address above) or by email (at the email address above) immediately.

Lena · July 4, 2019, 3:34pm

Archiving this topic due a lack of activity. If you have a similar problem please start a new topic. Thank you.