Dears,
I integrated sonar cloud with azuredevops pipeline.
Our organization pass the steps about create a project, pat token configuration, the build pipe works, the quality gate was created at the sonar side. When the pipe run mannualy the quality gate status is ok.
We implemented a poc project test, with some cases without code coverage, the project is presenting 50% about coverage. Just to view the failed occurs.
In the quality side we configure to less than 80% the gate fail,so, when the pipe run manual, this work. In the other hand, when the pipe went by the pull request, the sonar gate integration in the azure devops always presenting the “passed” status.
I was trying so many thins up to now. Quering in the web and in this forum, but unfortanetely without success.
Folow Below how is the pipe, and the conf into sonarcloud and azuredevops
Sonarqube quality gate:
Conditions on New Code
- Coverage is less than 80.0%
- Duplicated Lines (%) is greater than 3.0%
- Security Hotspots Reviewed is less than 100%
Conditions on Overall Code
- Coverage is less than 80.0%
- Unit Tests is less than 70
I also try changing this quality gate to the default
Azure devops pipeline
# ex azuredevops pipeline
pool:
vmImage: 'ubuntu-latest'
variables:
- name: 'BROWSERSLIST_IGNORE_OLD_DATA'
value: true
- name: 'IsPR'
value: $[eq(variables['Build.Reason'], 'PullRequest')]
- name: 'IsScheduled'
value: $[eq(variables['Build.Reason'], 'Schedule')]
- name: 'PRBaseBranch'
steps:
- checkout: self
fetchDepth: 0
- task: SonarCloudPrepare@1
condition: and(succeeded(), eq(variables.IsPR, 'true'))
inputs:
SonarCloud: XXXX
organization: XXXX
scannerMode: 'CLI'
configMode: 'manual'
cliProjectKey: XXXXX
projectName: '$(Build.DefinitionName)'
projectVersion: '$(Build.BuildNumber)'
cliSources: './php'
extraProperties: |
sonar.language=php
sonar.sources=./php/src/
sonar.tests=./php/tests/
sonar.projectKey=XXXX
sonar.projectName=XXXX
sonar.organization=XXXX
sonar.verbose=true
sonar.log.level=DEBUG
sonar.projectKey=XXXX
sonar.php.tests.reportPath=./php/tests/reports/phpunit.junit.xml
sonar.php.coverage.reportPaths=$(System.DefaultWorkingDirectory)/php/tests/reports/coverage-report.clover
sonar.exclusions=./php/tests/**,./php/src/index.php
sonar.pullrequest.key=$(System.PullRequest.PullRequestId)
sonar.pullrequest.base=$(PRBaseBranch)
sonar.pullrequest.branch=$(System.PullRequest.SourceBranch)
cmd to genererate the php testes: XDEBUG_MODE=coverage ./php/vendor/bin/phpunit -c ./php/phpunit.xml --testsuite "badtests" --coverage-html=./php/tests/reports/clover/ --coverage-clover=./php/tests/reports/coverage-report.clover --coverage-cobertura=./php/tests/reports/COVERAGE-phpunit-cobertura.xml --log-junit=./php/tests/reports/phpunit.junit.xml || true; chmod -R 0777 ./php/tests/reports/;
- task: PublishTestResults@2
inputs:
testRunner: 'JUnit' # Options: JUnit, NUnit, VSTest, xUnit
testResultsFiles: '**/phpunit.junit.xml'
searchFolder: '$(System.DefaultWorkingDirectory)/php/tests/reports'
mergeTestResults: false # Optional
- task: PublishCodeCoverageResults@1
inputs:
codeCoverageTool: 'Cobertura'
summaryFileLocation: '$(System.DefaultWorkingDirectory)/php/tests/reports/COVERAGE-phpunit-cobertura.xml'
reportDirectory: '$(System.DefaultWorkingDirectory)/_temp/cchtml'
- task: SonarCloudPrepare@1
condition: and(succeeded(), eq(variables.IsPR, 'false'))
inputs:
SonarCloud: XXXX
organization: XXXX
scannerMode: 'CLI'
configMode: 'manual'
projectKey: '$(Build.DefinitionName)'
projectName: '$(Build.DefinitionName)'
projectVersion: '$(Build.BuildNumber)'
cliProjectKey: XXXX
cliSources: './php'
extraProperties: |
sonar.language=php
sonar.sources=./php/src/
sonar.tests=./php/tests/
sonar.projectKey=XXXX
sonar.projectName=XXXX
sonar.organization=XXXX
sonar.verbose=true
sonar.log.level=DEBUG
sonar.projectKey=XXXX
sonar.php.tests.reportPath=./php/tests/reports/phpunit.junit.xml
sonar.php.coverage.reportPaths=$(System.DefaultWorkingDirectory)/php/tests/reports/coverage-report.clover
sonar.exclusions=./php/tests/**,./php/src/index.php
sonar.branch.name=$(Build.SourceBranchName)
- task: SonarCloudAnalyze@1
- task: SonarCloudPublish@1
inputs:
pollingTimeoutSec: '300'
The branch policy is configured with required, with the sonar pipeline and the status check to quality gate.
This runs, no problem about runs.
But when the trigger is the pull request, the quality always pass and is not blocked.
If I run mannualy the sonar shows for example:
status Failed
- 45.8%Coverage
- 80.0% required
- 2Unit Tests
- 70 required
When goes by the pull request the quality gate just pass.
Can anyone help?
