Code coverage suddenly dropped

SonarCloud
, ,
1

Unfortunately we have once again, for the second time in two weeks, hit random issues with our code coverage dropping without us changing anything.

image
image1044×574 17.4 KB

I posted about this previously as well as here.

Last night our code coverage dropped and this time it seems to be an issue with some of our csproj files not being picked up properly.

Highlighted below are some folders that I know should have at least some level of code coverage.

image
image1188×837 42.1 KB

Once again, we have not changed anything, but we’re now seeing vast differences in the statistics that are being produced.

2

For the record, details about the job config are here -> Adding another test run halves the code coverage

  • Does the issue happen for the projects you’ve migrated to OpenCover or to the projects that use the VS Coverage?
  • is your Javascript code in a different SQ project? AFAIK, you cannot show code coverage for multiple technologies in the same SQ project.
  • To investigate further, we’d also need the verbose logs. Please add the sonar.verbose=true property at the BEGIN step and give us the logs of the BEGIN and END steps.
  • can you send us the coverage reports as well? to verify their contents?

In case you want to send them via private messaging, I’ll contact you privately and you can upload them there.

3

The projects that are affected are all ones that use Visual Studio Coverage.

Our typescript code is in the same project and we have not had any issues up until now having multiple technologies all in the same project. We have python code as well, that reports our coverage as expected.

I will try to get those verbose logs out soon, but things are rather hectic on our end as we’re at the end of one of our sprints.

4

Sounds good. Good luck with the sprint :slight_smile: !

5

Okay this is somewhat hugely overdue, but we’re still seeing the same issue. For whatever reason it happens on our master builds rather than the PR builds from what I can tell. It’s an annoying issue that keeps popping up, and it can generally be fixed by re-running the build. I’ve got the logs but they seem to be larger than the allowed file limit, is there another way to get them to you?

6

This seems to be happening more regularly now. It may be because we’ve introduced more projects whose coverage is being calculated using OpenCover. Over the past two days we’ve had three different coverage calculations, 27.2%, 13.9%, and 29.4%, all with no major changes between them.

7

You can upload them to a cloud drive of your choice and send us the link.

Do you mean for the main branch? I’m really interested in the logs, indeed.

Does the variation happen for each project in the solution, or just one of them varies and affects the overall coverage?

8

It varies by project, and by content. Sometimes it just doesn’t load some projects, and other times the actual percentage values change for specific projects.

Would you be able to dm me your email, and we’ll share a sharepoint link for the file with you directly?

9

Thanks. I sent you a private message.