Code Smell comments not saved

We are running a local instance of SQ and have integration with Azure DevOps that applies code smell comments to our PRs. When a dev chooses won’t fix and the PR is completed, the comments SQ comments disappear from the PR, which is preventing us from going back and fixing the issues in a later release. How can this be configured to not remove the comments?