Updating Azure DevOps PAT token in SonarCloud

Trying to update the PAT token defined for Azure DevOps integration at:

https://sonarcloud.io/organizations/*********/edit

Looks like calls to Azure DevOps are still happening with the old token.

Also in the console, I can spot that on clicking ‘Update’ button at the link above (SonarCloud), there is an error recorded:
sentry-7b93282f.js:3 POST https://sonarcloud.io/api/alm_integration/bind_organization 500

Looks like it is caused by permissions on the account that generated PAT token. Not sure what would those be as it is stated it only needs code read/write.