Some projects experiencing an error after running vacuum full

SonarQube Server / Community Build
1
  • Community Edition Version 7.9.4

After running a vacuum full, some projects are experiencing he following error.

Caused by: org.apache.ibatis.exceptions.PersistenceException: 
### Error committing transaction.  Cause: org.apache.ibatis.executor.BatchExecutorException: org.sonar.db.purge.PurgeMapper.deleteFileSourcesByProjectUuid (batch index #1) failed. Cause: java.sql.BatchUpdateException: Batch entry 0 delete from file_sources where project_uuid='AXs_FXzFxlgwYQkt603P' was aborted: ERROR: invalid page in block 3343995 of relation base/36067179/45589027  Call getNextException to see other errors in the batch.
### Cause: org.apache.ibatis.executor.BatchExecutorException: org.sonar.db.purge.PurgeMapper.deleteFileSourcesByProjectUuid (batch index #1) failed. Cause: java.sql.BatchUpdateException: Batch entry 0 delete from file_sources where project_uuid='AXs_FXzFxlgwYQkt603P' was aborted: ERROR: invalid page in block 3343995 of relation base/36067179/45589027  Call getNextException to see other errors in the batch.
	at org.apache.ibatis.exceptions.ExceptionFactory.wrapException(ExceptionFactory.java:30)
	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:226)
	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:217)
	at org.sonar.db.DbSessionImpl.commit(DbSessionImpl.java:42)
	at org.sonar.db.BatchSession.commit(BatchSession.java:168)
	at org.sonar.db.purge.PurgeCommands.deleteFileSources(PurgeCommands.java:330)
	at org.sonar.db.purge.PurgeDao.deleteRootComponent(PurgeDao.java:250)
	at org.sonar.db.purge.PurgeDao.purgeStaleBranches(PurgeDao.java:92)
	at org.sonar.db.purge.PurgeDao.purge(PurgeDao.java:77)
	at org.sonar.ce.task.projectanalysis.purge.ProjectCleaner.purge(ProjectCleaner.java:63)
	at org.sonar.ce.task.projectanalysis.purge.PurgeDatastoresStep.execute(PurgeDatastoresStep.java:76)
	at org.sonar.ce.task.projectanalysis.purge.PurgeDatastoresStep.access$000(PurgeDatastoresStep.java:38)
	at org.sonar.ce.task.projectanalysis.purge.PurgeDatastoresStep$1.visitProject(PurgeDatastoresStep.java:63)
	at org.sonar.ce.task.projectanalysis.component.DepthTraversalTypeAwareCrawler.visitNode(DepthTraversalTypeAwareCrawler.java:70)
	at org.sonar.ce.task.projectanalysis.component.DepthTraversalTypeAwareCrawler.visitImpl(DepthTraversalTypeAwareCrawler.java:51)
	at org.sonar.ce.task.projectanalysis.component.DepthTraversalTypeAwareCrawler.visit(DepthTraversalTypeAwareCrawler.java:39)
	... 18 more
Caused by: org.apache.ibatis.executor.BatchExecutorException: org.sonar.db.purge.PurgeMapper.deleteFileSourcesByProjectUuid (batch index #1) failed. Cause: java.sql.BatchUpdateException: Batch entry 0 delete from file_sources where project_uuid='AXs_FXzFxlgwYQkt603P' was aborted: ERROR: invalid page in block 3343995 of relation base/36067179/45589027  Call getNextException to see other errors in the batch.
	at org.apache.ibatis.executor.BatchExecutor.doFlushStatements(BatchExecutor.java:148)
	at org.apache.ibatis.executor.BaseExecutor.flushStatements(BaseExecutor.java:129)
	at org.apache.ibatis.executor.BaseExecutor.flushStatements(BaseExecutor.java:122)
	at org.apache.ibatis.executor.BaseExecutor.commit(BaseExecutor.java:242)
	at org.apache.ibatis.executor.CachingExecutor.commit(CachingExecutor.java:119)
	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:223)
	... 32 more
Caused by: java.sql.BatchUpdateException: Batch entry 0 delete from file_sources where project_uuid='AXs_FXzFxlgwYQkt603P' was aborted: ERROR: invalid page in block 3343995 of relation base/36067179/45589027  Call getNextException to see other errors in the batch.
	at org.postgresql.jdbc.BatchResultHandler.handleError(BatchResultHandler.java:148)
	at org.postgresql.core.ResultHandlerDelegate.handleError(ResultHandlerDelegate.java:50)
	at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2184)
	at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:481)
	at org.postgresql.jdbc.PgStatement.executeBatch(PgStatement.java:840)
	at org.postgresql.jdbc.PgPreparedStatement.executeBatch(PgPreparedStatement.java:1538)
	at org.apache.commons.dbcp2.DelegatingStatement.executeBatch(DelegatingStatement.java:223)
	at org.apache.commons.dbcp2.DelegatingStatement.executeBatch(DelegatingStatement.java:223)
	at org.apache.ibatis.executor.BatchExecutor.doFlushStatements(BatchExecutor.java:122)
	... 37 more
Caused by: org.postgresql.util.PSQLException: ERROR: invalid page in block 3343995 of relation base/36067179/45589027
	at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440)
	at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183)

Note: An an elasticsearch re-index was not done

Any guidance on how to solve this issue would greatly be appreciated.

Thanks

2

Hi,

First, your version is past EOL. You should upgrade to either the latest version or the current LTS at your earliest convenience. Your upgrade path is:

7.9.4 → 8.9.2 → 9.0.1 (last step optional)

Regarding your actual question, I hadn’t seen this error before, so I Googled it & got that this is usually a hardware problem.

 
:woman_shrugging:
Ann