Your web.log show that indexes are read-only :
2019.07.19 00:05:34 ERROR web[o.s.s.es.BulkIndexer] index [projectmeasures], type [auth], id [AWtVBF5hrsX19e1yZHce], message [ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]]
And es.log show that you hit the low watermark
:
low disk watermark [85%] exceeded on [UeRVjxMESfesnoT-4wrPZw][sonarqube][/opt/sonarqube/data/es6/nodes/0] free: 43.1gb[14.7%], replicas will not be assigned to this node
Free some space an restart SQ.
About the threshold, you can find more information here : Disk-based shard allocation | Elasticsearch Guide [8.11] | Elastic
85% is the low watermark
meaning that new shards cannot be created on this node, but you can still write on existing ones. The 95% high watermark
lock all writings. In your case, a new shard is created, so you are stuck at the low watermark
.
Hope this help