複数のドライブでblockServiceUnhealthyが発生しました
環境
- H610S
- Element OS 12.3.2.3
問題
blockServiceUnhealthy
次の3つのドライブで発生した原因はUnrecoverable read error
- ドライブは利用可能なプールに移動されました
イベント:
3016730 2025-06-30T11:23:06.183Z iEEvent return code:4 71 12 { "throwFile": "shared/BasicFile.cpp", "throwFunction": "virtual size_t solidfire::BasicFile::WriteV(const solidfire::SmartBuffer&, const solidfire::SmartBuffer&, off_t)", "throwLine": 436, "whatString": "/dev/nvme2n1: No space left on device", "exceptionCode": "xFileWriteFailed", "currentStack": "", "streamDetails": 1 }
3016739 2025-06-30T11:23:06.159Z iEEvent return code:4 72 12 { "throwFile": "shared/BasicFile.cpp", "throwFunction": "virtual size_t solidfire::BasicFile::WriteV(const solidfire::SmartBuffer&, const solidfire::SmartBuffer&, off_t)", "throwLine": 436, "whatString": "/dev/nvme3n1: No space left on device", "exceptionCode": "xFileWriteFailed", "currentStack": "", "streamDetails": 1 }
3016737 2025-06-30T11:23:06.143Z iEEvent return code:4 73 12 { "throwFile": "shared/BasicFile.cpp", "throwFunction": "virtual size_t solidfire::BasicFile::WriteV(const solidfire::SmartBuffer&, const solidfire::SmartBuffer&, off_t)", "throwLine": 436, "whatString": "/dev/nvme4n1: No space left on device", "exceptionCode": "xFileWriteFailed", "currentStack": "", "streamDetails": 1 }
3016718 2025-06-30T11:22:52.356Z ureEvent Unrecoverable Read Error 71 12 51 { "Exception": "xFileReadTruncated", "Fatal": true, "Repaired": false, "DiskLocation": 3016976211456 }
3016717 2025-06-30T11:22:52.352Z ureEvent Unrecoverable Read Error 72 12 52 { "Exception": "xFileReadTruncated", "Fatal": true, "Repaired": false, "DiskLocation": 2913754897664 }
3016719 2025-06-30T11:22:52.351Z ureEvent Unrecoverable Read Error 73 12 53 { "Exception": "xFileReadTruncated", "Fatal": true, "Repaired": false, "DiskLocation": 2896420114752 }
エラーログ:
241 2025-06-30T11:28:48.559Z Error service 12 node_name 53 Yes 2025-06-30T11:58:21.168Z blockServiceUnhealthy A block service is unhealthy and SolidFire is attempting to migrate data away from it.
240 2025-06-30T11:28:48.558Z Error service 12 node_name 52 Yes 2025-06-30T11:58:21.167Z blockServiceUnhealthy A block service is unhealthy and SolidFire is attempting to migrate data away from it.
239 2025-06-30T11:28:48.557Z Error service 12 node_name 51 Yes 2025-06-30T11:58:21.166Z blockServiceUnhealthy A block service is unhealthy and SolidFire is attempting to migrate data away from it.
235 2025-06-30T11:23:48.352Z Error cluster 0 0 Yes 2025-06-30T11:57:39.761Z blocksDegraded Only a single complete copy of the block data is accessible. Restore any offline nodes or block services or contact support for assistance.