StorageGRID EC リバランスが書き込み可能なノードの不足により即座に失敗する

最後の更新
PDFとして保存

Views:: 7

Visibility:: Public

Votes:: 0

Category:: storagegrid

Specialty:: sgrid

Last Updated:

環境

NetApp StorageGRID
イレイジャーコーディング（EC）リバランス手順

問題

ECリバランス手順は、新しいジョブを開始した直後、またはジョブを再開した直後に、移動操作を一切行わずに失敗します。
- rebalance-data status
  ========================
  JobID: 1234567890
  Site: SiteName
  State: Failure
  Planned Moves: 0
  Completed Moves: 0
  Failed Moves: 0
  Site Imbalance: Unknown
  Retry Rebalance: Yes
  ========================

プライマリ管理ノードから/var/local/log/rebalance-data.logEC修復のジョブが見つかりませんでした：

D, [2026-04-29T12:31:32.611561 #4050370] DEBUG -- : No jobs found for replicated repair for the given parameters {"alert_for_node_repair"=>false, "include_node_repair"=>true, "repair"=>["replicated", "erasure-coded"], "state"=>"running"}
D, [2026-04-29T12:31:32.634167 #4050370] DEBUG -- : No jobs found for erasure-coded repair for the given parameters {"alert_for_node_repair"=>false, "include_node_repair"=>true, "repair"=>["replicated", "erasure-coded"], "state"=>"running"}
I, [2026-04-29T12:31:32.723691 #4050370] INFO -- : EC Site rebalance is restarted successfully.

ECジョブリーダーよりストレージノード /var/local/log/bycast.log レコードの再試行制限に達しました：

Apr 29 12:28:44 nodename ADE: |21014662 1884999497 ECJM ???? 2026-04-29T12:28:44.205607| NOTICE 0040 ECJM: Starting job 1234567890: Site Rebalance - Group ID 20.
Apr 29 12:28:44 nodename ADE: |21014662 1884999497 ECJM ^RDY 2026-04-29T12:28:44.231500| NOTICE 0234 ECJM: 1234567890(rebalance 20): Retrying
Apr 29 12:28:44 nodename ADE: |21014662 1884999497 ECJM ^RDY 2026-04-29T12:28:44.231579| NOTICE 1283 ECJM: 1234567890(rebalance 20): saving state. status: JOBSTATUS_IN_PROGRESS
Apr 29 12:28:44 nodename ADE: |21014662 1884999497 ECJM EVIU 2026-04-29T12:28:44.254866| NOTICE 0281 ECJM: 1234567890(rebalance 20): Already have 0 recommendations, asking for a further 200...
Apr 29 12:28:46 nodename ADE: |21014662 1884999497 ECJM EVIU 2026-04-29T12:28:46.179064| NOTICE 0295 ECJM: 1234567890(rebalance 20): received message GVCR
Apr 29 12:28:46 nodename ADE: |21014662 1884999497 ECJM EVIU 2026-04-29T12:28:46.179083| WARNING 0300 ECJM: 1234567890(rebalance 20): Got error SUNV while trying to retrieve VCS moves. Retrying.
Apr 29 12:28:46 nodename ADE: |21014662 1884999497 ECJM GVCR 2026-04-29T12:28:46.179112| NOTICE 1283 ECJM: 1234567890(rebalance 20): saving state. status: JOBSTATUS_PAUSED
Apr 29 12:28:46 nodename ADE: |21014662 1884999497 ECJM ^RDY 2026-04-29T12:28:46.270051| WARNING 0062 ECJM: Caught exception 'ENFORCE failed: !"Exhausted retry limit or retry time for getting move recommendations"' when running job 1234567890: Site Rebalance - Group ID 20.
Apr 29 12:28:46 nodename ADE: |21014662 1884999497 ECJM ^RDY 2026-04-29T12:28:46.292765| ERROR 1125 PROC: Exception: /build/src/modules/ErasureCoding/EC_JobManager_Module/SiteRebalanceJob.cc(382): Throw in function getMoveRecommendations#012Dynamic exception type: boost::wrapexcept<std::runtime_error>#012std::exception::what: ENFORCE failed: !"Exhausted retry limit or retry time for getting move recommendations"#012
一部のストレージノードは読み取り専用状態になっています。
ILM placement unachievableアラートが表示される場合もあります。