OpenStack での複数の Snapshot の同時削除が「 ERROR_Deleting 」で失敗する
環境
- Element ソフトウェア 12.3 以前
- OpenStack Queens のようなサービス
問題
OpenStack での複数の Snapshot の同時削除が失敗して次のメッセージが表示される：
- Snapshot ステータスが「 ERROR_Deleting 」と表示される
- 次のトレースバックが表示されます
cinder.log
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server [req-51f56f79-37a7-4dfc-9502-8fe743830eda e0bdb7eb798846e794e9a124f30e5542 98f1d3382f234278a90053c0aa081600 - 562bfa8e1b904076931ebdf1dfdcd3fa 562bfa8e1b904076931ebdf1dfdcd3fa] Exception during message handling: SolidFireAPIException: API response: {u'id': None, u'error': {u'message': u'Snapshot 289023 does not exist.', u'code': 500, u'name ': u'xSnapshotIDDoesNotExist'}} 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server Traceback (most recent call last): 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 166, in _process_incoming 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server File "<string>", line 2, in delete_snapshot 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/cinder/coordination.py", line 151, in _synchronized 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server return f(*a, **k) 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 1163, in delete_snapshot 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server snapshot.save() 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server self.force_reraise() 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 1153, in delete_snapshot 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server self.driver.delete_snapshot(snapshot) 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/solidfire.py", line 1563, in delete_snapshot 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server sf_snaps = self._get_sf_snapshots(sf_vol['volumeID']) 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/solidfire.py", line 961, in _get_sf_snapshots 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server 'ListSnapshots', params, version='6.0')['result']['snapshots'] 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/solidfire.py", line 118, in func_retry 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server return f(*args, **kwargs) 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/solidfire.py", line 529, in _issue_api_request 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server raise exception.SolidFireAPIException(msg) 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server SolidFireAPIException: API response: {u'id': None, u'error': {u'message': u'Snapshot 289023 does not exist.', u'code': 500, u'name': u'xSnapshotIDDoesNotExist'}} 2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server
- ClusterEvent には次のメッセージが表示されます
API response: {u'id': None, u'error': {u'message': u'Snapshot XXXXXX does not exist.', u'code': 500, u'name': u'xSnapshotIDDoesNotExist'}