ElasticSearch のインデックス作成に失敗すると、 OnCommand Insight でパフォーマンスの問題が発生します

最後の更新
PDFとして保存

Views:: 131

Visibility:: Public

Votes:: 0

Category:: oncommand-insight<a>OCI</a><a>Elasticsearch</a><a>OnCommand データウェアハウス（DWH）</a><a>OnCommand Insight</a><a>1074147</a>

Specialty:: oci

Last Updated:

環境

OnCommand Insight （ OCI ） 7.x

問題

ElasticSearch でインデックスを作成できなかったことに関連する問題を次に示します。これらは、一緒に表示することも、別々に表示することも

WebUI の検索速度が遅い
OCI サーバの CPU 使用率が高い
OCI サーバのメモリ使用率が高い
OCI サーバ上のファイルシステムがほぼフル / フルになっています
WebUI にアクセスしようとすると、 404 Page Not Found エラーメッセージが表示されます
データソースがエラー "" で失敗Internal error: Cannot update server (Server returned HTTP response code: 500 for URLしました "

server_indexer.log （）に\SANscreen\wildfly\standalone\logは、次のような失敗したインデックスメッセージが表示されることがあります。

2018-01-15 20:35:00,436 ERROR [EJB default - 7] QueryIndexBuilder (QueryIndexBuilder.java:195) - Error indexing InternalVolume

 com.netapp.oci.es.ElasticsearchException: [bulkIndexById][INDEX_NAME:oci-inventory-internalvolume-2018-01-15-20-33] [ANOMALY_INDEX_TYPE: internalvolume] [IDS: [7864440,

Caused by: com.netapp.oci.es.ElasticsearchException: Error bulk indexing data. failure in bulk

execution:

[19439]: index [oci-inventory-internalvolume-2018-01-23-07-56], type [internalvolume], id [11609

24], message [java.lang.IllegalArgumentException: Document contains at least one immense term

in field="annotationValues.text.Automounter Path" (whose UTF8 encoding is longer than the max l

ength 32766), all of which were skipped. Please correct the analyzer to not produce such terms. T

he prefix of the first immense term is: '[47, 105, 99, 101, 110, 103, 47, 100, 102, 109, 47, 114, 103,

98, 44, 32, 47, 105, 99, 101, 110, 103, 47, 100, 102, 109, 47, 98, 108, 97]...', original message: by

tes can be at most 32766 in length; got 37802]

server.log （にあります）で\SANscreen\wildfly\standalone\logは、次のような失敗メッセージが表示されることがあります。

2019-06-18 07:11:26,296 ERROR [default task-33057] OriginatorWorkingSet(OriginatorWorkingSet.java:488) - <datasource> failed on submit, due to: Errors encountered while executing delete extendedData documents. failure in bulk execution: [0]: index [oci-extended-data-v2], type [_doc], id [1871197], message [ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]] [1]: index [oci-extended-data-v2], type [_doc], id [3310508], message [ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]] [2]: index [oci-extended-data-v2], type [_doc], id [1567170], message [ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]] [3]: index [oci-extended-data-v2], type [_doc], id [4478203], message [ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]] [4]: index [oci-extended-data-v2], type [_doc], id [4311330], message [ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]]

OCI-cluster.log （）\SANscreen\program_data\elasticsearch\logsには、次のような失敗メッセージが表示されることがあります。

[2018-03-26T17:55:13,054][WARN ][o.e.c.a.s.ShardStateAction] [<datasource>] [oci-timeseries-qtree-2018-03-11][1] received shard failed for shard id [[oci-timeseries-qtree-2018-03-11][1]], allocation id [sSKYeTqNR46jrWY-rGw1XA], primary term [0], message [failed recovery], failure [RecoveryFailedException[[oci-timeseries-qtree-2018-03-11][1]: Recovery failed on {XXXXXXXX}{6HO5LMOIRYCEAWKINLSCIQ {TB2VITKTREOZQLBQLXWMIG}{127.0.0.1}{127.0.0.1:9310}]; nested: IndexShardRecoveryException[failed recovery]; nested: IllegalStateException[pre-1.4 translog found [F:\NetApp\SANscreen\program_data\elasticsearch\data\nodes\0\indices\KeESoUKHROaLhn6_WseZVQ\1\translog\translog-1.tlog]]; ] org.elasticsearch.indices.recovery.RecoveryFailedException: [oci-timeseries-qtree-2018-03-11][1]: Recovery failed on {XXXXXXXX}{6HO5LMOIRYCEAWKINLSCIQ}{TB2VITKTREOZQLBQLXWMIG}{127.0.0.1}{127.0.0.1:9310}

Caused by: org.elasticsearch.index.shard.IndexShardRecoveryException: failed recovery at org.elasticsearch.index.shard.StoreRecovery.executeRecovery(StoreRecovery.java:299) ~[elasticsearch-5.4.2.jar:5.4.2] at org.elasticsearch.index.shard.StoreRecovery.recoverFromStore(StoreRecovery.java:88) ~[elasticsearch-5.4.2.jar:5.4.2] at org.elasticsearch.index.shard.IndexShard.recoverFromStore(IndexShard.java:1238) ~[elasticsearch-5.4.2.jar:5.4.2] at org.elasticsearch.index.shard.IndexShard.lambda$startRecovery$1(IndexShard.java:1486) ~[elasticsearch-5.4.2.jar:5.4.2] ... 4 more Caused by: java.lang.IllegalStateException: pre-1.4 translog found [F:\NetApp\SANscreen\program_data\elasticsearch\data\nodes\0\indices\KeESoUKHROaLhn6_WseZVQ\1\translog\translog-1.tlog]