NFSからS3にファイルをコピーするときにCloud Sync が複数のエラーで失敗しました
環境
- Cloud Sync
- AWS S3
問題
- NFSからS3へのコピーを実行しているときにCloud Sync で複数のファイルをコピーできません。
- データブローカーから次のような複数のエラーが報告される
"TimeoutError: socket hang up" , "Error: write EPIPE", "RequestTimeout:"
[WARN] [TRANSFERRER] [1361] [32677] [64137xxxxxxxxxx] RETRYING copy from: {"local":{"path":"mnt/64137xxxxxxxxx/test_src/test1/folder1"}} to: {"s3":{"bucket":"test-input","tags":[],"provider":"s3","storageClass":"STANDARD","region":"eu-xx-1","path":"test1/folder1"}} entry: {"path":"test0_test2","type":"FILE","size":1165827801088,"mode":33184,"uid":207,"gid":205,"mtimeSec":1677791421,"creationTimeSec":1677791421,"inode":955xxxx} TimeoutError: socket hang up
[WARN] [TRANSFERRER] [1361] [32677] [64137xxxxxxxxx] RETRYING copy from: {"local":{"path":"mnt/64137xxxxxxxxx/test_src/test1/folder1"}} to: {"s3":{"bucket":"test-input","tags":[],"provider":"s3","storageClass":"STANDARD","region":"eu-xx-1","path":"test1/folder1"}} entry: {"path":"test0_test2","type":"FILE","size":1221348679680,"mode":33184,"uid":207,"gid":205,"mtimeSec":1677792320,"creationTimeSec":1677792320,"inode":955xxxxx} Error: write EPIPE
[WARN] [TRANSFERRER] [1362] [1968] [64137xxxxxxxxx] RETRYING copy from: {"local":{"path":"mnt/64137xxxxxxxxx/test_src/test1/folder1"}} to: {"s3":{"bucket":"test-input","tags":[],"provider":"s3","storageClass":"STANDARD","region":"eu-xx-1","path":"test1/folder1"}} entry: {"path":"test0_test2","type":"FILE","size":1181281681408,"mode":33184,"uid":207,"gid":205,"mtimeSec":1677792475,"creationTimeSec":1677792475,"inode":955xxxxx} RequestTimeout: Your socket connection to the server was not read from or written to within the timeout period. Idle connections will be closed.