hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-16188) s3a rename failed during copy, "Unable to copy part" + 200 error code
Date Wed, 13 Mar 2019 19:57:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-16188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792061#comment-16792061
] 

Steve Loughran commented on HADOOP-16188:
-----------------------------------------

{code}
dest/.hive-staging_hive_2019-03-11_05-50-13_382_7297996996718911643-1/_tmp.-ext-10000/ym=201901/001203_0:
com.amazonaws.SdkClientException: Unable to copy part: We encountered an internal error. Please
try again. (Service: Amazon S3; Status Code: 200; Error Code: InternalError; Request ID: 2B0F6CD699E1D9F6):
Unable to copy part: We encountered an internal error. Please try again. (Service: Amazon
S3; Status Code: 200; Error Code: InternalError; Request ID: 2B0F6CD699E1D9F6)
        at org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:147)
        at org.apache.hadoop.fs.s3a.S3AFileSystem.copyFile(S3AFileSystem.java:2198)
        at org.apache.hadoop.fs.s3a.S3AFileSystem.innerRename(S3AFileSystem.java:915)
        at org.apache.hadoop.fs.s3a.S3AFileSystem.rename(S3AFileSystem.java:746)
        at org.apache.hadoop.hive.ql.util.ParallelDirectoryRenamer$1.call(ParallelDirectoryRenamer.java:105)
        at org.apache.hadoop.hive.ql.util.ParallelDirectoryRenamer$1.call(ParallelDirectoryRenamer.java:101)
        ... 4 more
Caused by: com.amazonaws.SdkClientException: Unable to copy part: We encountered an internal
error. Please try again. (Service: Amazon S3; Status Code: 200; Error Code: InternalError;
Request ID: 2B0F6CD699E1D9F6)
        at com.amazonaws.services.s3.transfer.internal.CompleteMultipartCopy.collectPartETags(CompleteMultipartCopy.java:117)
        at com.amazonaws.services.s3.transfer.internal.CompleteMultipartCopy.call(CompleteMultipartCopy.java:79)
        at com.amazonaws.services.s3.transfer.internal.CompleteMultipartCopy.call(CompleteMultipartCopy.java:38)
        ... 4 more
Caused by: com.amazonaws.services.s3.model.AmazonS3Exception: We encountered an internal error.
Please try again. (Service: Amazon S3; Status Code: 200; Error Code: InternalError; Request
ID: 2B0F6CD699E1D9F6), S3 Extended Request ID: 9KWB8D2Tqo27t/5BdpRwrKZ68YdYNLDKuNUHag/jux28rjnxsCOM2/HI38odKBN5/m3R7lzO09Y=
        at com.amazonaws.services.s3.AmazonS3Client.copyPart(AmazonS3Client.java:2024)
        at com.amazonaws.services.s3.transfer.internal.CopyPartCallable.call(CopyPartCallable.java:41)
        at com.amazonaws.services.s3.transfer.internal.CopyPartCallable.call(CopyPartCallable.java:28)
{code}

> s3a rename failed during copy, "Unable to copy part" + 200 error code
> ---------------------------------------------------------------------
>
>                 Key: HADOOP-16188
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16188
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.2.0
>            Reporter: Steve Loughran
>            Priority: Minor
>
> Error during a rename where AWS S3 seems to have some internal error *which is not retried
and returns status code 200"
> {code}
> com.amazonaws.SdkClientException: Unable to copy part: We encountered an internal error.
Please try again. (Service: Amazon S3; Status Code: 200; Error Code: InternalError;
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message