hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11319) CTAS with location qualifier overwrites directories
Date Mon, 03 Aug 2015 04:26:04 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651405#comment-14651405
] 

Hive QA commented on HIVE-11319:
--------------------------------



{color:red}Overall{color}: -1 no tests executed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12748382/HIVE-11319.2.patch

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4794/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4794/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4794/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Tests exited with: ExecutionException: org.apache.hive.ptest.execution.ssh.SSHExecutionException:
RSyncResult [localFile=/data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-4794/succeeded/TestEmbeddedHiveMetaStore,
remoteFile=/home/hiveptest/54.158.176.48-hiveptest-0/logs/, getExitCode()=12, getException()=null,
getUser()=hiveptest, getHost()=54.158.176.48, getInstance()=0]: 'Address 54.158.176.48 maps
to ec2-54-158-176-48.compute-1.amazonaws.com, but this does not map back to the address -
POSSIBLE BREAK-IN ATTEMPT!
receiving incremental file list
TEST-TestEmbeddedHiveMetaStore-TEST-org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.xml
           0   0%    0.00kB/s    0:00:00
        8612 100%    8.21MB/s    0:00:00 (xfer#1, to-check=3/5)
hive.log
           0   0%    0.00kB/s    0:00:00
rsync: write failed on "/data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-4794/succeeded/TestEmbeddedHiveMetaStore/hive.log":
No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(301) [receiver=3.0.6]
rsync: connection unexpectedly closed (220 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(600) [generator=3.0.6]
Address 54.158.176.48 maps to ec2-54-158-176-48.compute-1.amazonaws.com, but this does not
map back to the address - POSSIBLE BREAK-IN ATTEMPT!
receiving incremental file list
hive.log
           0   0%    0.00kB/s    0:00:00
rsync: write failed on "/data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-4794/succeeded/TestEmbeddedHiveMetaStore/hive.log":
No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(301) [receiver=3.0.6]
rsync: connection unexpectedly closed (220 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(600) [generator=3.0.6]
Address 54.158.176.48 maps to ec2-54-158-176-48.compute-1.amazonaws.com, but this does not
map back to the address - POSSIBLE BREAK-IN ATTEMPT!
receiving incremental file list
./
hive.log
           0   0%    0.00kB/s    0:00:00
rsync: write failed on "/data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-4794/succeeded/TestEmbeddedHiveMetaStore/hive.log":
No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(301) [receiver=3.0.6]
rsync: connection unexpectedly closed (220 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(600) [generator=3.0.6]
Address 54.158.176.48 maps to ec2-54-158-176-48.compute-1.amazonaws.com, but this does not
map back to the address - POSSIBLE BREAK-IN ATTEMPT!
receiving incremental file list
./
hive.log
           0   0%    0.00kB/s    0:00:00
rsync: write failed on "/data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-4794/succeeded/TestEmbeddedHiveMetaStore/hive.log":
No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(301) [receiver=3.0.6]
rsync: connection unexpectedly closed (220 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(600) [generator=3.0.6]
Address 54.158.176.48 maps to ec2-54-158-176-48.compute-1.amazonaws.com, but this does not
map back to the address - POSSIBLE BREAK-IN ATTEMPT!
receiving incremental file list
./
hive.log
           0   0%    0.00kB/s    0:00:00
rsync: write failed on "/data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-4794/succeeded/TestEmbeddedHiveMetaStore/hive.log":
No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(301) [receiver=3.0.6]
rsync: connection unexpectedly closed (220 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(600) [generator=3.0.6]
'
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12748382 - PreCommit-HIVE-TRUNK-Build

> CTAS with location qualifier overwrites directories
> ---------------------------------------------------
>
>                 Key: HIVE-11319
>                 URL: https://issues.apache.org/jira/browse/HIVE-11319
>             Project: Hive
>          Issue Type: Bug
>          Components: Parser
>    Affects Versions: 0.14.0, 1.0.0, 1.2.0
>            Reporter: Yongzhi Chen
>            Assignee: Yongzhi Chen
>         Attachments: HIVE-11319.1.patch, HIVE-11319.2.patch
>
>
> CTAS with location clause acts as an insert overwrite. This can cause problems when there
sub directories with in a directory.
> This cause some users accidentally wipe out directories with very important data. We
should  ban CTAS with location to a non-empty directory. 
> Reproduce:
> create table ctas1  
> location '/Users/ychen/tmp' 
> as 
> select * from jsmall limit 10;
> create table ctas2  
> location '/Users/ychen/tmp' 
> as 
> select * from jsmall limit 5;
> Both creates will succeed. But value in table ctas1 will be replaced by ctas2 accidentally.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message