[ https://issues.apache.org/jira/browse/HIVE-10228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491328#comment-14491328 ] Hive QA commented on HIVE-10228: -------------------------------- {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12724677/HIVE-10228.patch {color:red}ERROR:{color} -1 due to 102 failed/errored test(s), 8675 tests executed *Failed tests:* {noformat} TestMinimrCliDriver-bucketmapjoin6.q-constprog_partitioner.q-infer_bucket_sort_dyn_part.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-external_table_with_space_in_location_path.q-infer_bucket_sort_merge.q-auto_sortmerge_join_16.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-groupby2.q-import_exported_table.q-bucketizedhiveinputformat.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-index_bitmap3.q-stats_counter_partitioned.q-temp_table_external.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-infer_bucket_sort_map_operators.q-join1.q-bucketmapjoin7.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-infer_bucket_sort_num_buckets.q-disable_merge_for_bucketing.q-uber_reduce.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-infer_bucket_sort_reducers_power_two.q-scriptfile1.q-scriptfile1_win.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-leftsemijoin_mr.q-load_hdfs_file_with_space_in_the_name.q-root_dir_external_table.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-list_bucket_dml_10.q-bucket_num_reducers.q-bucket6.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-load_fs2.q-file_with_header_footer.q-ql_rewrite_gbtoidx_cbo_1.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-parallel_orderby.q-reduce_deduplicate.q-ql_rewrite_gbtoidx_cbo_2.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-ql_rewrite_gbtoidx.q-smb_mapjoin_8.q - did not produce a TEST-*.xml file TestMinimrCliDriver-schemeAuthority2.q-bucket4.q-input16_cc.q-and-1-more - did not produce a TEST-*.xml file org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testAlterPartition org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testAlterTable org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testAlterViewParititon org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testColumnStatistics org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testComplexTable org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testConcurrentMetastores org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testDropTable org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testFilterLastPartition org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testFilterSinglePartition org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testListPartitionNames org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testListPartitions org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testPartition org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testPartitionFilter org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testRenamePartition org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testSimpleTable org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testTableDatabase org.apache.hadoop.hive.metastore.TestHiveMetaTool.testExecuteJDOQL org.apache.hadoop.hive.metastore.TestHiveMetaTool.testListFSRoot org.apache.hadoop.hive.metastore.TestHiveMetaTool.testUpdateFSRootLocation org.apache.hadoop.hive.metastore.TestMetastoreExpr.testPartitionExpr org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testAlterPartition org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testAlterTable org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testAlterViewParititon org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testColumnStatistics org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testComplexTable org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testConcurrentMetastores org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testDropTable org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testFilterLastPartition org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testFilterSinglePartition org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testListPartitionNames org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testListPartitions org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testPartition org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testPartitionFilter org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testRenamePartition org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testSimpleTable org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testTableDatabase org.apache.hadoop.hive.metastore.TestRetryingHMSHandler.testRetryingHMSHandler org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testAlterPartition org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testAlterTable org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testAlterViewParititon org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testColumnStatistics org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testComplexTable org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testConcurrentMetastores org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testDropTable org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testFilterLastPartition org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testFilterSinglePartition org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testListPartitionNames org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testListPartitions org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testPartition org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testPartitionFilter org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testRenamePartition org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testSimpleTable org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testTableDatabase org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testAlterPartition org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testAlterTable org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testAlterViewParititon org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testColumnStatistics org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testComplexTable org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testConcurrentMetastores org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testDropTable org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testFilterLastPartition org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testFilterSinglePartition org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testListPartitionNames org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testListPartitions org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testPartition org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testPartitionFilter org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testRenamePartition org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testSimpleTable org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testTableDatabase org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testAlterPartition org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testAlterTable org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testAlterViewParititon org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testColumnStatistics org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testComplexTable org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testConcurrentMetastores org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testDropTable org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testFilterLastPartition org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testFilterSinglePartition org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testListPartitionNames org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testListPartitions org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testPartition org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testPartitionFilter org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testRenamePartition org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testSimpleTable org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testTableDatabase org.apache.hive.hcatalog.cli.TestPermsGrp.testCustomPerms org.apache.hive.hcatalog.mapreduce.TestHCatMultiOutputFormat.org.apache.hive.hcatalog.mapreduce.TestHCatMultiOutputFormat org.apache.hive.jdbc.TestJdbcWithMiniHS2.testNewConnectionConfiguration org.apache.hive.jdbc.TestSSL.testSSLFetchHttp {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3389/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3389/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-3389/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 102 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12724677 - PreCommit-HIVE-TRUNK-Build > Changes to Hive Export/Import/DropTable/DropPartition to support replication semantics > -------------------------------------------------------------------------------------- > > Key: HIVE-10228 > URL: https://issues.apache.org/jira/browse/HIVE-10228 > Project: Hive > Issue Type: Sub-task > Components: Import/Export > Affects Versions: 1.2.0 > Reporter: Sushanth Sowmyan > Assignee: Sushanth Sowmyan > Attachments: HIVE-10228.patch > > > We need to update a couple of hive commands to support replication semantics. To wit, we need the following: > EXPORT ... [FOR [METADATA] REPLICATION(“comment”)] > Export will now support an extra optional clause to tell it that this export is being prepared for the purpose of replication. There is also an additional optional clause here, that allows for the export to be a metadata-only export, to handle cases of capturing the diff for alter statements, for example. > Also, if done for replication, the non-presence of a table, or a table being a view/offline table/non-native table is not considered an error, and instead, will result in a successful no-op. > IMPORT ... (as normal) – but handles new semantics > No syntax changes for import, but import will have to change to be able to handle all the permutations of export dumps possible. Also, import will have to ensure that it should update the object only if the update being imported is not older than the state of the object. > DROP TABLE ... FOR REPLICATION('eventid') > Drop Table now has an additional clause, to specify that this drop table is being done for replication purposes, and that the dop should not actually drop the table if the table is newer than that event id specified. > ALTER TABLE ... DROP PARTITION (...) FOR REPLICATION('eventid') > Similarly, Drop Partition also has an equivalent change to Drop Table. > = > In addition, we introduce a new property "repl.last.id", which when tagged on to table properties or partition properties on a replication-destination, holds the effective "state identifier" of the object. -- This message was sent by Atlassian JIRA (v6.3.4#6332)