hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sushanth Sowmyan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9674) *DropPartitionEvent should handle partition-sets.
Date Wed, 29 Apr 2015 06:37:06 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518827#comment-14518827
] 

Sushanth Sowmyan commented on HIVE-9674:
----------------------------------------

All the failures listed here have nothing to do with the patch itself. I wondered about the
org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection failure, since it's
in HCat's package. However, that is not related to this patch, and on retesting locally, it
seems to pass. Also, that's likely to be related to ACID rather than this, since its error
log looks like the following:

{noformat}
java.sql.SQLException: Table/View 'TXNS' already exists in Schema 'APP'.
	at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
	at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
	at org.apache.derby.impl.sql.catalog.DataDictionaryImpl.duplicateDescriptorException(Unknown
Source)
	at org.apache.derby.impl.sql.catalog.DataDictionaryImpl.addDescriptor(Unknown Source)
	at org.apache.derby.impl.sql.execute.CreateTableConstantAction.executeConstantAction(Unknown
Source)
	at org.apache.derby.impl.sql.execute.MiscResultSet.open(Unknown Source)
	at org.apache.derby.impl.sql.GenericPreparedStatement.executeStmt(Unknown Source)
	at org.apache.derby.impl.sql.GenericPreparedStatement.execute(Unknown Source)
	at org.apache.derby.impl.jdbc.EmbedStatement.executeStatement(Unknown Source)
	at org.apache.derby.impl.jdbc.EmbedStatement.execute(Unknown Source)
	at org.apache.derby.impl.jdbc.EmbedStatement.execute(Unknown Source)
	at org.apache.hadoop.hive.metastore.txn.TxnDbUtil.prepDb(TxnDbUtil.java:72)
	at org.apache.hadoop.hive.metastore.txn.TxnDbUtil.prepDb(TxnDbUtil.java:131)
	at org.apache.hive.hcatalog.streaming.TestStreaming.<init>(TestStreaming.java:157)
{noformat}

> *DropPartitionEvent should handle partition-sets.
> -------------------------------------------------
>
>                 Key: HIVE-9674
>                 URL: https://issues.apache.org/jira/browse/HIVE-9674
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.14.0
>            Reporter: Mithun Radhakrishnan
>            Assignee: Mithun Radhakrishnan
>         Attachments: HIVE-9674.2.patch, HIVE-9674.3.patch, HIVE-9674.4.patch, HIVE-9674.5.patch
>
>
> Dropping a set of N partitions from a table currently results in N DropPartitionEvents
(and N PreDropPartitionEvents) being fired serially. This is wasteful, especially so for large
N. It also makes it impossible to even try to run authorization-checks on all partitions in
a batch.
> Taking the cue from HIVE-9609, we should compose an {{Iterable<Partition>}} in
the event, and expose them via an {{Iterator}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message