hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thejas M Nair (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-17585) Improve thread safety when loading dynamic partitions in parallel
Date Sun, 24 Sep 2017 01:22:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16178031#comment-16178031
] 

Thejas M Nair commented on HIVE-17585:
--------------------------------------

For reference these are some exceptions seen -

{code}
WARN  [load-dynamic-partitions-3]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(206))
- MetaStoreClient lost connection. Attempting to reconnect (1 of 24) after 5s. fireListenerEvent
org.apache.thrift.TApplicationException: fire_listener_event failed: out of sequence response
	at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:84)
	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_fire_listener_event(ThriftHiveMetastore.java:4302)
	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4289)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:2088)
	at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:178)
	at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source)
	at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:2248)
	at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1528)
	at org.apache.hadoop.hive.ql.metadata.Hive$2.call(Hive.java:1794)
	at org.apache.hadoop.hive.ql.metadata.Hive$2.call(Hive.java:1785)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
WARN  [load-dynamic-partitions-13]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(206))
- MetaStoreClient lost connection. Attempting to reconnect (1 of 24) after 5s. getPartitionWithAuthInfo
org.apache.thrift.TApplicationException: get_partition_with_auth failed: out of sequence response
	at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:84)
	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_partition_with_auth(ThriftHiveMetastore.java:1977)
	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_partition_with_auth(ThriftHiveMetastore.java:1960)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getPartitionWithAuthInfo(HiveMetaStoreClient.java:1273)
	at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:178)
	at com.sun.proxy.$Proxy5.getPartitionWithAuthInfo(Unknown Source)
	at org.apache.hadoop.hive.metastore.SynchronizedMetaStoreClient.getPartitionWithAuthInfo(SynchronizedMetaStoreClient.java:104)
	at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:2112)
	at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:2053)
	at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1468)
	at org.apache.hadoop.hive.ql.metadata.Hive$2.call(Hive.java:1794)
	at org.apache.hadoop.hive.ql.metadata.Hive$2.call(Hive.java:1785)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
WARN  [load-dynamic-partitions-3]: transport.TIOStreamTransport (TIOStreamTransport.java:close(112))
- Error closing output stream.
java.net.SocketException: Socket closed
	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:116)
	at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
	at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
	at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
	at java.io.FilterOutputStream.close(FilterOutputStream.java:158)
	at org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110)
	at org.apache.thrift.transport.TSocket.close(TSocket.java:235)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.close(HiveMetaStoreClient.java:566)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.reconnect(HiveMetaStoreClient.java:364)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:168)
	at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source)
	at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:2248)
	at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1528)
	at org.apache.hadoop.hive.ql.metadata.Hive$2.call(Hive.java:1794)
	at org.apache.hadoop.hive.ql.metadata.Hive$2.call(Hive.java:1785)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

{code}

> Improve thread safety when loading dynamic partitions in parallel
> -----------------------------------------------------------------
>
>                 Key: HIVE-17585
>                 URL: https://issues.apache.org/jira/browse/HIVE-17585
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Tao Li
>            Assignee: Tao Li
>         Attachments: HIVE-17585.1.patch, HIVE-17585.2.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message