hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajesh Balamohan (Jira)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-22752) HiveMetastore addWriteNotificationLog should be invoked only when listeners are enabled
Date Tue, 21 Jan 2020 03:17:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-22752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rajesh Balamohan updated HIVE-22752:
------------------------------------
    Description: 
[https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java#L8109]

 

Even though listeners are turned off, it gets executed and causes load on the system. This
should be guarded by listener checks.

 
{noformat}
	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
	at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1589)
	at org.apache.hadoop.fs.FileSystem.isDirectory(FileSystem.java:1700)
	at org.apache.hadoop.hive.ql.metadata.Hive.addInsertFileInformation(Hive.java:3185)
	at org.apache.hadoop.hive.ql.metadata.Hive.addWriteNotificationLog(Hive.java:3138)
	at org.apache.hadoop.hive.ql.metadata.Hive.addWriteNotificationLog(Hive.java:3123)
	at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:2238){noformat}

  was:
[https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java#L8109]

 

Even though listeners are turned off, it gets executed and causes load on the system. This
should be guarded by listener checks.


> HiveMetastore addWriteNotificationLog should be invoked only when listeners are enabled
> ---------------------------------------------------------------------------------------
>
>                 Key: HIVE-22752
>                 URL: https://issues.apache.org/jira/browse/HIVE-22752
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Rajesh Balamohan
>            Priority: Minor
>
> [https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java#L8109]
>  
> Even though listeners are turned off, it gets executed and causes load on the system.
This should be guarded by listener checks.
>  
> {noformat}
> 	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> 	at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1589)
> 	at org.apache.hadoop.fs.FileSystem.isDirectory(FileSystem.java:1700)
> 	at org.apache.hadoop.hive.ql.metadata.Hive.addInsertFileInformation(Hive.java:3185)
> 	at org.apache.hadoop.hive.ql.metadata.Hive.addWriteNotificationLog(Hive.java:3138)
> 	at org.apache.hadoop.hive.ql.metadata.Hive.addWriteNotificationLog(Hive.java:3123)
> 	at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:2238){noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message