hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Igor Kryvenko (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-17683) Annotate Query Plan with locking information
Date Tue, 17 Jul 2018 09:27:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16546207#comment-16546207
] 

Igor Kryvenko edited comment on HIVE-17683 at 7/17/18 9:26 AM:
---------------------------------------------------------------

Seems like failure is not related
{code:java}
<error message="Could not open client transport with JDBC Uri: jdbc:hive2://localhost:42546/:
java.net.ConnectException: Connection refused" type="java.sql.SQLException">
<![CDATA[
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:42546/:
java.net.ConnectException: Connection refused at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:252)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107) at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:247) at org.apache.hive.beeline.TestBeeLineWithArgs.createTable(TestBeeLineWithArgs.java:112)
at org.apache.hive.beeline.TestBeeLineWithArgs.preTests(TestBeeLineWithArgs.java:102) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340)
at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413)
Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection
refused at org.apache.thrift.transport.TSocket.open(TSocket.java:226) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:266)
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at
org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:339) at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:224)
... 23 more Caused by: java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native
Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589)
at org.apache.thrift.transport.TSocket.open(TSocket.java:221) ... 27 more
]]>
</error>
{code}
I will attach the same patch to check this.

 

Locally it also works fine:
{code}
[INFO] Running org.apache.hive.beeline.TestBeeLineWithArgs
[WARNING] Tests run: 54, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 237.004 s - in
org.apache.hive.beeline.TestBeeLineWithArgs
[INFO] 
[INFO] Results:
[INFO] 
[WARNING] Tests run: 54, Failures: 0, Errors: 0, Skipped: 2
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 05:00 min
[INFO] Finished at: 2018-07-17T12:25:43+03:00
[INFO] Final Memory: 136M/2524M
[INFO] ------------------------------------------------------------------------

 {code}


was (Author: ikryvenko):
Seems like failure is not related 
{code}
<error message="Could not open client transport with JDBC Uri: jdbc:hive2://localhost:42546/:
java.net.ConnectException: Connection refused" type="java.sql.SQLException">
<![CDATA[
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:42546/:
java.net.ConnectException: Connection refused at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:252)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107) at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:247) at org.apache.hive.beeline.TestBeeLineWithArgs.createTable(TestBeeLineWithArgs.java:112)
at org.apache.hive.beeline.TestBeeLineWithArgs.preTests(TestBeeLineWithArgs.java:102) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340)
at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413)
Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection
refused at org.apache.thrift.transport.TSocket.open(TSocket.java:226) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:266)
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at
org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:339) at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:224)
... 23 more Caused by: java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native
Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589)
at org.apache.thrift.transport.TSocket.open(TSocket.java:221) ... 27 more
]]>
</error>
{code}
I will attach the same patch to check this.


> Annotate Query Plan with locking information
> --------------------------------------------
>
>                 Key: HIVE-17683
>                 URL: https://issues.apache.org/jira/browse/HIVE-17683
>             Project: Hive
>          Issue Type: New Feature
>          Components: Transactions
>            Reporter: Eugene Koifman
>            Assignee: Igor Kryvenko
>            Priority: Critical
>         Attachments: HIVE-17683.01.patch, HIVE-17683.02.patch, HIVE-17683.03.patch
>
>
> Explore if it's possible to add info about what locks will be asked for to the query
plan.
> Lock acquisition (for Acid Lock Manager) is done in DbTxnManager.acquireLocks() which
is called once the query starts running.  Would need to refactor that.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message