sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peter Cseh (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SQOOP-3177) ParquetJob should check for active tokens in a more reliable way
Date Fri, 28 Apr 2017 14:02:04 GMT

     [ https://issues.apache.org/jira/browse/SQOOP-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Peter Cseh updated SQOOP-3177:
------------------------------
    Attachment: SQOOP-3177-1.patch

Attaching first version of the fix.
I don't like the fact that we need the service's name that's in the token to check for it.
I'll look into it next week. 
Any ideas for a better check?

> ParquetJob should check for active tokens in a more reliable way
> ----------------------------------------------------------------
>
>                 Key: SQOOP-3177
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3177
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.4.5
>            Reporter: Peter Cseh
>         Attachments: SQOOP-3177-1.patch
>
>
> Right now ParquetJob checks whether there is a Hive token in the job credentials by calling
[conf.getCredentials.getToken()|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/ParquetJob.java#L112]
with the alias "HCat Token".
> This is not finding delegation tokens issued by Oozie as Oozie uses a different alias.
> Sqoop could rely on {{org.apache.hadoop.hive.thrift.DelegationTokenSelector}} to look
for available delegation tokens.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message