hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11507) Hadoop RPC Authentication problem with different user locale
Date Fri, 23 Jan 2015 19:39:35 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14289804#comment-14289804

Steve Loughran commented on HADOOP-11507:

+1, committing. 

Allen, it's a feature of turkish that {{"I".toLower()!="i"}} & vice versa, which is why
you should always spec a local when doing case conversions, and *never* use {{String.equalsIgnoreCase()}}.
Now you know.

> Hadoop RPC Authentication problem with different user locale
> ------------------------------------------------------------
>                 Key: HADOOP-11507
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11507
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 2.6.0, 2.5.2
>            Reporter: Talat UYARER
>            Assignee: Talat UYARER
>            Priority: Minor
>             Fix For: 2.7.0
>         Attachments: HADOOP-11507.patch
> When I try to use hadoop mapreduce framework with Turkish locale that set default  mapreduce.map.java.opts
and  mapreduce.reduce.java.opts to -Duser.language=tr. It throws exception. 
> After Long research, i found a little bug in org.apache.hadoop.security.SaslPropertiesResolver
line 68. default setting of hadoop.rpc.protection is authentication. When i make locale Turkish
authentication parameter with toUpperCase become AUTHENTÄ°CATÄ°ON. Please attention to dotted
big i. This is a Turkish letter. It is very similar big i, it just have addition dot. :)
> IMHO who-one use upper or lowercase method for settings, it should use Locale.ENGLISH.
I created a patch file. But I could not test it. I can not find which tests should i run.
If you show me, I will be glad.  
> BTW I think, Hadoop Tests  should be run different locale. 
> {block}
> ERROR operation.Operation: Error running hive query: 
> org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED:
Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
>         at org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:147)
>         at org.apache.hive.service.cli.operation.SQLOperation.access$000(SQLOperation.java:69)
>         at org.apache.hive.service.cli.operation.SQLOperation$1$1.run(SQLOperation.java:200)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:415)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
>         at org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:502)
>         at org.apache.hive.service.cli.operation.SQLOperation$1.run(SQLOperation.java:213)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:745)
> {block}
> p.s. Exception is generated by a Hive query. It can be generated by any map reduce job.

This message was sent by Atlassian JIRA

View raw message