phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cristian Armaselu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-975) Can't make bulk loading work
Date Sun, 11 May 2014 17:59:14 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13994627#comment-13994627
] 

Cristian Armaselu commented on PHOENIX-975:
-------------------------------------------

I switched to a local VM cloudera and change the client jar for Hadoop 2
MR jobs completed but now I got file system permissions
I'm running as os unix account cds_user, this is the error:
Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException):
Permission denied: user=hbase, access=WRITE, inode="/tmp/c216155f-a65e-437b-ad8f-16dc1fe819c1/default":cds_user:supergroup:drwxr-xr-x
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:224)
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:204)
	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:152)

The file to load was placed in hdfs:/tmp
I do not understand why should I get a file system exception

I have tried the same thing (hadoop2 client) on the cluster side (6 nodes) and jobs are failing
because of hundreds of exceptions like the below:
java.net.ConnectException: Connection refused
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2014-05-11 17:42:47,628 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to
server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2014-05-11 17:42:47,629 WARN org.apache.zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect



> Can't make bulk loading work
> ----------------------------
>
>                 Key: PHOENIX-975
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-975
>             Project: Phoenix
>          Issue Type: Bug
>    Affects Versions: 3.0.0
>         Environment: Cloudera 4.8.0
>            Reporter: Cristian Armaselu
>
> Copied server jar on all 6 nodes:
> -rw-r--r-- 1 root root 1949565 May  9 19:43 /opt/cloudera/parcels/CDH/lib/hbase/lib/phoenix-core-3.0.0-incubating.jar
> Ran the below command to import an hdfs file in a pre-created table:
> hadoop --config /etc/hadoop/conf/ jar phoenix-core-3.0.0-incubating.jar org.apache.phoenix.mapreduce.CsvBulkLoadTool
-libjars antlr-runtime-3.4.jar --table CUSTOMERS3 --input /tmp/customers.dat
> Got a log of exceptions in the tasks such as:
> 2014-05-11 15:44:40,795 FATAL org.apache.hadoop.mapred.Child: Error running child : java.lang.IncompatibleClassChangeError:
Found interface org.apache.hadoop.mapreduce.Counter, but class was expected
> 	at org.apache.phoenix.mapreduce.CsvToKeyValueMapper$MapperUpsertListener.upsertDone(CsvToKeyValueMapper.java:261)
> 	at org.apache.phoenix.util.csv.CsvUpsertExecutor.execute(CsvUpsertExecutor.java:148)
> 	at org.apache.phoenix.util.csv.CsvUpsertExecutor.execute(CsvUpsertExecutor.java:128)
> 	at org.apache.phoenix.mapreduce.CsvToKeyValueMapper.map(CsvToKeyValueMapper.java:134)
> 	at org.apache.phoenix.mapreduce.CsvToKeyValueMapper.map(CsvToKeyValueMapper.java:65)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:140)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> 	at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:262)
> 2014-05-11 16:05:04,639 WARN org.apache.zookeeper.ClientCnxn: Session 0x0 for server
null, unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
> The MR jobs are killed after they timeout (in 600 sec)



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message