fluo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [fluo-muchos] keith-turner commented on issue #270: Support Accumulo installs on Microsoft Azure
Date Thu, 15 Aug 2019 21:57:10 GMT
keith-turner commented on issue #270: Support Accumulo installs on Microsoft Azure
URL: https://github.com/apache/fluo-muchos/pull/270#issuecomment-521812086
 
 
   I tried running this branch against EC2 to setup a 12 node cluster and I ran into a few
issues.
   
     * Accumulo 2.0 does not download, I am still trying to figure out why.  Looking at the
changes made to the Accumulo ansible files I don't see any problems.  I am going to look into
this some more tomorrow.
     * I am seeing some errors with the zookeeper setup because I chose a leader node type
that only had a single ephemeral drive.
     * I saw some errors with the jps commands, but these did not seem to cause a problem.
   
   
   Below are the zookeeper setup errors I saw.  The leader nodes only have `/media/ephemeral0`
   
   ```
   ASK [zookeeper : Create zookeeper log dir] ****************************************************************************************************************************************************************
   Thursday 15 August 2019  21:40:11 +0000 (0:00:01.844)       0:03:27.249 ******* 
   fatal: [leader2]: FAILED! => {"changed": false, "msg": "There was an issue creating
/media/ephemeral1 as requested: [Errno 13] Permission denied: '/media/ephemeral1'", "path":
"/media/ephemeral1/logs/zookeeper"}
   fatal: [leader3]: FAILED! => {"changed": false, "msg": "There was an issue creating
/media/ephemeral1 as requested: [Errno 13] Permission denied: '/media/ephemeral1'", "path":
"/media/ephemeral1/logs/zookeeper"}
   changed: [worker1]
   fatal: [leader1]: FAILED! => {"changed": false, "msg": "There was an issue creating
/media/ephemeral1 as requested: [Errno 13] Permission denied: '/media/ephemeral1'", "path":
"/media/ephemeral1/logs/zookeeper"}
   changed: [worker6]
   changed: [worker7]
   changed: [worker8]
   changed: [worker9]
   changed: [worker4]
   changed: [worker5]
   changed: [worker3]
   changed: [worker2]
   ```
   
   Below are the jps errors and the failure to download Accumulo.
   
   ```
   PLAY [journalnode] *****************************************************************************************************************************************************************************************
   
   PLAY [namenode[0]] *****************************************************************************************************************************************************************************************
   
   PLAY [namenode[0]] *****************************************************************************************************************************************************************************************
   
   PLAY [namenode] ********************************************************************************************************************************************************************************************
   
   PLAY [namenode[0]] *****************************************************************************************************************************************************************************************
   
   PLAY [namenode[1]] *****************************************************************************************************************************************************************************************
   
   PLAY [workers] *********************************************************************************************************************************************************************************************
   
   TASK [Check if DataNode is running] ************************************************************************************************************************************************************************
   Thursday 15 August 2019  21:41:31 +0000 (0:00:00.576)       0:04:47.205 ******* 
   fatal: [worker1]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep
-v grep", "delta": "0:00:00.139149", "end": "2019-08-15 21:41:32.007976", "msg": "non-zero
return code", "rc": 1, "start": "2019-08-15 21:41:31.868827", "stderr": "", "stderr_lines":
[], "stdout": "", "stdout_lines": []}
   ...ignoring
   fatal: [worker2]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep
-v grep", "delta": "0:00:00.143752", "end": "2019-08-15 21:41:32.085573", "msg": "non-zero
return code", "rc": 1, "start": "2019-08-15 21:41:31.941821", "stderr": "", "stderr_lines":
[], "stdout": "", "stdout_lines": []}
   ...ignoring
   fatal: [worker4]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep
-v grep", "delta": "0:00:00.143829", "end": "2019-08-15 21:41:32.101101", "msg": "non-zero
return code", "rc": 1, "start": "2019-08-15 21:41:31.957272", "stderr": "", "stderr_lines":
[], "stdout": "", "stdout_lines": []}
   ...ignoring
   fatal: [worker3]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep
-v grep", "delta": "0:00:00.147803", "end": "2019-08-15 21:41:32.102506", "msg": "non-zero
return code", "rc": 1, "start": "2019-08-15 21:41:31.954703", "stderr": "", "stderr_lines":
[], "stdout": "", "stdout_lines": []}
   ...ignoring
   fatal: [worker5]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep
-v grep", "delta": "0:00:00.131862", "end": "2019-08-15 21:41:32.120846", "msg": "non-zero
return code", "rc": 1, "start": "2019-08-15 21:41:31.988984", "stderr": "", "stderr_lines":
[], "stdout": "", "stdout_lines": []}
   ...ignoring
   fatal: [worker6]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep
-v grep", "delta": "0:00:00.146547", "end": "2019-08-15 21:41:32.143614", "msg": "non-zero
return code", "rc": 1, "start": "2019-08-15 21:41:31.997067", "stderr": "", "stderr_lines":
[], "stdout": "", "stdout_lines": []}
   ...ignoring
   fatal: [worker8]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep
-v grep", "delta": "0:00:00.130241", "end": "2019-08-15 21:41:32.165315", "msg": "non-zero
return code", "rc": 1, "start": "2019-08-15 21:41:32.035074", "stderr": "", "stderr_lines":
[], "stdout": "", "stdout_lines": []}
   ...ignoring
   fatal: [worker7]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep
-v grep", "delta": "0:00:00.142849", "end": "2019-08-15 21:41:32.183773", "msg": "non-zero
return code", "rc": 1, "start": "2019-08-15 21:41:32.040924", "stderr": "", "stderr_lines":
[], "stdout": "", "stdout_lines": []}
   ...ignoring
   fatal: [worker9]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep
-v grep", "delta": "0:00:00.131396", "end": "2019-08-15 21:41:32.211191", "msg": "non-zero
return code", "rc": 1, "start": "2019-08-15 21:41:32.079795", "stderr": "", "stderr_lines":
[], "stdout": "", "stdout_lines": []}
   ...ignoring
   
   TASK [start datanodes] *************************************************************************************************************************************************************************************
   Thursday 15 August 2019  21:41:32 +0000 (0:00:00.663)       0:04:47.868 ******* 
   changed: [worker1]
   changed: [worker2]
   changed: [worker3]
   changed: [worker4]
   changed: [worker5]
   changed: [worker6]
   changed: [worker7]
   changed: [worker8]
   changed: [worker9]
   
   PLAY [resourcemanager] *************************************************************************************************************************************************************************************
   
   PLAY [metrics] *********************************************************************************************************************************************************************************************
   
   PLAY [proxy] ***********************************************************************************************************************************************************************************************
   
   PLAY [all:!_] *************************************************************************************************************************************************************************************************
   
   TASK [accumulo : install accumulo from tarball] ************************************************************************************************************************************************************
   Thursday 15 August 2019  21:41:34 +0000 (0:00:02.700)       0:04:50.568 ******* 
   fatal: [worker1]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz'
on the Ansible Controller.\nIf you are using a module and expect the file to exist on the
remote, see the remote_src option"}
   fatal: [worker7]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz'
on the Ansible Controller.\nIf you are using a module and expect the file to exist on the
remote, see the remote_src option"}
   fatal: [worker6]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz'
on the Ansible Controller.\nIf you are using a module and expect the file to exist on the
remote, see the remote_src option"}
   fatal: [worker8]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz'
on the Ansible Controller.\nIf you are using a module and expect the file to exist on the
remote, see the remote_src option"}
   fatal: [worker9]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz'
on the Ansible Controller.\nIf you are using a module and expect the file to exist on the
remote, see the remote_src option"}
   fatal: [worker4]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz'
on the Ansible Controller.\nIf you are using a module and expect the file to exist on the
remote, see the remote_src option"}
   fatal: [worker5]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz'
on the Ansible Controller.\nIf you are using a module and expect the file to exist on the
remote, see the remote_src option"}
   fatal: [worker3]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz'
on the Ansible Controller.\nIf you are using a module and expect the file to exist on the
remote, see the remote_src option"}
   fatal: [worker2]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz'
on the Ansible Controller.\nIf you are using a module and expect the file to exist on the
remote, see the remote_src option"}
   
   PLAY [accumulomaster[0]] ***********************************************************************************************************************************************************************************
   
   PLAY [accumulo] ********************************************************************************************************************************************************************************************
   
   PLAY [workers] *********************************************************************************************************************************************************************************************
   
   PLAY [accumulomaster] **************************************************************************************************************************************************************************************
   ```
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message