metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Justin Leet <justinjl...@gmail.com>
Subject Re: Deploying items to hdfs
Date Tue, 04 Apr 2017 17:01:30 GMT
Actually, so you don't have to dig around, here's the source in Ambari's
Github

https://github.com/apache/ambari/blob/5228e1847bd7b92d7a3379d26002879dbfeafffe/ambari-common/src/main/python/resource_management/libraries/resources/hdfs_resource.py#L59

On Tue, Apr 4, 2017 at 12:59 PM, Justin Leet <justinjleet@gmail.com> wrote:

> Take a look at HdfsResource, like https://github.com/
> apache/incubator-metron/blob/master/metron-deployment/
> packaging/ambari/metron-mpack/src/main/resources/common-
> services/METRON/CURRENT/package/scripts/enrichment_commands.py#L110
>
> If you dig into that function, there's this snippet defining an argument
> for hdfs put essentially:
>
>   # if present - copies file/directory from local path {source} to hadoop
> path - {target}
>   source = ResourceArgument()
>
> I don't know that we've actually used that argument before, so you might
> have to test it out, but it sounds like it'll do what you're looking for.
>
> Justin
>
>
> On Tue, Apr 4, 2017 at 12:43 PM, Otto Fowler <ottobackwards@gmail.com>
> wrote:
>
>> So, if I have RPM’s that install as part of installing metron parsers,
>> I can, after install move or copy things from that install to hdfs?
>>
>> What would be the best approach there?
>>
>>
>> On April 4, 2017 at 12:33:08, David Lyle (dlyle65535@gmail.com) wrote:
>>
>> Hi Otto,
>>
>> No, you can deploy to hdfs via Ambari. There are some examples in the
>> MPack
>> currently.
>>
>> -D...
>>
>>
>> On Tue, Apr 4, 2017 at 12:26 PM, Otto Fowler <ottobackwards@gmail.com>
>> wrote:
>>
>> > Can someone correct me if I am wrong here, but in order for deployment
>> to
>> > put things into hdfs it has to be done through the ansible build and not
>> > the rpm/ambari?
>> > Is that right?
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message