spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Addanki, Santosh Kumar" <santosh.kumar.adda...@sap.com>
Subject RE: Spark And Mapr
Date Wed, 01 Oct 2014 23:09:24 GMT
Hi

We would like to do this in PySpark Environment

i.e something like

test = sc.textFile("maprfs:///user/root/test") or
test = sc.textFile("hdfs:///user/root/test") or


Currently when we try
test = sc.textFile("maprfs:///user/root/test")

It throws the error
No File-System for scheme: maprfs


Best Regards
Santosh



From: Vladimir Rodionov [mailto:vrodionov@splicemachine.com]
Sent: Wednesday, October 01, 2014 3:59 PM
To: Addanki, Santosh Kumar
Cc: user@spark.apache.org
Subject: Re: Spark And Mapr

There is doc on MapR:

http://doc.mapr.com/display/MapR/Accessing+MapR-FS+in+Java+Applications

-Vladimir Rodionov

On Wed, Oct 1, 2014 at 3:00 PM, Addanki, Santosh Kumar <santosh.kumar.addanki@sap.com<mailto:santosh.kumar.addanki@sap.com>>
wrote:
Hi

We were using Horton 2.4.1 as our Hadoop distribution and now switched to MapR

Previously to read a text file  we would use :

test = sc.textFile(\"hdfs://10.48.101.111:8020/user/hdfs/test\<http://10.48.101.111:8020/user/hdfs/test%5C>")"


What would be the equivalent of the same for Mapr.

Best Regards
Santosh

Mime
View raw message