spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Addanki, Santosh Kumar" <>
Subject RE: Spark And Mapr
Date Wed, 01 Oct 2014 23:09:24 GMT

We would like to do this in PySpark Environment

i.e something like

test = sc.textFile("maprfs:///user/root/test") or
test = sc.textFile("hdfs:///user/root/test") or

Currently when we try
test = sc.textFile("maprfs:///user/root/test")

It throws the error
No File-System for scheme: maprfs

Best Regards

From: Vladimir Rodionov []
Sent: Wednesday, October 01, 2014 3:59 PM
To: Addanki, Santosh Kumar
Subject: Re: Spark And Mapr

There is doc on MapR:

-Vladimir Rodionov

On Wed, Oct 1, 2014 at 3:00 PM, Addanki, Santosh Kumar <<>>

We were using Horton 2.4.1 as our Hadoop distribution and now switched to MapR

Previously to read a text file  we would use :

test = sc.textFile(\"hdfs://\<>")"

What would be the equivalent of the same for Mapr.

Best Regards

View raw message