spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Saurav Sinha <sauravsinh...@gmail.com>
Subject Re: What is the best way for Spark to read HDF5@scale?
Date Mon, 17 Sep 2018 07:13:57 GMT
Here is the solution

sc.textFile("hdfs://nn1home:8020/input/war-and-peace.txt")

How did I find out nn1home:8020?

Just search for the file core-site.xml and look for xml element fs.defaultFS

On Fri, Sep 14, 2018 at 7:57 PM kathleen li <kathleenli168@gmail.com> wrote:

> Hi,
> Any Spark-connector for HDF5?
>
> The following link does not work anymore?
>
> https://www.hdfgroup.org/downloads/spark-connector/
> down vo
>
> Thanks,
>
> Kathleen
>


-- 
Thanks and Regards,

Saurav Sinha

Contact: 9742879062

Mime
View raw message