spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Exie <tfind...@prodevelop.com.au>
Subject Re: Spark run errors on Raspberry Pi
Date Wed, 01 Jul 2015 03:40:51 GMT
FWIW, I had some trouble getting Spark running on a Pi. 

My core problem was using snappy for compression as it comes as a pre-made
binary for i386 and I couldnt find one for ARM.

So to work around it there was an option to use LZO instead, then everything
worked.

Off the top of my head, it was something like:
spark.sql.parquet.compression.codec=lzo

This might be worth trying.



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-run-errors-on-Raspberry-Pi-tp23532p23561.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message