spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sud_self <852677...@qq.com>
Subject rdd.toDF().saveAsParquetFile("tachyon://host:19998/test")
Date Sat, 28 Mar 2015 05:42:50 GMT
spark version is 1.3.0 with tanhyon-0.6.1    

QUESTION DESCRIPTION: rdd.saveAsObjectFile("tachyon://host:19998/test")  and 
rdd.saveAsTextFile("tachyon://host:19998/test")  succeed,   but
rdd.toDF().saveAsParquetFile("tachyon://host:19998/test") failure.

ERROR MESSAGE:    java.lang.IllegalArgumentException: Wrong FS:
tachyon://host:19998/test, expected: hdfs://host:8020
	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:645)
	at org.apache.hadoop.fs.FileSystem.makeQualified(FileSystem.java:465)
	at
org.apache.spark.sql.parquet.ParquetRelation2$MetadataCache$$anonfun$6.apply(newParquet.scala:252)
	at
org.apache.spark.sql.parquet.ParquetRelation2$MetadataCache$$anonfun$6.apply(newParquet.scala:251)



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/rdd-toDF-saveAsParquetFile-tachyon-host-19998-test-tp22264.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message