spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ofir Manor <>
Subject Re: ORC v/s Parquet for Spark 2.0
Date Tue, 26 Jul 2016 10:50:10 GMT
One additional point specific to Spark 2.0 - for the alpha Structured
Streaming API (only),  the file sink only supports Parquet format (I'm sure
that limitation will be lifted in a future release before Structured
Streaming is GA):
     "File sink - Stores the output to a directory. As of Spark 2.0, this
only supports Parquet file format, and Append output mode."


View raw message