spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "喜之郎" <251922...@qq.com>
Subject 回复: parquet table in spark-sql
Date Wed, 04 May 2016 01:49:58 GMT
thanks for your answer, Sandeep .
And also thanks,Varadharajan.




------------------ 原始邮件 ------------------
发件人: "Sandeep Nemuri";<nhsandeep6@gmail.com>;
发送时间: 2016年5月3日(星期二) 晚上8:48
收件人: "Varadharajan Mukundan"<srinathsmn@gmail.com>; 
抄送: "喜之郎"<251922566@qq.com>; "user"<user@spark.apache.org>; 
主题: Re: parquet table in spark-sql



We don't need any delimiters for Parquet file format.


ᐧ

On Tue, May 3, 2016 at 5:31 AM, Varadharajan Mukundan <srinathsmn@gmail.com> wrote:
Hi,

Yes, it is not needed. Delimiters are need only for text files.


On Tue, May 3, 2016 at 12:49 PM, 喜之郎 <251922566@qq.com> wrote:
hi, I want to ask a question about parquet table in spark-sql table.


I think that parquet have schema information in its own file.
so you don't need define row separator and column separator in create-table DDL, like that:


total_duration  BigInt)
ROW FORMAT DELIMITED 
  FIELDS TERMINATED BY ',' 
  LINES TERMINATED BY '\n' 



can anyone give me a answer? thanks











-- 
Thanks,
M. Varadharajan

------------------------------------------------

"Experience is what you get when you didn't get what you wanted"
               -By Prof. Randy Pausch in "The Last Lecture"

My Journal :- http://varadharajan.in
 
 




-- 
  Regards  Sandeep Nemuri
Mime
View raw message