| Message view | « Date » · « Thread » |
|---|---|
| Top | « Date » · « Thread » |
| From | Kevin Tran <kevin...@gmail.com> |
| Subject | Best practises to storing data in Parquet files |
| Date | Sun, 28 Aug 2016 14:43:51 GMT |
Hi, Does anyone know what is the best practises to store data to parquet file? Does parquet file has limit in size ( 1TB ) ? Should we use SaveMode.APPEND for long running streaming app ? How should we store in HDFS (directory structure, ... )? Thanks, Kevin. | |
| Mime |
|
| View raw message | |