| Message view | « Date » · « Thread » |
|---|---|
| Top | « Date » · « Thread » |
| From | Dave Challis <dave.chal...@aistemos.com> |
| Subject | Re: Which perform better JSON or convert JSON to parquet format ? |
| Date | Fri, 15 Jun 2018 08:42:36 GMT |
One gotcha with JSON vs parquet is that there's a longstanding bug that causes errors when trying to read from Parquet files containing 0 rows. For cases where we're converting from datasets that might be empty, we use JSON, and for everything else, Parquet. | |
| Mime |
|
| View raw message | |