spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 李斌松 <>
Subject Spark hive table dependent on parquet version too low
Date Fri, 24 May 2019 07:35:32 GMT
Spark has two create table ddl statements,: hive table and spark table. In
practice, a lot of people use hive table,When spark writes data to hive
table, it relies on parquet version 1.6.0, version is relatively low, the
latest version of parquet has a lot of performance optimization, does the
community have an upgrade plan?

parquet 1.6.0
[image: image.png]

parquet 1.10.1
[image: image.png]

View raw message