spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "lk_spark"<lk_sp...@163.com>
Subject how to limit tasks num when read hive with orc
Date Tue, 12 Nov 2019 05:56:04 GMT
hi,all:
    I have a hive table STORED AS INPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat'
, many files of it is very small , when I use spark to read it , thousands tasks will start
, how can I limit the task num ?

2019-11-12


lk_spark 
Mime
View raw message