kudu-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Daniel Cryans <jdcry...@apache.org>
Subject Re: AUTO_FLUSH_BACKGROUND is supported in Impala 2.7?
Date Tue, 14 Mar 2017 15:07:02 GMT
You can see here that it's hardcoded to use it:
https://github.com/apache/kudu/blob/master/java/kudu-spark/src/main/scala/org/apache/kudu/spark/kudu/KuduContext.scala#L212

J-D

On Tue, Mar 14, 2017 at 3:38 AM, Jason Heo <jason.heo.sde@gmail.com> wrote:

> @Harsh
>
> Can I ask one more question?
>
> I wanted to know if AUTO_FLUSH_BACKGROUND can be enabled or already
> enabled by default with Apache Spark.
>
> Thanks.
>
> 2017-03-14 19:24 GMT+09:00 Jason Heo <jason.heo.sde@gmail.com>:
>
>> @Harsh
>>
>> Ok. I got it.
>>
>> Thanks.
>>
>> 2017-03-14 17:41 GMT+09:00 Harsh J <harsh@cloudera.com>:
>>
>>> The Apache Impala (incubating) 2.8.0 sources do carry the default flush
>>> mode of Kudu client sessions as AUTO_FLUSH_BACKGROUND: https:/
>>> /github.com/apache/incubator-impala/blob/2.8.0/be/src/exec/k
>>> udu-table-sink.cc#L161-L162 (in 2.7.0 this was MANUAL)
>>>
>>> The CDH 5.10.0 included Apache Impala (incubating) release too has the
>>> default flush mode set to AUTO_FLUSH_BACKGROUND as evidenced at
>>> https://github.com/cloudera/Impala/blob/cdh5.10.0-release
>>> /be/src/exec/kudu-table-sink.cc#L161-L162.
>>>
>>> On Tue, 14 Mar 2017 at 12:34 Jason Heo <jason.heo.sde@gmail.com> wrote:
>>>
>>>> Sorry.
>>>>
>>>> I've noticed that `v2.7.0` is just Impala Shell's.
>>>>
>>>> It seems CDH 5.10.x includes Impala 2.8. But I can't find if
>>>> AUTO_FLUSH_BACKGROUND is added at the "New Features in Impala 2.8.x /
>>>> CDH 5.10.x
>>>> <https://www.cloudera.com/documentation/enterprise/release-notes/topics/impala_new_features.html#new_features_280>
>>>> "
>>>>
>>>>
>>>>
>>>> 2017-03-14 15:47 GMT+09:00 Jason Heo <jason.heo.sde@gmail.com>:
>>>>
>>>> Hi.
>>>>
>>>> I'm using (Impala + Kudu) on CDH 5.10
>>>>
>>>>
>>>> > version;
>>>> Shell version: Impala Shell v2.7.0-cdh5.10.0 (785a073) built on Fri Jan
>>>> 20 12:03:56 PST 2017
>>>> Server version: impalad version 2.7.0-cdh5.10.0 RELEASE (build
>>>> 785a073cd07e2540d521ecebb8b38161ccbd2aa2)
>>>>
>>>> I've read IMPALA-4134
>>>> <https://issues-test.apache.org/jira/browse/IMPALA-4134>, I'm
>>>> wondering if AUTO_FLUSH_BACKGROUND is enabled by default impala 2.7
>>>>
>>>> Thanks.
>>>>
>>>>
>>>>
>>
>

Mime
View raw message