spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun Khetarpal <arunkhetarpa...@gmail.com>
Subject Aggregate pushdown for data source
Date Mon, 19 Aug 2019 01:31:55 GMT
Hi Folks:

I have implemented a data source v2 API for an internal source. As a
consequence of generating the data source, we have bunch of statistical
information about the source which i can potentially use, only if spark
pushes down the aggregates down to the data source itself.

I see that there is already a comprehensive Jira for the same:
https://issues.apache.org/jira/browse/SPARK-22390. Are there any more
blockers for this Jira? I'll be more than happy to contribute if no one
else had picked it up.

Regards,
Arun

Mime
View raw message