spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Huaxin Gao (Jira)" <>
Subject [jira] [Commented] (SPARK-22390) Aggregate push down
Date Mon, 07 Oct 2019 18:55:00 GMT


Huaxin Gao commented on SPARK-22390:

I am slowly catching up the changes in Data Source V2 and try to fit aggregate push down there.
It seems JDBC support is still not in Data Source V2 yet. If I put aggregate push down in
V2, I don't have a data source to test the implementation. I guess all I can do is to follow
the pushFilters in DataSourceV2Suite and implement a simple aggregate in AdvancedDataSourceV2,
something like the GreaterThan filter. Any suggestions? [~smilegator][~holden]

> Aggregate push down
> -------------------
>                 Key: SPARK-22390
>                 URL:
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 2.3.0
>            Reporter: Wenchen Fan
>            Priority: Major

This message was sent by Atlassian Jira

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message