spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Peter Shmukler <pe...@varonis.com>
Subject RE: filters Pushdown
Date Thu, 02 Feb 2017 10:23:36 GMT
Hi Vincent,
Thank you for answer. (I don’t see your answer in mailing list, so I’m answering directly)

What connectors can I work with from Spark?
Can you provide any link to read about it because I see nothing in Spark documentation?


From: vincent gromakowski [mailto:vincent.gromakowski@gmail.com]
Sent: Thursday, February 2, 2017 12:12 PM
To: Peter Shmukler <peter@varonis.com>
Cc: user@spark.apache.org
Subject: Re: filters Pushdown


Pushdowns depend on the source connector.
Join pushdown with Cassandra only
Filter pushdown with mainly all sources with some specific constraints

Le 2 févr. 2017 10:42 AM, "Peter Sg" <peter@varonis.com<mailto:peter@varonis.com>>
a écrit :
Can community help me to figure out some details about Spark:
-       Does Spark support filter Pushdown for types:
  o     Int/long
  o     DateTime
  o     String
-       Does Spark support Pushdown of join operations for partitioned tables (in
case of join condition includes partitioning field)?
-       Does Spark support Pushdown on Parquet, ORC ?
  o     Should I use Hadoop or NTFS/NFS is option was well?




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/filters-Pushdown-tp28357.html<https://urldefense.proofpoint.com/v2/url?u=http-3A__apache-2Dspark-2Duser-2Dlist.1001560.n3.nabble.com_filters-2DPushdown-2Dtp28357.html&d=DwMFaQ&c=7s4bs_giP1ngjwWhX4oayQ&r=kLWLAWGkyIRgjRCprqh7QX1OMFp1eBZjlRawqzDlMWc&m=Zss0q3yuZVzxFuqvPaXLIOHACrxzZOjevU-VE8Eeh04&s=dupzi0-PiyPLCmvPqwWSt2NaEE5hUKlbzmB4-NRuhfg&e=>
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org<mailto:user-unsubscribe@spark.apache.org>

________________________________
This email and any attachments thereto may contain private, confidential, and privileged material
for the sole use of the intended recipient. Any review, copying, or distribution of this email
(or any attachments thereto) by others is strictly prohibited. If you are not the intended
recipient, please contact the sender immediately and permanently delete the original and any
copies of this email and any attachments thereto.
Mime
View raw message