spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Terry Siu <Terry....@smartfocus.com>
Subject Re: ParquetFilters and StringType support for GT, GTE, LT, LTE
Date Mon, 03 Nov 2014 22:04:26 GMT
Done.

https://issues.apache.org/jira/browse/SPARK-4213

Thanks,
-Terry

From: Michael Armbrust <michael@databricks.com<mailto:michael@databricks.com>>
Date: Monday, November 3, 2014 at 1:37 PM
To: Terry Siu <terry.siu@smartfocus.com<mailto:terry.siu@smartfocus.com>>
Cc: "user@spark.apache.org<mailto:user@spark.apache.org>" <user@spark.apache.org<mailto:user@spark.apache.org>>
Subject: Re: ParquetFilters and StringType support for GT, GTE, LT, LTE

That sounds like a regression.  Could you open a JIRA with steps to reproduce (https://issues.apache.org/jira/browse/SPARK)?
 We'll want to fix this before the 1.2 release.

On Mon, Nov 3, 2014 at 11:04 AM, Terry Siu <Terry.Siu@smartfocus.com<mailto:Terry.Siu@smartfocus.com>>
wrote:
Is there any reason why StringType is not a supported type the GT, GTE, LT, LTE operations?
I was able to previously have a predicate where my column type was a string and execute a
filter with one of the above operators in SparkSQL w/o any problems. However, I synced up
to the latest code this morning and now the same query will give me a MatchError for this
column of string type.

Thanks,
-Terry




Mime
View raw message