spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Spark 2.0 vs 1.6.1 Query Time using Thrift server
Date Sun, 24 Apr 2016 14:10:25 GMT
Spark 2.0 changes very fast.

The ShowTablesCommand is now in:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala

Consider opening a PR for the change shown below.

For the query run, can you share some of your code ?
Please pastebin related portion from Thrift server log.

Cheers

On Sun, Apr 24, 2016 at 6:50 AM, Raymond Honderdors <
Raymond.Honderdors@sizmek.com> wrote:

> Hi,
>
>
>
> I run a query using JDBC driver running it on version 1.6.1 it return
> after 5 – 6 min , the same query against version 2.0 fails after 2h (due to
> timeout)
>
> Both versions run on the same hardware/configuration and data source
>
>
>
> Is anyone else experiencing this?
>
>
>
>
>
> Also I noticed that the thrift server on version had a change in
> commands.scala in spark-sql-2.11/execution/command
>
>
>
>
>
>
>
> The external tool Microstrategy can see tables only with the reinserted
> code compiling spark version 2.0, it looks like a bug
>
>
>
>
>
> *Raymond Honderdors *
>
> *Team Lead Analytics BI*
>
> *Business Intelligence Developer *
>
> *raymond.honderdors@sizmek.com <raymond.honderdors@sizmek.com> *
>
> *T +972.7325.3569*
>
> *Herzliya*
>
>
>
> [image: Read More] <http://feeds.feedburner.com/~r/sizmek-blog/~6/1>
>
> <http://www.sizmek.com/>
>

Mime
View raw message