spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <ja...@japila.pl>
Subject Re: BUILD FAILURE due to...not found: value AnalysisBarrier in spark-catalyst_2.11?
Date Sat, 09 Dec 2017 11:34:26 GMT
Hi,

Thanks Sean! You're right -- my local repo got hosed. I don't know why the
patch with AnalysisBarrier didn't go through.

Speaking of the patch [1] I've noticed a sentence in the scaladoc of
AnalysisBarrier that does not make much sense to me. There's something
missing in it, isn't there?

> The SQL Analyzer goes through a whole query plan even most part of it is
analyzed.

What is this sentence telling me? `if` missing in between "even most"?

[1]
https://github.com/apache/spark/blob/00d176d2fe7bbdf55cb3146a9cb04ca99b1858b7/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala?utf8=%E2%9C%93#L890

Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
Spark Structured Streaming https://bit.ly/spark-structured-streaming
Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski

On Fri, Dec 8, 2017 at 6:40 PM, Sean Owen <sowen@cloudera.com> wrote:

> Build is fine for me, and on Jenkins. Try a clean build?
>
> On Fri, Dec 8, 2017 at 11:04 AM Jacek Laskowski <jacek@japila.pl> wrote:
>
>> Hi,
>>
>> Just got BUILD FAILURE and have been wondering if it's just me or is this
>> a known issue that's being worked on?
>>
>> (Sorry if that's just my local setup that I got broken)
>>
>> [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @
>> spark-catalyst_2.11 ---
>> [INFO] Using zinc server for incremental compilation
>> [warn] Pruning sources from previous analysis, due to incompatible
>> CompileSetup.
>> [info] Compiling 222 Scala sources and 27 Java sources to
>> /Users/jacek/dev/oss/spark/sql/catalyst/target/scala-2.11/classes...
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:728: not found:
>> value AnalysisBarrier
>> [error]           AnalysisBarrier(newRight)
>> [error]           ^
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1081: not found:
>> value AnalysisBarrier
>> [error]       case sa @ Sort(_, _, AnalysisBarrier(child: Aggregate)) =>
>> sa
>> [error]                            ^
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1134: not found:
>> value AnalysisBarrier
>> [error]         return AnalysisBarrier(plan)
>> [error]                ^
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1409: not found:
>> value AnalysisBarrier
>> [error]       case filter @ Filter(havingCondition,
>> AnalysisBarrier(aggregate: Aggregate)) =>
>> [error]                                             ^
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1410: not found:
>> value AnalysisBarrier
>> [error]         apply(Filter(havingCondition, aggregate)).mapChildren(
>> AnalysisBarrier)
>> [error]                                                               ^
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1470: not found:
>> value AnalysisBarrier
>> [error]       case sort @ Sort(sortOrder, global,
>> AnalysisBarrier(aggregate: Aggregate)) =>
>> [error]                                           ^
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1471: not found:
>> value AnalysisBarrier
>> [error]         apply(Sort(sortOrder, global, aggregate)).mapChildren(
>> AnalysisBarrier)
>> [error]                                                               ^
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:2345: not found:
>> value AnalysisBarrier
>> [error]     case AnalysisBarrier(child) => child
>> [error]          ^
>> [error] 8 errors found
>> [error] Compile failed at Dec 8, 2017 5:58:10 PM [8.170s]
>> [INFO] ------------------------------------------------------------
>> ------------
>>
>> Pozdrawiam,
>> Jacek Laskowski
>> ----
>> https://about.me/JacekLaskowski
>> Spark Structured Streaming https://bit.ly/spark-structured-streaming
>> Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark
>> Follow me at https://twitter.com/jaceklaskowski
>>
>

Mime
View raw message