spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Armin Braun ...@obrown.io>
Subject Re: In Intellij, maven failed to build Catalyst project
Date Tue, 21 Feb 2017 06:40:31 GMT
I think the reason you're seeing this (and it then disappearing in Sean's
case) is likely that there was a change in another that required a
recompile of a module dependency.
Maven doesn't do this automatically by default. So it eventually goes away
when you do a full build either with Maven or SBT.

You could add `--also-make-dependents`  (-amd) as a build flag to fix this
behavior and rebuild dependencies too.

On Tue, Feb 21, 2017 at 6:35 AM, Sean Owen <sowen@cloudera.com> wrote:

> I saw this too yesterday but not today. It may have been fixed by some
> recent commits.
>
> On Mon, Feb 20, 2017 at 6:52 PM ron8hu <ron.hu@huawei.com> wrote:
>
> I am using Intellij IDEA 15.0.6.   I used to use Maven to compile Spark
> project Catalyst inside Intellij without problem.
>
> A couple of days ago, I fetched latest Spark code from its master
> repository.  There was a change in CreateJacksonParser.scala.  So I used
> Maven to compile Catalyst project again.  Then I got this error:
> ...../spark/sql/catalyst/json/CreateJacksonParser.scala:33: value
> getByteBuffer is not a member of org.apache.spark.unsafe.types.UTF8String
>
> Note that I was able to compile the source code using sbt.  This compile
> error happens inside Intellij/Maven.  Below is the detailed message.   Any
> advice will be appreciated.
> *******  ****************  *******
> [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @
> spark-catalyst_2.11 ---
> [INFO] Using zinc server for incremental compilation
>
> Compiling 203 Scala sources and 26 Java sources to
> /home/rhu/spark-20/sql/catalyst/target/scala-2.11/classes....
> /home/rhu/spark-20/sql/catalyst/src/main/scala/org/
> apache/spark/sql/catalyst/json/CreateJacksonParser.scala:33:
> value getByteBuffer is not a member of
> org.apache.spark.unsafe.types.UTF8String
>     val bb = record.getByteBuffer
>                     ^ not found
>
> One error found.
> [INFO] Compile failed at Feb 20, 2017
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 01:53 min
> [INFO] Finished at: 2017-02-20T17:37:55-08:00
> [INFO] Final Memory: 38M/795M
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The requested profile "hive" could not be activated because it
> does not exist.
> [ERROR] Failed to execute goal
> net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first)
> on
> project spark-catalyst_2.11: Execution scala-compile-first of goal
> net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed
> ->
> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>
> Process finished with exit code 1
>
>
>
>
> --
> View this message in context: http://apache-spark-
> developers-list.1001551.n3.nabble.com/In-Intellij-maven-
> failed-to-build-Catalyst-project-tp21036.html
> Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>

Mime
View raw message