spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ron8hu <>
Subject In Intellij, maven failed to build Catalyst project
Date Tue, 21 Feb 2017 02:51:47 GMT
I am using Intellij IDEA 15.0.6.   I used to use Maven to compile Spark
project Catalyst inside Intellij without problem.  

A couple of days ago, I fetched latest Spark code from its master
repository.  There was a change in CreateJacksonParser.scala.  So I used
Maven to compile Catalyst project again.  Then I got this error:
...../spark/sql/catalyst/json/CreateJacksonParser.scala:33: value
getByteBuffer is not a member of org.apache.spark.unsafe.types.UTF8String

Note that I was able to compile the source code using sbt.  This compile
error happens inside Intellij/Maven.  Below is the detailed message.   Any
advice will be appreciated.  
*******  ****************  *******
[INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @
spark-catalyst_2.11 ---
[INFO] Using zinc server for incremental compilation

Compiling 203 Scala sources and 26 Java sources to
value getByteBuffer is not a member of
    val bb = record.getByteBuffer
                    ^ not found

One error found.
[INFO] Compile failed at Feb 20, 2017
[INFO] Total time: 01:53 min
[INFO] Finished at: 2017-02-20T17:37:55-08:00
[INFO] Final Memory: 38M/795M
[WARNING] The requested profile "hive" could not be activated because it
does not exist.
[ERROR] Failed to execute goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on
project spark-catalyst_2.11: Execution scala-compile-first of goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed ->
[Help 1]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]

Process finished with exit code 1

View this message in context:
Sent from the Apache Spark Developers List mailing list archive at

To unsubscribe e-mail:

View raw message