spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Iulian Dragoș <iulian.dra...@typesafe.com>
Subject Re: Intellij Spark Source Compilation
Date Mon, 11 May 2015 15:31:12 GMT
Oh, I see. So then try to run one build on the command time firs (or try sbt
avro:generate, though I’m not sure it’s enough). I just noticed that I have
an additional source folder target/scala-2.10/src_managed/main/compiled_avro
for spark-streaming-flume-sink. I guess I built the project once and that’s
why I never saw these errors..

Once we get it to work, let me know so I can update the wiki guide.

thanks,
iulian
​

On Mon, May 11, 2015 at 4:20 PM, rtimp <dolethebobdole11@gmail.com> wrote:

> Hi,
>
> Thanks Iulian. Yeah, I was kind of anticipating I could just ignore
> old-deps
> ultimately. However, Even after doing a clean and build all, I get the
> following still:
>
> Description     Location        Resource        Path    Type
> not found: type EventBatch      line 72 SparkAvroCallbackHandler.scala
>
> /spark-streaming-flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> not found: type EventBatch      line 87 SparkAvroCallbackHandler.scala
>
> /spark-streaming-flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> not found: type EventBatch      line 25 SparkSinkUtils.scala
>
> /spark-streaming-flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> not found: type EventBatch      line 48 TransactionProcessor.scala
>
> /spark-streaming-flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> not found: type EventBatch      line 48 TransactionProcessor.scala
>
> /spark-streaming-flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> not found: type EventBatch      line 80 TransactionProcessor.scala
>
> /spark-streaming-flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> not found: type EventBatch      line 146        TransactionProcessor.scala
>
> /spark-streaming-flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> not found: type SparkFlumeProtocol      line 46
> SparkAvroCallbackHandler.scala
>
> /spark-streaming-flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> not found: type SparkFlumeProtocol      line 86 SparkSink.scala
>
> /spark-streaming-flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> not found: type SparkSinkEvent  line 115        TransactionProcessor.scala
>
> /spark-streaming-flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> not found: value SparkFlumeProtocol     line 185
> SparkSinkSuite.scala
>
> /spark-streaming-flume-sink/src/test/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> not found: value SparkFlumeProtocol     line 194
> SparkSinkSuite.scala
>
> /spark-streaming-flume-sink/src/test/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> Project not built due to errors in dependent project(s)
> spark-streaming-flume-sink      Unknown spark-streaming-flume
>  Scala Problem
> value ack is not a member of Any        line 52 SparkSinkSuite.scala
>
> /spark-streaming-flume-sink/src/test/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> value getEventBatch is not a member of Any      line 51
> SparkSinkSuite.scala
>
> /spark-streaming-flume-sink/src/test/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> value getEventBatch is not a member of Any      line 71
> SparkSinkSuite.scala
>
> /spark-streaming-flume-sink/src/test/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> value getEventBatch is not a member of Any      line 91
> SparkSinkSuite.scala
>
> /spark-streaming-flume-sink/src/test/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
> value nack is not a member of Any       line 73 SparkSinkSuite.scala
>
> /spark-streaming-flume-sink/src/test/scala/org/apache/spark/streaming/flume/sink
> Scala Problem
>
>
> I'd mention that the EventBatch  and SparkFlumeProtocol were very similar
> to
> what initially occurred for me in intellij, until I clicked the "Generate
> Sources and Update Folders For All Projects" button in the "Maven Projects"
> tool window that the wiki suggests suggests doing.
>
>
>
> --
> View this message in context:
> http://apache-spark-developers-list.1001551.n3.nabble.com/Intellij-Spark-Source-Compilation-tp12168p12195.html
> Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>


-- 

--
Iulian Dragos

------
Reactive Apps on the JVM
www.typesafe.com

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message