spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashutosh Kumar <kmr.ashutos...@gmail.com>
Subject Running Google Dataflow on Spark
Date Wed, 02 Nov 2016 11:48:09 GMT
I am trying to run Google Dataflow code on Spark. It works fine as google
dataflow on google cloud platform. But while running on Spark I am getting
following error

16/11/02 11:14:32 INFO com.cloudera.dataflow.spark.SparkPipelineRunner:
Evaluating ParDo(GroupByKeyHashAndSortByKeyAndWindow)
Exception in thread "main" java.lang.RuntimeException:
java.lang.IllegalStateException: No TransformEvaluator registered for class
com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner$Grou
pByKeyAndSortValuesOnly
        at
com.cloudera.dataflow.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:124)

Thanks
Ashutosh

Mime
View raw message