datafu-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [datafu] eyala commented on issue #15: Add Spark functionality to DataFu, datafu-spark
Date Thu, 02 May 2019 11:56:20 GMT
eyala commented on issue #15: Add Spark functionality to DataFu, datafu-spark
URL: https://github.com/apache/datafu/pull/15#issuecomment-488644759
 
 
   I didn't take care of all of Russell's comments, but I had to make some changes in the
tests in order for them to pass in all the Spark/Scala versions I included (Spark from 2.1.0
to 2.4.0, Scala 2.10 and 2.11).
   
   In order to build and run the tests for all the different versions, you can use the bash
script [build_and_test_spark.sh](https://github.com/apache/datafu/blob/spark-tmp/datafu-spark/build_and_test_spark.sh).
It takes a little less than an hour to run and test on all the versions.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message