spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yeikel Santana" <em...@yeikel.com>
Subject RE: Fast Unit Tests
Date Tue, 01 May 2018 15:56:54 GMT
Can you share a sample test case? How are you doing the unit tests? Are you creating the session
in a beforeAll block or similar? 

 

As far as I know, if you use spark you will end up with light integration tests rather than
“real” unit tests (please correct me if I am wrong). 

 

From: marcos rebelo <oleber@gmail.com> 
Sent: Tuesday, May 1, 2018 11:25 AM
To: user <user@spark.apache.org>
Subject: Fast Unit Tests

 

Hey all,

 

We are using Scala and SQL heavily, but I have a problem with VERY SLOW Unit Tests. 

 

Is there a way to do fast Unit Tests on Spark? 

 

How are you guys going around it?

 

Best Regards

Marcos Rebelo


Mime
View raw message