spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yeikel Santana" <>
Subject RE: Fast Unit Tests
Date Tue, 01 May 2018 15:56:54 GMT
Can you share a sample test case? How are you doing the unit tests? Are you creating the session
in a beforeAll block or similar? 


As far as I know, if you use spark you will end up with light integration tests rather than
“real” unit tests (please correct me if I am wrong). 


From: marcos rebelo <> 
Sent: Tuesday, May 1, 2018 11:25 AM
To: user <>
Subject: Fast Unit Tests


Hey all,


We are using Scala and SQL heavily, but I have a problem with VERY SLOW Unit Tests. 


Is there a way to do fast Unit Tests on Spark? 


How are you guys going around it?


Best Regards

Marcos Rebelo

View raw message