spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zhan Zhang <>
Subject Re: RFC: Remote "HBaseTest" from examples?
Date Thu, 21 Apr 2016 20:28:09 GMT
FYI: There are several pending patches for DataFrame support on top of HBase.


Zhan Zhang

On Apr 20, 2016, at 2:43 AM, Saisai Shao <<>>

+1, HBaseTest in Spark Example is quite old and obsolete, the HBase connector in HBase repo
has evolved a lot, it would be better to guide user to refer to that not here in Spark example.
So good to remove it.


On Wed, Apr 20, 2016 at 1:41 AM, Josh Rosen <<>>
+1; I think that it's preferable for code examples, especially third-party integration examples,
to live outside of Spark.

On Tue, Apr 19, 2016 at 10:29 AM Reynold Xin <<>>
Yea in general I feel examples that bring in a large amount of dependencies should be outside

On Tue, Apr 19, 2016 at 10:15 AM, Marcelo Vanzin <<>>
Hey all,

Two reasons why I think we should remove that from the examples:

- HBase now has Spark integration in its own repo, so that really
should be the template for how to use HBase from Spark, making that
example less useful, even misleading.

- It brings up a lot of extra dependencies that make the size of the
Spark distribution grow.

Any reason why we shouldn't drop that example?


To unsubscribe, e-mail:<>
For additional commands, e-mail:<>

View raw message