spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <ja...@japila.pl>
Subject Re: suggest configuration for debugging spark streaming, kafka
Date Thu, 27 Aug 2015 09:48:46 GMT
On Wed, Aug 26, 2015 at 11:02 PM, Joanne Contact
<joannenetwork@gmail.com> wrote:
> Hi I have a Ubuntu box with 4GB memory and duo cores. Do you think it
> won't be enough to run spark streaming and kafka? I try to install
> standalone mode spark kafka so I can debug them in IDE. Do I need to
> install hadoop?

Hi,

It should be enough and you don't need Hadoop.

I described the process of setting up both in
http://blog.jaceklaskowski.pl/2015/07/20/real-time-data-processing-using-apache-kafka-and-spark-streaming.html.

Pozdrawiam,
Jacek

--
Jacek Laskowski | http://blog.japila.pl | http://blog.jaceklaskowski.pl
Follow me at https://twitter.com/jaceklaskowski
Upvote at http://stackoverflow.com/users/1305344/jacek-laskowski

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message