spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "hsy541@gmail.com" <hsy...@gmail.com>
Subject How to do an interactive Spark SQL
Date Tue, 22 Jul 2014 23:03:49 GMT
Hi guys,

I'm able to run some Spark SQL example but the sql is static in the code. I
would like to know is there a way to read sql from somewhere else (shell
for example)

I could read sql statement from kafka/zookeeper, but I cannot share the sql
to all workers. broadcast seems not working for updating values.

Moreover if I use some non-serializable class(DataInputStream etc) to read
sql from other source, I always get "Task not serializable:
java.io.NotSerializableException"


Best,
Siyuan

Mime
View raw message