spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yasemin Kaya <godo...@gmail.com>
Subject Re: Cassandra Submit
Date Tue, 09 Jun 2015 17:29:47 GMT
My jar files are:

cassandra-driver-core-2.1.5.jar
cassandra-thrift-2.1.3.jar
guava-18.jar
jsr166e-1.1.0.jar
spark-assembly-1.3.0.jar
spark-cassandra-connector_2.10-1.3.0-M1.jar
spark-cassandra-connector-java_2.10-1.3.0-M1.jar
spark-core_2.10-1.3.1.jar
spark-streaming_2.10-1.3.1.jar

And my code from datastax spark-cassandra-connector
<https://github.com/datastax/spark-cassandra-connector/blob/master/spark-cassandra-connector-demos/simple-demos/src/main/java/com/datastax/spark/connector/demo/JavaApiDemo.java>
.

Thanx alot.
yasemin

2015-06-09 18:58 GMT+03:00 Yana Kadiyska <yana.kadiyska@gmail.com>:

> hm. Yeah, your port is good...have you seen this thread:
> http://stackoverflow.com/questions/27288380/fail-to-use-spark-cassandra-connector
> ? It seems that you might be running into version mis-match issues?
>
> What versions of Spark/Cassandra-connector are you trying to use?
>
> On Tue, Jun 9, 2015 at 10:18 AM, Yasemin Kaya <godot85@gmail.com> wrote:
>
>> Sorry my answer I hit terminal lsof -i:9160: result is
>>
>> lsof -i:9160
>> COMMAND  PID    USER   FD   TYPE DEVICE SIZE/OFF NODE NAME
>> java    7597 inosens  101u  IPv4  85754      0t0  TCP localhost:9160
>> (LISTEN)
>>
>> so 9160 port is available or not ?
>>
>> 2015-06-09 17:16 GMT+03:00 Yasemin Kaya <godot85@gmail.com>:
>>
>>> Yes my cassandra is listening on 9160 I think. Actually I know from yaml
>>> file. The file includes :
>>>
>>> rpc_address: localhost
>>> # port for Thrift to listen for clients on
>>> rpc_port: 9160
>>>
>>> I check the port "nc -z localhost 9160; echo $?" it returns me "0". I
>>> think it close, should I open this port ?
>>>
>>> 2015-06-09 16:55 GMT+03:00 Yana Kadiyska <yana.kadiyska@gmail.com>:
>>>
>>>> Is your cassandra installation actually listening on 9160?
>>>>
>>>> lsof -i :9160COMMAND   PID     USER   FD   TYPE   DEVICE SIZE/OFF NODE NAME
>>>> java    29232 ykadiysk   69u  IPv4 42152497      0t0  TCP localhost:9160
(LISTEN)
>>>>
>>>> ​
>>>> I am running an out-of-the box cassandra conf where
>>>>
>>>> rpc_address: localhost
>>>> # port for Thrift to listen for clients on
>>>> rpc_port: 9160
>>>>
>>>>
>>>>
>>>> On Tue, Jun 9, 2015 at 7:36 AM, Yasemin Kaya <godot85@gmail.com> wrote:
>>>>
>>>>> I couldn't find any solution. I can write but I can't read from
>>>>> Cassandra.
>>>>>
>>>>> 2015-06-09 8:52 GMT+03:00 Yasemin Kaya <godot85@gmail.com>:
>>>>>
>>>>>> Thanks alot Mohammed, Gerard and Yana.
>>>>>> I can write to table, but exception returns me. It says "*Exception
>>>>>> in thread "main" java.io.IOException: Failed to open thrift connection
to
>>>>>> Cassandra at 127.0.0.1:9160 <http://127.0.0.1:9160>*"
>>>>>>
>>>>>> In yaml file :
>>>>>> rpc_address: localhost
>>>>>> rpc_port: 9160
>>>>>>
>>>>>> And at project :
>>>>>>
>>>>>> .set("spark.cassandra.connection.host", "127.0.0.1")
>>>>>> .set("spark.cassandra.connection.rpc.port", "9160");
>>>>>>
>>>>>> or
>>>>>>
>>>>>> .set("spark.cassandra.connection.host", "localhost")
>>>>>> .set("spark.cassandra.connection.rpc.port", "9160");
>>>>>>
>>>>>> whatever I write setting,  I get same exception. Any help ??
>>>>>>
>>>>>>
>>>>>> 2015-06-08 18:23 GMT+03:00 Yana Kadiyska <yana.kadiyska@gmail.com>:
>>>>>>
>>>>>>> yes, whatever you put for listen_address in cassandra.yaml. Also,
>>>>>>> you should try to connect to your cassandra cluster via bin/cqlsh
to make
>>>>>>> sure you have connectivity before you try to make a a connection
via spark.
>>>>>>>
>>>>>>> On Mon, Jun 8, 2015 at 4:43 AM, Yasemin Kaya <godot85@gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi,
>>>>>>>> I run my project on local. How can find ip address of my
cassandra
>>>>>>>> host ? From cassandra.yaml or ??
>>>>>>>>
>>>>>>>> yasemin
>>>>>>>>
>>>>>>>> 2015-06-08 11:27 GMT+03:00 Gerard Maas <gerard.maas@gmail.com>:
>>>>>>>>
>>>>>>>>> ????? = <ip address of your cassandra host>
>>>>>>>>>
>>>>>>>>> On Mon, Jun 8, 2015 at 10:12 AM, Yasemin Kaya <godot85@gmail.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi ,
>>>>>>>>>>
>>>>>>>>>> How can I find spark.cassandra.connection.host? And
what should I
>>>>>>>>>> change ? Should I change cassandra.yaml ?
>>>>>>>>>>
>>>>>>>>>> Error says me *"Exception in thread "main" java.io.IOException:
>>>>>>>>>> Failed to open native connection to Cassandra at
{127.0.1.1}:9042"*
>>>>>>>>>>
>>>>>>>>>> What should I add *SparkConf sparkConf = new
>>>>>>>>>> SparkConf().setAppName("JavaApiDemo").set(**"spark.driver.allowMultipleContexts",
>>>>>>>>>> "true").set("spark.cassandra.connection.host", ?????);*
>>>>>>>>>>
>>>>>>>>>> Best
>>>>>>>>>> yasemin
>>>>>>>>>>
>>>>>>>>>> 2015-06-06 3:04 GMT+03:00 Mohammed Guller <mohammed@glassbeam.com
>>>>>>>>>> >:
>>>>>>>>>>
>>>>>>>>>>>  Check your spark.cassandra.connection.host setting.
It should
>>>>>>>>>>> be pointing to one of your Cassandra nodes.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Mohammed
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> *From:* Yasemin Kaya [mailto:godot85@gmail.com]
>>>>>>>>>>> *Sent:* Friday, June 5, 2015 7:31 AM
>>>>>>>>>>> *To:* user@spark.apache.org
>>>>>>>>>>> *Subject:* Cassandra Submit
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> I am using cassandraDB in my project. I had that
error *Exception
>>>>>>>>>>> in thread "main" java.io.IOException: Failed
to open native connection to
>>>>>>>>>>> Cassandra at {127.0.1.1}:9042*
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> I think I have to modify the submit line. What
should I add or
>>>>>>>>>>> remove when I submit my project?
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Best,
>>>>>>>>>>>
>>>>>>>>>>> yasemin
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>>
>>>>>>>>>>> hiç ender hiç
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> hiç ender hiç
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> hiç ender hiç
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> hiç ender hiç
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> hiç ender hiç
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> hiç ender hiç
>>>
>>
>>
>>
>> --
>> hiç ender hiç
>>
>
>


-- 
hiç ender hiç

Mime
View raw message