spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zhan Zhang <zzh...@hortonworks.com>
Subject Re: Spark-thriftserver Issue
Date Mon, 23 Mar 2015 22:51:05 GMT
Probably the port is already used by others, e.g., hive. You can change the port similar to
below


 ./sbin/start-thriftserver.sh --master yarn --executor-memory 512m --hiveconf hive.server2.thrift.port=10001

Thanks.

Zhan Zhang

On Mar 23, 2015, at 12:01 PM, Neil Dev <neilkdev@gmail.com<mailto:neilkdev@gmail.com>>
wrote:

Hi,

I am having issue starting spark-thriftserver. I'm running spark 1.3.with
Hadoop 2.4.0. I would like to be able to change its port too so, I can hive
hive-thriftserver as well as spark-thriftserver running at the same time.

Starting sparkthrift server:-
sudo ./start-thriftserver.sh --master spark://ip-172-31-10-124:7077
--executor-memory 2G

Error:-
I created the folder manually but still getting the following error----
Exception in thread "main" java.lang.IllegalArgumentException: Log
directory /tmp/spark-events does not exist.


I am getting the following error
15/03/23 15:07:02 ERROR thrift.ThriftCLIService: Error:
org.apache.thrift.transport.TTransportException: Could not create
ServerSocket on address0.0.0.0/0.0.0.0:10000.
       at
org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:93)
       at
org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:79)
       at
org.apache.hive.service.auth.HiveAuthFactory.getServerSocket(HiveAuthFactory.java:236)
       at
org.apache.hive.service.cli.thrift.ThriftBinaryCLIService.run(ThriftBinaryCLIService.java:69)
       at java.lang.Thread.run(Thread.java:745)

Thanks
Neil


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message