spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hélène Delanoeye <helene.delano...@kelkoo.com>
Subject Issue with Spark-1.1.0 and the start-thriftserver.sh script
Date Thu, 25 Sep 2014 09:44:01 GMT
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Hi<br>
<br>
We've just experienced an issue with the new Spark-1.1.0 and the start-thriftserver.sh script.<br>
<br>
<br>
We tried to launch start-thriftserver.sh with &quot;--master yarn&quot; option and
got the following error message :<br>
<br>
<i>Failed to load Hive Thrift server main class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2.<br>
You need to build Spark with -Phive. </i><br>
<br>
<br>
In fact Spark was built with -Phive option, but the real problem was this one :<br>
<br>
<i>Application appattempt_1411058337040_0118_000001 submitted by user xxxxx&nbsp;
to unknown queue: default</i><br>
<br>
So the solution was to specified the queue, and it works : <br>
/opt/spark/sbin/start-thriftserver.sh --master yarn --queue spark-batch<br>
<br>
Hope this could help, as the error message is not really clear (and rather wrong).<br>
<br>
Helene<br>
<br>
<div class="moz-signature">-- <br>
<table border="0" cellpadding="0" cellspacing="0" width="652">
<tbody>
<tr>
<td bgcolor="#f56026" width="221"><img src="cid:part1.00050907.05030401@kelkoo.com"
alt="Kelkoo" height="111" width="221"></td>
<td style="border-top-width: 1px; border-right-width: 1px;
              border-bottom-width: 1px; border-left-width: 0px;
              border-top-style: solid; border-right-style: solid;
              border-bottom-style: solid; border-left-style: none;
              border-bottom-color: #cccccc; border-top-color: #cccccc;
              border-right-color: #cccccc; font-size:11px;
              color:#666666; line-height:12px; padding:0 0 0 10px;
              margin:0 0 0 0;" width="431">
<p style="line-height:14px; padding:0 0 0 0; margin:0 0 0
                0; font-family:Arial, Helvetica, sans-serif;">
<span style="font-size:18px; color:#f56026;"><strong>Hélène Delanoeye </strong></span>Software
engineer / Search team<br>
<br>
<span style="color:#f56026;"><strong>E</strong></span><a href="mailto:helene.delanoeye@kelkoo.com"
style="text-decoration:none; color:#666;"> helene.delanoeye@kelkoo.com</a>&nbsp;&nbsp;&nbsp;&nbsp;<span
style="color:#f56026;"><strong>Y!Messenger</strong></span> kelkoohelened<br>
<span style="color:#f56026;"><strong>T</strong></span> (&#43;33)
4 56 09 07 57&nbsp;&nbsp;&nbsp;&nbsp;<br>
<span style="color:#f56026;"><strong>A</strong></span> 6, rue des
Méridiens 38130 Echirolles FRANCE</p>
</td>
</tr>
<tr>
<td><img src="cid:part3.09030104.09000709@kelkoo.com" style="display:block;" height="20"
width="221"></td>
<td><img src="cid:part4.05080400.00050100@kelkoo.com" style="display:block;" align="top"
height="20" width="431"></td>
</tr>
</tbody>
</table>
</div>
<br>
<hr>
<font face="Arial" color="Gray" size="1">Kelkoo SAS<br>
Société par Actions Simplifiée<br>
Au capital de € 4.168.964,30<br>
Siège social : 8, rue du Sentier 75002 Paris<br>
425 093 069 RCS Paris<br>
<br>
Ce message et les pièces jointes sont confidentiels et établis à l'attention exclusive
de leurs destinataires. Si vous n'êtes pas le destinataire de ce message, merci de le détruire
et d'en avertir l'expéditeur.<br>
</font>
</body>
</html>

Mime
View raw message