spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hélène Delanoeye <>
Subject Issue with Spark-1.1.0 and the script
Date Thu, 25 Sep 2014 09:44:01 GMT
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<body bgcolor="#FFFFFF" text="#000000">
We've just experienced an issue with the new Spark-1.1.0 and the script.<br>
We tried to launch with &quot;--master yarn&quot; option and
got the following error message :<br>
<i>Failed to load Hive Thrift server main class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2.<br>
You need to build Spark with -Phive. </i><br>
In fact Spark was built with -Phive option, but the real problem was this one :<br>
<i>Application appattempt_1411058337040_0118_000001 submitted by user xxxxx&nbsp;
to unknown queue: default</i><br>
So the solution was to specified the queue, and it works : <br>
/opt/spark/sbin/ --master yarn --queue spark-batch<br>
Hope this could help, as the error message is not really clear (and rather wrong).<br>
<div class="moz-signature">-- <br>
<table border="0" cellpadding="0" cellspacing="0" width="652">
<td bgcolor="#f56026" width="221"><img src=""
alt="Kelkoo" height="111" width="221"></td>
<td style="border-top-width: 1px; border-right-width: 1px;
              border-bottom-width: 1px; border-left-width: 0px;
              border-top-style: solid; border-right-style: solid;
              border-bottom-style: solid; border-left-style: none;
              border-bottom-color: #cccccc; border-top-color: #cccccc;
              border-right-color: #cccccc; font-size:11px;
              color:#666666; line-height:12px; padding:0 0 0 10px;
              margin:0 0 0 0;" width="431">
<p style="line-height:14px; padding:0 0 0 0; margin:0 0 0
                0; font-family:Arial, Helvetica, sans-serif;">
<span style="font-size:18px; color:#f56026;"><strong>Hélène Delanoeye </strong></span>Software
engineer / Search team<br>
<span style="color:#f56026;"><strong>E</strong></span><a href=""
style="text-decoration:none; color:#666;"></a>&nbsp;&nbsp;&nbsp;&nbsp;<span
style="color:#f56026;"><strong>Y!Messenger</strong></span> kelkoohelened<br>
<span style="color:#f56026;"><strong>T</strong></span> (&#43;33)
4 56 09 07 57&nbsp;&nbsp;&nbsp;&nbsp;<br>
<span style="color:#f56026;"><strong>A</strong></span> 6, rue des
Méridiens 38130 Echirolles FRANCE</p>
<td><img src="" style="display:block;" height="20"
<td><img src="" style="display:block;" align="top"
height="20" width="431"></td>
<font face="Arial" color="Gray" size="1">Kelkoo SAS<br>
Société par Actions Simplifiée<br>
Au capital de € 4.168.964,30<br>
Siège social : 8, rue du Sentier 75002 Paris<br>
425 093 069 RCS Paris<br>
Ce message et les pièces jointes sont confidentiels et établis à l'attention exclusive
de leurs destinataires. Si vous n'êtes pas le destinataire de ce message, merci de le détruire
et d'en avertir l'expéditeur.<br>

View raw message