spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcelo Vanzin <>
Subject Re: how to run spark job on yarn with jni lib?
Date Thu, 25 Sep 2014 15:53:31 GMT
Hmmm, you might be suffering from SPARK-1719.

Not sure what the proper workaround is, but it sounds like your native
libs are not in any of the "standard" lib directories; one workaround
might be to copy them there, or add their location to /etc/
(I'm assuming Linux).

On Thu, Sep 25, 2014 at 8:34 AM, taqilabon <> wrote:
> Hi all,
> I tried to run my spark job on yarn.
> In my application, I need to call third-parity jni libraries in a spark job.
> However, I can't find a way to make spark job load my native libraries.
> Is there anyone who knows how to solve this problem?
> Thanks.
> Ziv Huang
> --
> View this message in context:
> Sent from the Apache Spark User List mailing list archive at
> ---------------------------------------------------------------------
> To unsubscribe, e-mail:
> For additional commands, e-mail:


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message