spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yanbo Liang <yanboha...@gmail.com>
Subject Re: how to know the Spark worker Mechanism
Date Tue, 18 Nov 2014 08:32:20 GMT
Did you set spark.executor.extraLibraryPath to the directory which your
native library exists?

2014-11-18 16:13 GMT+08:00 tangweihan <tangweihan@360.cn>:

> I'm a newbee in Spark. I know that what the work should do is written in
> RDD.
> But I want to make the worker load a native lib and I can do something to
> change the content of the lib in memory.
> So how can I do. I can do it on driver, but not worker. I always get a
> fatal
> error. The jvm report A fatal error
>  C  [libstdc++.so.6+0x64d24]
> std::_Rb_tree_rotate_left(std::_Rb_tree_node_base*,
> std::_Rb_tree_node_base*&)+0x4
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/how-to-know-the-Spark-worker-Mechanism-tp19141.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Mime
View raw message