spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steven Ruppert <ste...@fullcontact.com>
Subject Does anybody use spark.rpc.io.mode=epoll?
Date Tue, 07 Mar 2017 19:46:23 GMT
The epoll mode definitely exists in spark, but the official
documentation does not mention it, nor any of the other settings that
appear to be unofficially documented in:

https://github.com/jaceklaskowski/mastering-apache-spark-book/blob/master/spark-rpc-netty.adoc

I don't seem to have any particular performance problems with the
default NIO impl, but the "lower gc pressure" mentioned in the
official netty docs
https://github.com/netty/netty/wiki/Native-transports does seem
attractive.

However, the fact that it's not even documented gives me pause. Is it
deprecated, or perhaps just not useful? Do I have to stick the native
library jar into the spark classpath to use it?

-- 
*CONFIDENTIALITY NOTICE: This email message, and any documents, files or 
previous e-mail messages attached to it is for the sole use of the intended 
recipient(s) and may contain confidential and privileged information. Any 
unauthorized review, use, disclosure or distribution is prohibited. If you 
are not the intended recipient, please contact the sender by reply email 
and destroy all copies of the original message.*

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message